Dec 04 00:27:39.127654 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 00:27:39.287162 master-0 kubenswrapper[4799]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:27:39.287162 master-0 kubenswrapper[4799]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 00:27:39.287162 master-0 kubenswrapper[4799]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:27:39.288490 master-0 kubenswrapper[4799]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:27:39.288490 master-0 kubenswrapper[4799]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 00:27:39.288490 master-0 kubenswrapper[4799]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:27:39.288667 master-0 kubenswrapper[4799]: I1204 00:27:39.288417 4799 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294077 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294108 4799 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294117 4799 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294127 4799 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294136 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294147 4799 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294155 4799 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294164 4799 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:27:39.294143 master-0 kubenswrapper[4799]: W1204 00:27:39.294173 4799 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294182 4799 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294191 4799 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294202 4799 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294213 4799 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294221 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294230 4799 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294240 4799 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294256 4799 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294264 4799 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294274 4799 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294283 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294292 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294300 4799 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294309 4799 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294317 4799 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294325 4799 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294334 4799 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294341 4799 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294349 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:27:39.294613 master-0 kubenswrapper[4799]: W1204 00:27:39.294356 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294364 4799 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294372 4799 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294379 4799 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294387 4799 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294395 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294403 4799 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294410 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294418 4799 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294426 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294433 4799 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294442 4799 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294450 4799 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294459 4799 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294474 4799 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294483 4799 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294491 4799 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294499 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294508 4799 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294515 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:27:39.295129 master-0 kubenswrapper[4799]: W1204 00:27:39.294523 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294531 4799 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294541 4799 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294590 4799 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294602 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294611 4799 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294620 4799 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294631 4799 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294639 4799 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294648 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294656 4799 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294664 4799 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294672 4799 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294681 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294690 4799 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294698 4799 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294705 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294713 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294721 4799 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:27:39.295849 master-0 kubenswrapper[4799]: W1204 00:27:39.294731 4799 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: W1204 00:27:39.294741 4799 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: W1204 00:27:39.294750 4799 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: W1204 00:27:39.294761 4799 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: W1204 00:27:39.294771 4799 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.294949 4799 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.294968 4799 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.294986 4799 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.294998 4799 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295009 4799 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295019 4799 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295032 4799 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295043 4799 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295052 4799 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295062 4799 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295071 4799 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295082 4799 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295091 4799 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295100 4799 flags.go:64] FLAG: --cgroup-root="" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295109 4799 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295118 4799 flags.go:64] FLAG: --client-ca-file="" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295128 4799 flags.go:64] FLAG: --cloud-config="" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295138 4799 flags.go:64] FLAG: --cloud-provider="" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295147 4799 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 00:27:39.296332 master-0 kubenswrapper[4799]: I1204 00:27:39.295158 4799 flags.go:64] FLAG: --cluster-domain="" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295168 4799 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295178 4799 flags.go:64] FLAG: --config-dir="" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295187 4799 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295197 4799 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295209 4799 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295218 4799 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295227 4799 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295237 4799 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295246 4799 flags.go:64] FLAG: --contention-profiling="false" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295254 4799 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295263 4799 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295272 4799 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295282 4799 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295293 4799 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295303 4799 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295312 4799 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295321 4799 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295330 4799 flags.go:64] FLAG: --enable-server="true" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295339 4799 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295351 4799 flags.go:64] FLAG: --event-burst="100" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295361 4799 flags.go:64] FLAG: --event-qps="50" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295369 4799 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295380 4799 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295389 4799 flags.go:64] FLAG: --eviction-hard="" Dec 04 00:27:39.296874 master-0 kubenswrapper[4799]: I1204 00:27:39.295400 4799 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295409 4799 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295418 4799 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295427 4799 flags.go:64] FLAG: --eviction-soft="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295437 4799 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295446 4799 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295454 4799 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295463 4799 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295472 4799 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295481 4799 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295490 4799 flags.go:64] FLAG: --feature-gates="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295501 4799 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295510 4799 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295519 4799 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295528 4799 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295537 4799 flags.go:64] FLAG: --healthz-port="10248" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295547 4799 flags.go:64] FLAG: --help="false" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295555 4799 flags.go:64] FLAG: --hostname-override="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295564 4799 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295574 4799 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295583 4799 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295592 4799 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295602 4799 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295611 4799 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295620 4799 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 00:27:39.297441 master-0 kubenswrapper[4799]: I1204 00:27:39.295629 4799 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295640 4799 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295650 4799 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295659 4799 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295668 4799 flags.go:64] FLAG: --kube-reserved="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295678 4799 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295686 4799 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295696 4799 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295705 4799 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295714 4799 flags.go:64] FLAG: --lock-file="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295724 4799 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295733 4799 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295742 4799 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295755 4799 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295765 4799 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295774 4799 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295783 4799 flags.go:64] FLAG: --logging-format="text" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295792 4799 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295802 4799 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295811 4799 flags.go:64] FLAG: --manifest-url="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295820 4799 flags.go:64] FLAG: --manifest-url-header="" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295831 4799 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295843 4799 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295857 4799 flags.go:64] FLAG: --max-pods="110" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295870 4799 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 00:27:39.298059 master-0 kubenswrapper[4799]: I1204 00:27:39.295882 4799 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295893 4799 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295903 4799 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295914 4799 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295955 4799 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295965 4799 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.295992 4799 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296001 4799 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296010 4799 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296019 4799 flags.go:64] FLAG: --pod-cidr="" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296028 4799 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fff930cf757e23d388d86d05942b76e44d3bda5e387b299c239e4d12545d26dd" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296043 4799 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296052 4799 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296061 4799 flags.go:64] FLAG: --pods-per-core="0" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296070 4799 flags.go:64] FLAG: --port="10250" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296080 4799 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296089 4799 flags.go:64] FLAG: --provider-id="" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296098 4799 flags.go:64] FLAG: --qos-reserved="" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296107 4799 flags.go:64] FLAG: --read-only-port="10255" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296116 4799 flags.go:64] FLAG: --register-node="true" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296126 4799 flags.go:64] FLAG: --register-schedulable="true" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296136 4799 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296151 4799 flags.go:64] FLAG: --registry-burst="10" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296159 4799 flags.go:64] FLAG: --registry-qps="5" Dec 04 00:27:39.298640 master-0 kubenswrapper[4799]: I1204 00:27:39.296168 4799 flags.go:64] FLAG: --reserved-cpus="" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296177 4799 flags.go:64] FLAG: --reserved-memory="" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296188 4799 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296197 4799 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296206 4799 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296215 4799 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296223 4799 flags.go:64] FLAG: --runonce="false" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296232 4799 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296242 4799 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296251 4799 flags.go:64] FLAG: --seccomp-default="false" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296260 4799 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296270 4799 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296279 4799 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296289 4799 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296298 4799 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296307 4799 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296315 4799 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296324 4799 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296333 4799 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296344 4799 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296353 4799 flags.go:64] FLAG: --system-cgroups="" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296363 4799 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296376 4799 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296386 4799 flags.go:64] FLAG: --tls-cert-file="" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296395 4799 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 00:27:39.299212 master-0 kubenswrapper[4799]: I1204 00:27:39.296406 4799 flags.go:64] FLAG: --tls-min-version="" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296414 4799 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296423 4799 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296432 4799 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296441 4799 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296450 4799 flags.go:64] FLAG: --v="2" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296462 4799 flags.go:64] FLAG: --version="false" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296474 4799 flags.go:64] FLAG: --vmodule="" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296485 4799 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: I1204 00:27:39.296495 4799 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296726 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296736 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296745 4799 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296755 4799 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296764 4799 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296772 4799 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296782 4799 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296792 4799 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296803 4799 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296814 4799 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296822 4799 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296830 4799 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:27:39.299744 master-0 kubenswrapper[4799]: W1204 00:27:39.296837 4799 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296845 4799 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296853 4799 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296862 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296870 4799 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296880 4799 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296888 4799 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296897 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296906 4799 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296915 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296924 4799 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296973 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296981 4799 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296990 4799 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.296998 4799 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297006 4799 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297013 4799 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297022 4799 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297031 4799 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297039 4799 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:27:39.300264 master-0 kubenswrapper[4799]: W1204 00:27:39.297047 4799 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297056 4799 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297064 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297073 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297081 4799 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297088 4799 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297096 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297104 4799 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297113 4799 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297121 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297129 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297137 4799 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297147 4799 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297159 4799 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297169 4799 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297179 4799 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297189 4799 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297197 4799 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297206 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:27:39.300728 master-0 kubenswrapper[4799]: W1204 00:27:39.297214 4799 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297222 4799 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297229 4799 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297246 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297254 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297262 4799 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297270 4799 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297278 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297286 4799 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297294 4799 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297302 4799 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297309 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297317 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297325 4799 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297332 4799 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297340 4799 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297348 4799 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297356 4799 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297368 4799 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297378 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:27:39.301420 master-0 kubenswrapper[4799]: W1204 00:27:39.297387 4799 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:27:39.301838 master-0 kubenswrapper[4799]: I1204 00:27:39.297410 4799 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:27:39.305831 master-0 kubenswrapper[4799]: I1204 00:27:39.305751 4799 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 00:27:39.305831 master-0 kubenswrapper[4799]: I1204 00:27:39.305789 4799 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305865 4799 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305874 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305878 4799 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305883 4799 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305887 4799 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305892 4799 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305896 4799 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305900 4799 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305905 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305909 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305913 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305917 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305920 4799 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305940 4799 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305944 4799 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305949 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305954 4799 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305958 4799 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305961 4799 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:27:39.306136 master-0 kubenswrapper[4799]: W1204 00:27:39.305965 4799 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305971 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305976 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305980 4799 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305986 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305991 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.305998 4799 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306003 4799 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306008 4799 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306012 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306016 4799 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306021 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306025 4799 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306030 4799 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306037 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306042 4799 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306047 4799 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306054 4799 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306058 4799 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:27:39.306684 master-0 kubenswrapper[4799]: W1204 00:27:39.306063 4799 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306068 4799 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306073 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306077 4799 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306081 4799 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306086 4799 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306091 4799 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306097 4799 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306103 4799 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306110 4799 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306115 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306120 4799 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306125 4799 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306129 4799 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306134 4799 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306139 4799 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306145 4799 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306149 4799 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306154 4799 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:27:39.307439 master-0 kubenswrapper[4799]: W1204 00:27:39.306159 4799 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306164 4799 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306168 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306172 4799 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306179 4799 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306185 4799 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306190 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306195 4799 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306200 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306205 4799 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306210 4799 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306214 4799 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306219 4799 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306224 4799 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: W1204 00:27:39.306228 4799 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:27:39.308027 master-0 kubenswrapper[4799]: I1204 00:27:39.306236 4799 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306375 4799 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306384 4799 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306390 4799 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306395 4799 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306400 4799 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306404 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306410 4799 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306417 4799 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306422 4799 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306427 4799 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306432 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306436 4799 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306441 4799 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306445 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306450 4799 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306455 4799 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306460 4799 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306465 4799 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306469 4799 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:27:39.308374 master-0 kubenswrapper[4799]: W1204 00:27:39.306473 4799 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306477 4799 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306481 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306484 4799 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306487 4799 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306492 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306498 4799 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306503 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306507 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306511 4799 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306515 4799 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306519 4799 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306523 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306526 4799 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306530 4799 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306533 4799 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306537 4799 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306541 4799 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306545 4799 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:27:39.308799 master-0 kubenswrapper[4799]: W1204 00:27:39.306548 4799 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306552 4799 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306555 4799 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306559 4799 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306590 4799 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306595 4799 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306599 4799 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306603 4799 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306606 4799 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306610 4799 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306614 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306618 4799 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306621 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306625 4799 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306629 4799 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306632 4799 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306636 4799 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306639 4799 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306643 4799 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:27:39.309222 master-0 kubenswrapper[4799]: W1204 00:27:39.306647 4799 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306651 4799 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306656 4799 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306662 4799 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306666 4799 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306672 4799 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306677 4799 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306681 4799 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306686 4799 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306692 4799 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306696 4799 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306701 4799 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306705 4799 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306710 4799 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: W1204 00:27:39.306714 4799 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:27:39.309627 master-0 kubenswrapper[4799]: I1204 00:27:39.306720 4799 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:27:39.309970 master-0 kubenswrapper[4799]: I1204 00:27:39.306861 4799 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 00:27:39.309970 master-0 kubenswrapper[4799]: I1204 00:27:39.308564 4799 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Dec 04 00:27:39.309970 master-0 kubenswrapper[4799]: I1204 00:27:39.309123 4799 server.go:997] "Starting client certificate rotation" Dec 04 00:27:39.309970 master-0 kubenswrapper[4799]: I1204 00:27:39.309145 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 00:27:39.309970 master-0 kubenswrapper[4799]: I1204 00:27:39.309349 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 00:27:39.314313 master-0 kubenswrapper[4799]: I1204 00:27:39.314266 4799 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:27:39.315728 master-0 kubenswrapper[4799]: I1204 00:27:39.315683 4799 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:27:39.317520 master-0 kubenswrapper[4799]: E1204 00:27:39.317378 4799 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:39.325811 master-0 kubenswrapper[4799]: I1204 00:27:39.325738 4799 log.go:25] "Validated CRI v1 runtime API" Dec 04 00:27:39.329220 master-0 kubenswrapper[4799]: I1204 00:27:39.329082 4799 log.go:25] "Validated CRI v1 image API" Dec 04 00:27:39.332108 master-0 kubenswrapper[4799]: I1204 00:27:39.332052 4799 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 00:27:39.336160 master-0 kubenswrapper[4799]: I1204 00:27:39.336058 4799 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4 b7c19a61-c15a-446d-937b-5d5c941bb8bc:/dev/vda3] Dec 04 00:27:39.336160 master-0 kubenswrapper[4799]: I1204 00:27:39.336113 4799 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0}] Dec 04 00:27:39.376450 master-0 kubenswrapper[4799]: I1204 00:27:39.375873 4799 manager.go:217] Machine: {Timestamp:2025-12-04 00:27:39.373276481 +0000 UTC m=+0.189897079 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:eb95431843ee4cf58882520b84731300 SystemUUID:eb954318-43ee-4cf5-8882-520b84731300 BootID:b925b56b-e641-48cc-9935-878f5ab258fa Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:ea:1e:17 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d2:13:f5 Speed:-1 Mtu:9000} {Name:ovs-system MacAddress:b2:0a:5f:ad:6c:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 00:27:39.376450 master-0 kubenswrapper[4799]: I1204 00:27:39.376378 4799 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 00:27:39.376883 master-0 kubenswrapper[4799]: I1204 00:27:39.376595 4799 manager.go:233] Version: {KernelVersion:5.14.0-427.97.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511041748-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 00:27:39.377552 master-0 kubenswrapper[4799]: I1204 00:27:39.377499 4799 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 00:27:39.377993 master-0 kubenswrapper[4799]: I1204 00:27:39.377879 4799 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 00:27:39.378353 master-0 kubenswrapper[4799]: I1204 00:27:39.377989 4799 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 00:27:39.378443 master-0 kubenswrapper[4799]: I1204 00:27:39.378387 4799 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 00:27:39.378443 master-0 kubenswrapper[4799]: I1204 00:27:39.378407 4799 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 00:27:39.378898 master-0 kubenswrapper[4799]: I1204 00:27:39.378857 4799 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:27:39.378996 master-0 kubenswrapper[4799]: I1204 00:27:39.378911 4799 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:27:39.379212 master-0 kubenswrapper[4799]: I1204 00:27:39.379175 4799 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:27:39.379365 master-0 kubenswrapper[4799]: I1204 00:27:39.379330 4799 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 00:27:39.381387 master-0 kubenswrapper[4799]: I1204 00:27:39.381331 4799 kubelet.go:418] "Attempting to sync node with API server" Dec 04 00:27:39.381387 master-0 kubenswrapper[4799]: I1204 00:27:39.381366 4799 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 00:27:39.381618 master-0 kubenswrapper[4799]: I1204 00:27:39.381409 4799 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 00:27:39.381618 master-0 kubenswrapper[4799]: I1204 00:27:39.381431 4799 kubelet.go:324] "Adding apiserver pod source" Dec 04 00:27:39.381618 master-0 kubenswrapper[4799]: I1204 00:27:39.381460 4799 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 00:27:39.384278 master-0 kubenswrapper[4799]: I1204 00:27:39.384228 4799 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 00:27:39.385207 master-0 kubenswrapper[4799]: I1204 00:27:39.385163 4799 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 00:27:39.385207 master-0 kubenswrapper[4799]: W1204 00:27:39.385132 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:39.385398 master-0 kubenswrapper[4799]: W1204 00:27:39.385114 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:39.385398 master-0 kubenswrapper[4799]: E1204 00:27:39.385251 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:39.385398 master-0 kubenswrapper[4799]: E1204 00:27:39.385265 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385408 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385430 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385440 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385449 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385458 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385466 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385476 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385484 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385495 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385505 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385517 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 00:27:39.385660 master-0 kubenswrapper[4799]: I1204 00:27:39.385530 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 00:27:39.386592 master-0 kubenswrapper[4799]: I1204 00:27:39.386150 4799 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 00:27:39.386719 master-0 kubenswrapper[4799]: I1204 00:27:39.386697 4799 server.go:1280] "Started kubelet" Dec 04 00:27:39.387226 master-0 kubenswrapper[4799]: I1204 00:27:39.387069 4799 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 00:27:39.387997 master-0 kubenswrapper[4799]: I1204 00:27:39.387100 4799 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 00:27:39.388406 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 00:27:39.390750 master-0 kubenswrapper[4799]: I1204 00:27:39.390398 4799 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 00:27:39.392819 master-0 kubenswrapper[4799]: I1204 00:27:39.392767 4799 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 00:27:39.393475 master-0 kubenswrapper[4799]: I1204 00:27:39.393450 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 00:27:39.393895 master-0 kubenswrapper[4799]: I1204 00:27:39.393874 4799 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 00:27:39.394191 master-0 kubenswrapper[4799]: E1204 00:27:39.394142 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:27:39.394191 master-0 kubenswrapper[4799]: I1204 00:27:39.394180 4799 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 00:27:39.394320 master-0 kubenswrapper[4799]: I1204 00:27:39.394250 4799 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 00:27:39.394320 master-0 kubenswrapper[4799]: I1204 00:27:39.394244 4799 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 00:27:39.394509 master-0 kubenswrapper[4799]: I1204 00:27:39.394424 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:39.394941 master-0 kubenswrapper[4799]: E1204 00:27:39.394430 4799 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/default/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{master-0.187ddb94647d021e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,LastTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:39.396540 master-0 kubenswrapper[4799]: I1204 00:27:39.396499 4799 factory.go:55] Registering systemd factory Dec 04 00:27:39.396540 master-0 kubenswrapper[4799]: I1204 00:27:39.396536 4799 factory.go:221] Registration of the systemd container factory successfully Dec 04 00:27:39.397267 master-0 kubenswrapper[4799]: I1204 00:27:39.397176 4799 factory.go:153] Registering CRI-O factory Dec 04 00:27:39.397267 master-0 kubenswrapper[4799]: I1204 00:27:39.397226 4799 factory.go:221] Registration of the crio container factory successfully Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: I1204 00:27:39.397313 4799 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: I1204 00:27:39.397352 4799 factory.go:103] Registering Raw factory Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: I1204 00:27:39.397297 4799 reconstruct.go:97] "Volume reconstruction finished" Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: I1204 00:27:39.397380 4799 reconciler.go:26] "Reconciler: start to sync state" Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: I1204 00:27:39.397383 4799 manager.go:1196] Started watching for new ooms in manager Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: W1204 00:27:39.397455 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: E1204 00:27:39.397547 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:39.397586 master-0 kubenswrapper[4799]: E1204 00:27:39.397563 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 00:27:39.398310 master-0 kubenswrapper[4799]: I1204 00:27:39.398272 4799 manager.go:319] Starting recovery of all containers Dec 04 00:27:39.398406 master-0 kubenswrapper[4799]: I1204 00:27:39.398351 4799 server.go:449] "Adding debug handlers to kubelet server" Dec 04 00:27:39.402905 master-0 kubenswrapper[4799]: E1204 00:27:39.402864 4799 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Dec 04 00:27:39.428236 master-0 kubenswrapper[4799]: I1204 00:27:39.427799 4799 manager.go:324] Recovery completed Dec 04 00:27:39.447038 master-0 kubenswrapper[4799]: I1204 00:27:39.446982 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.449006 master-0 kubenswrapper[4799]: I1204 00:27:39.448888 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.449088 master-0 kubenswrapper[4799]: I1204 00:27:39.449016 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.449088 master-0 kubenswrapper[4799]: I1204 00:27:39.449035 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.449858 master-0 kubenswrapper[4799]: I1204 00:27:39.449812 4799 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 00:27:39.449858 master-0 kubenswrapper[4799]: I1204 00:27:39.449838 4799 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 00:27:39.450032 master-0 kubenswrapper[4799]: I1204 00:27:39.449872 4799 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:27:39.452775 master-0 kubenswrapper[4799]: I1204 00:27:39.452707 4799 policy_none.go:49] "None policy: Start" Dec 04 00:27:39.453851 master-0 kubenswrapper[4799]: I1204 00:27:39.453805 4799 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 00:27:39.453851 master-0 kubenswrapper[4799]: I1204 00:27:39.453840 4799 state_mem.go:35] "Initializing new in-memory state store" Dec 04 00:27:39.494894 master-0 kubenswrapper[4799]: E1204 00:27:39.494848 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:27:39.527563 master-0 kubenswrapper[4799]: I1204 00:27:39.527518 4799 manager.go:334] "Starting Device Plugin manager" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.527581 4799 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.527600 4799 server.go:79] "Starting device plugin registration server" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.528162 4799 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.528180 4799 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.528495 4799 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.528604 4799 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: I1204 00:27:39.528614 4799 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 00:27:39.562235 master-0 kubenswrapper[4799]: E1204 00:27:39.530384 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:27:39.567788 master-0 kubenswrapper[4799]: I1204 00:27:39.567686 4799 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 00:27:39.570183 master-0 kubenswrapper[4799]: I1204 00:27:39.570125 4799 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 00:27:39.570264 master-0 kubenswrapper[4799]: I1204 00:27:39.570244 4799 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 00:27:39.570306 master-0 kubenswrapper[4799]: I1204 00:27:39.570291 4799 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 00:27:39.570438 master-0 kubenswrapper[4799]: E1204 00:27:39.570392 4799 kubelet.go:2359] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Dec 04 00:27:39.571704 master-0 kubenswrapper[4799]: W1204 00:27:39.571631 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:39.571779 master-0 kubenswrapper[4799]: E1204 00:27:39.571722 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:39.600073 master-0 kubenswrapper[4799]: E1204 00:27:39.599976 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 00:27:39.629090 master-0 kubenswrapper[4799]: I1204 00:27:39.629006 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.630334 master-0 kubenswrapper[4799]: I1204 00:27:39.630263 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.630334 master-0 kubenswrapper[4799]: I1204 00:27:39.630335 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.630482 master-0 kubenswrapper[4799]: I1204 00:27:39.630354 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.630482 master-0 kubenswrapper[4799]: I1204 00:27:39.630393 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:39.631584 master-0 kubenswrapper[4799]: E1204 00:27:39.631529 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:39.670784 master-0 kubenswrapper[4799]: I1204 00:27:39.670656 4799 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-etcd/etcd-master-0-master-0","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","kube-system/bootstrap-kube-controller-manager-master-0","kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:27:39.671085 master-0 kubenswrapper[4799]: I1204 00:27:39.670841 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.673089 master-0 kubenswrapper[4799]: I1204 00:27:39.673043 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.673089 master-0 kubenswrapper[4799]: I1204 00:27:39.673089 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.673239 master-0 kubenswrapper[4799]: I1204 00:27:39.673099 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.673306 master-0 kubenswrapper[4799]: I1204 00:27:39.673246 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.673878 master-0 kubenswrapper[4799]: I1204 00:27:39.673831 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.673983 master-0 kubenswrapper[4799]: I1204 00:27:39.673949 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.674370 master-0 kubenswrapper[4799]: I1204 00:27:39.674335 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.674370 master-0 kubenswrapper[4799]: I1204 00:27:39.674363 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.674370 master-0 kubenswrapper[4799]: I1204 00:27:39.674374 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.674602 master-0 kubenswrapper[4799]: I1204 00:27:39.674444 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.674764 master-0 kubenswrapper[4799]: I1204 00:27:39.674709 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.674905 master-0 kubenswrapper[4799]: I1204 00:27:39.674837 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.675132 master-0 kubenswrapper[4799]: I1204 00:27:39.675102 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.675132 master-0 kubenswrapper[4799]: I1204 00:27:39.675123 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.675132 master-0 kubenswrapper[4799]: I1204 00:27:39.675133 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.675366 master-0 kubenswrapper[4799]: I1204 00:27:39.675183 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.675366 master-0 kubenswrapper[4799]: I1204 00:27:39.675220 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.675366 master-0 kubenswrapper[4799]: I1204 00:27:39.675232 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.675366 master-0 kubenswrapper[4799]: I1204 00:27:39.675265 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.675864 master-0 kubenswrapper[4799]: I1204 00:27:39.675449 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.675864 master-0 kubenswrapper[4799]: I1204 00:27:39.675515 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.676558 master-0 kubenswrapper[4799]: I1204 00:27:39.676524 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.676558 master-0 kubenswrapper[4799]: I1204 00:27:39.676540 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.676558 master-0 kubenswrapper[4799]: I1204 00:27:39.676554 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.676558 master-0 kubenswrapper[4799]: I1204 00:27:39.676568 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.676558 master-0 kubenswrapper[4799]: I1204 00:27:39.676572 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676584 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676636 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676678 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676693 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676731 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.677075 master-0 kubenswrapper[4799]: I1204 00:27:39.676850 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.677423 master-0 kubenswrapper[4799]: I1204 00:27:39.677335 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.680678 master-0 kubenswrapper[4799]: I1204 00:27:39.680621 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.680678 master-0 kubenswrapper[4799]: I1204 00:27:39.680671 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.680906 master-0 kubenswrapper[4799]: I1204 00:27:39.680694 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.681031 master-0 kubenswrapper[4799]: I1204 00:27:39.680989 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.681031 master-0 kubenswrapper[4799]: I1204 00:27:39.681022 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.681141 master-0 kubenswrapper[4799]: I1204 00:27:39.681073 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.681141 master-0 kubenswrapper[4799]: I1204 00:27:39.681137 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.681260 master-0 kubenswrapper[4799]: I1204 00:27:39.681152 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.683156 master-0 kubenswrapper[4799]: I1204 00:27:39.683100 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.683291 master-0 kubenswrapper[4799]: I1204 00:27:39.683161 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.683291 master-0 kubenswrapper[4799]: I1204 00:27:39.683181 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.699315 master-0 kubenswrapper[4799]: I1204 00:27:39.699206 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.699315 master-0 kubenswrapper[4799]: I1204 00:27:39.699288 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.699315 master-0 kubenswrapper[4799]: I1204 00:27:39.699317 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.699573 master-0 kubenswrapper[4799]: I1204 00:27:39.699338 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.699573 master-0 kubenswrapper[4799]: I1204 00:27:39.699404 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.699573 master-0 kubenswrapper[4799]: I1204 00:27:39.699433 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.699573 master-0 kubenswrapper[4799]: I1204 00:27:39.699511 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.699573 master-0 kubenswrapper[4799]: I1204 00:27:39.699564 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.699850 master-0 kubenswrapper[4799]: I1204 00:27:39.699585 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.699850 master-0 kubenswrapper[4799]: I1204 00:27:39.699666 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.699850 master-0 kubenswrapper[4799]: I1204 00:27:39.699728 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.699850 master-0 kubenswrapper[4799]: I1204 00:27:39.699756 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.699850 master-0 kubenswrapper[4799]: I1204 00:27:39.699779 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.700181 master-0 kubenswrapper[4799]: I1204 00:27:39.699850 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.700181 master-0 kubenswrapper[4799]: I1204 00:27:39.699902 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.700181 master-0 kubenswrapper[4799]: I1204 00:27:39.699976 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.700181 master-0 kubenswrapper[4799]: I1204 00:27:39.700028 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.800809 master-0 kubenswrapper[4799]: I1204 00:27:39.800723 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.800809 master-0 kubenswrapper[4799]: I1204 00:27:39.800788 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.800809 master-0 kubenswrapper[4799]: I1204 00:27:39.800811 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.800809 master-0 kubenswrapper[4799]: I1204 00:27:39.800833 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800856 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800876 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800896 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800915 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800947 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800965 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.800983 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801000 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801019 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801038 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801057 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801051 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801088 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801075 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801135 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801123 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.801276 master-0 kubenswrapper[4799]: I1204 00:27:39.801175 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801137 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801170 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801260 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801055 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801189 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801175 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801298 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801330 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801353 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801331 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801370 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801439 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.802303 master-0 kubenswrapper[4799]: I1204 00:27:39.801318 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:39.832249 master-0 kubenswrapper[4799]: I1204 00:27:39.832136 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:39.833880 master-0 kubenswrapper[4799]: I1204 00:27:39.833820 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:39.834060 master-0 kubenswrapper[4799]: I1204 00:27:39.833888 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:39.834060 master-0 kubenswrapper[4799]: I1204 00:27:39.833908 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:39.834060 master-0 kubenswrapper[4799]: I1204 00:27:39.834020 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:39.835307 master-0 kubenswrapper[4799]: E1204 00:27:39.835225 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:40.002260 master-0 kubenswrapper[4799]: E1204 00:27:40.002064 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 00:27:40.008910 master-0 kubenswrapper[4799]: I1204 00:27:40.008804 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:27:40.028745 master-0 kubenswrapper[4799]: I1204 00:27:40.028660 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:40.039205 master-0 kubenswrapper[4799]: I1204 00:27:40.039115 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:27:40.054509 master-0 kubenswrapper[4799]: I1204 00:27:40.054424 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:40.062780 master-0 kubenswrapper[4799]: I1204 00:27:40.062714 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:27:40.236298 master-0 kubenswrapper[4799]: I1204 00:27:40.236150 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:40.238405 master-0 kubenswrapper[4799]: I1204 00:27:40.238343 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:40.238405 master-0 kubenswrapper[4799]: I1204 00:27:40.238400 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:40.238616 master-0 kubenswrapper[4799]: I1204 00:27:40.238420 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:40.238616 master-0 kubenswrapper[4799]: I1204 00:27:40.238483 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:40.239961 master-0 kubenswrapper[4799]: E1204 00:27:40.239832 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:40.280714 master-0 kubenswrapper[4799]: W1204 00:27:40.280471 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:40.280714 master-0 kubenswrapper[4799]: E1204 00:27:40.280611 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:40.386200 master-0 kubenswrapper[4799]: W1204 00:27:40.386031 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:40.386200 master-0 kubenswrapper[4799]: E1204 00:27:40.386185 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:40.398245 master-0 kubenswrapper[4799]: I1204 00:27:40.398173 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:40.566776 master-0 kubenswrapper[4799]: W1204 00:27:40.566588 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:40.566776 master-0 kubenswrapper[4799]: E1204 00:27:40.566669 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:40.569810 master-0 kubenswrapper[4799]: W1204 00:27:40.569714 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:40.569884 master-0 kubenswrapper[4799]: E1204 00:27:40.569830 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:40.746756 master-0 kubenswrapper[4799]: W1204 00:27:40.746621 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13238af3704fe583f617f61e755cf4c2.slice/crio-65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51 WatchSource:0}: Error finding container 65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51: Status 404 returned error can't find the container with id 65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51 Dec 04 00:27:40.755763 master-0 kubenswrapper[4799]: I1204 00:27:40.755709 4799 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:27:40.765771 master-0 kubenswrapper[4799]: W1204 00:27:40.765692 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bce50c457ac1f4721bc81a570dd238a.slice/crio-e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe WatchSource:0}: Error finding container e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe: Status 404 returned error can't find the container with id e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe Dec 04 00:27:40.803783 master-0 kubenswrapper[4799]: E1204 00:27:40.803650 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 00:27:40.810255 master-0 kubenswrapper[4799]: W1204 00:27:40.810175 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b95a38663dd6fe34e183818a475977.slice/crio-f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84 WatchSource:0}: Error finding container f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84: Status 404 returned error can't find the container with id f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84 Dec 04 00:27:40.868165 master-0 kubenswrapper[4799]: W1204 00:27:40.868081 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb495b0c38f2c54e7cc46282c5f92aab5.slice/crio-00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b WatchSource:0}: Error finding container 00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b: Status 404 returned error can't find the container with id 00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b Dec 04 00:27:41.040832 master-0 kubenswrapper[4799]: I1204 00:27:41.040647 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:41.042558 master-0 kubenswrapper[4799]: I1204 00:27:41.042496 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:41.042626 master-0 kubenswrapper[4799]: I1204 00:27:41.042590 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:41.042673 master-0 kubenswrapper[4799]: I1204 00:27:41.042624 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:41.042744 master-0 kubenswrapper[4799]: I1204 00:27:41.042707 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:41.044141 master-0 kubenswrapper[4799]: E1204 00:27:41.044064 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:41.366072 master-0 kubenswrapper[4799]: I1204 00:27:41.365911 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 00:27:41.368321 master-0 kubenswrapper[4799]: E1204 00:27:41.368248 4799 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:41.398900 master-0 kubenswrapper[4799]: I1204 00:27:41.398821 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:41.577004 master-0 kubenswrapper[4799]: I1204 00:27:41.576481 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b"} Dec 04 00:27:41.577542 master-0 kubenswrapper[4799]: I1204 00:27:41.577494 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84"} Dec 04 00:27:41.578597 master-0 kubenswrapper[4799]: I1204 00:27:41.578568 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe"} Dec 04 00:27:41.579770 master-0 kubenswrapper[4799]: I1204 00:27:41.579735 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51"} Dec 04 00:27:41.580955 master-0 kubenswrapper[4799]: I1204 00:27:41.580914 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerStarted","Data":"635bc81a309df7832d537de83efd770b2125edb6f2daccb7afe434b4d90fe5b6"} Dec 04 00:27:42.154814 master-0 kubenswrapper[4799]: W1204 00:27:42.154737 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:42.155048 master-0 kubenswrapper[4799]: E1204 00:27:42.154818 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:42.398291 master-0 kubenswrapper[4799]: I1204 00:27:42.398223 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:42.404987 master-0 kubenswrapper[4799]: E1204 00:27:42.404875 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 00:27:42.644364 master-0 kubenswrapper[4799]: I1204 00:27:42.644261 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:42.645772 master-0 kubenswrapper[4799]: I1204 00:27:42.645715 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:42.645833 master-0 kubenswrapper[4799]: I1204 00:27:42.645785 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:42.645833 master-0 kubenswrapper[4799]: I1204 00:27:42.645798 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:42.645916 master-0 kubenswrapper[4799]: I1204 00:27:42.645879 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:42.647042 master-0 kubenswrapper[4799]: E1204 00:27:42.646959 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:42.729642 master-0 kubenswrapper[4799]: W1204 00:27:42.729454 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:42.729642 master-0 kubenswrapper[4799]: E1204 00:27:42.729513 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:43.397624 master-0 kubenswrapper[4799]: I1204 00:27:43.397553 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:43.638703 master-0 kubenswrapper[4799]: W1204 00:27:43.638615 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:43.638703 master-0 kubenswrapper[4799]: E1204 00:27:43.638687 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:43.745397 master-0 kubenswrapper[4799]: W1204 00:27:43.745283 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:43.745397 master-0 kubenswrapper[4799]: E1204 00:27:43.745333 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:44.401806 master-0 kubenswrapper[4799]: I1204 00:27:44.401742 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:45.367240 master-0 kubenswrapper[4799]: W1204 00:27:45.367077 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:45.367980 master-0 kubenswrapper[4799]: E1204 00:27:45.367245 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:45.397913 master-0 kubenswrapper[4799]: I1204 00:27:45.397840 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:45.469260 master-0 kubenswrapper[4799]: I1204 00:27:45.469164 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 00:27:45.470415 master-0 kubenswrapper[4799]: E1204 00:27:45.470370 4799 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:45.606285 master-0 kubenswrapper[4799]: E1204 00:27:45.606217 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 00:27:45.847442 master-0 kubenswrapper[4799]: I1204 00:27:45.847361 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:45.849229 master-0 kubenswrapper[4799]: I1204 00:27:45.849140 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:45.849229 master-0 kubenswrapper[4799]: I1204 00:27:45.849192 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:45.849229 master-0 kubenswrapper[4799]: I1204 00:27:45.849206 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:45.849229 master-0 kubenswrapper[4799]: I1204 00:27:45.849266 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:45.850341 master-0 kubenswrapper[4799]: E1204 00:27:45.850281 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 00:27:46.398415 master-0 kubenswrapper[4799]: I1204 00:27:46.398277 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:46.543311 master-0 kubenswrapper[4799]: E1204 00:27:46.543112 4799 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/default/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{master-0.187ddb94647d021e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,LastTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:47.218159 master-0 kubenswrapper[4799]: W1204 00:27:47.217910 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:47.218159 master-0 kubenswrapper[4799]: E1204 00:27:47.218100 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:47.398162 master-0 kubenswrapper[4799]: I1204 00:27:47.398012 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:48.398222 master-0 kubenswrapper[4799]: I1204 00:27:48.398166 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:48.443015 master-0 kubenswrapper[4799]: W1204 00:27:48.442943 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:48.443168 master-0 kubenswrapper[4799]: E1204 00:27:48.443027 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:49.074745 master-0 kubenswrapper[4799]: W1204 00:27:49.074604 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:49.074745 master-0 kubenswrapper[4799]: E1204 00:27:49.074697 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:49.397787 master-0 kubenswrapper[4799]: I1204 00:27:49.397699 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:49.530584 master-0 kubenswrapper[4799]: E1204 00:27:49.530485 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:27:50.398777 master-0 kubenswrapper[4799]: I1204 00:27:50.398668 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:51.398401 master-0 kubenswrapper[4799]: I1204 00:27:51.398318 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:51.609405 master-0 kubenswrapper[4799]: I1204 00:27:51.609310 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"c9637097b486453df64c71018abb37b06dfffe6f736dcd239764c377bfc5b3ec"} Dec 04 00:27:51.609405 master-0 kubenswrapper[4799]: I1204 00:27:51.609384 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"e06a5b4e4be58273879a0e221f9819c741e49f33730780a29935b023d52dc5fc"} Dec 04 00:27:51.609796 master-0 kubenswrapper[4799]: I1204 00:27:51.609503 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:51.611203 master-0 kubenswrapper[4799]: I1204 00:27:51.611141 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:51.611203 master-0 kubenswrapper[4799]: I1204 00:27:51.611206 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:51.611469 master-0 kubenswrapper[4799]: I1204 00:27:51.611224 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:51.612889 master-0 kubenswrapper[4799]: I1204 00:27:51.612818 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742"} Dec 04 00:27:51.614800 master-0 kubenswrapper[4799]: I1204 00:27:51.614724 4799 generic.go:334] "Generic (PLEG): container finished" podID="13238af3704fe583f617f61e755cf4c2" containerID="87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899" exitCode=0 Dec 04 00:27:51.614800 master-0 kubenswrapper[4799]: I1204 00:27:51.614801 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerDied","Data":"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899"} Dec 04 00:27:51.615014 master-0 kubenswrapper[4799]: I1204 00:27:51.614886 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:51.615794 master-0 kubenswrapper[4799]: I1204 00:27:51.615746 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:51.615794 master-0 kubenswrapper[4799]: I1204 00:27:51.615781 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:51.615794 master-0 kubenswrapper[4799]: I1204 00:27:51.615794 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:51.619381 master-0 kubenswrapper[4799]: I1204 00:27:51.619292 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerStarted","Data":"c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48"} Dec 04 00:27:51.619381 master-0 kubenswrapper[4799]: I1204 00:27:51.619341 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:51.620456 master-0 kubenswrapper[4799]: I1204 00:27:51.620400 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:51.621060 master-0 kubenswrapper[4799]: I1204 00:27:51.621005 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:51.621060 master-0 kubenswrapper[4799]: I1204 00:27:51.621044 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:51.621060 master-0 kubenswrapper[4799]: I1204 00:27:51.621062 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:51.621644 master-0 kubenswrapper[4799]: I1204 00:27:51.621581 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:51.621644 master-0 kubenswrapper[4799]: I1204 00:27:51.621620 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:51.621644 master-0 kubenswrapper[4799]: I1204 00:27:51.621632 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:51.623015 master-0 kubenswrapper[4799]: I1204 00:27:51.622897 4799 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532" exitCode=0 Dec 04 00:27:51.623015 master-0 kubenswrapper[4799]: I1204 00:27:51.623000 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532"} Dec 04 00:27:51.623223 master-0 kubenswrapper[4799]: I1204 00:27:51.623076 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:51.623984 master-0 kubenswrapper[4799]: I1204 00:27:51.623902 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:51.623984 master-0 kubenswrapper[4799]: I1204 00:27:51.623955 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:51.623984 master-0 kubenswrapper[4799]: I1204 00:27:51.623969 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:51.910614 master-0 kubenswrapper[4799]: W1204 00:27:51.910514 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 00:27:51.910808 master-0 kubenswrapper[4799]: E1204 00:27:51.910640 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 00:27:52.251439 master-0 kubenswrapper[4799]: I1204 00:27:52.251363 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:52.252338 master-0 kubenswrapper[4799]: I1204 00:27:52.252318 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:52.252429 master-0 kubenswrapper[4799]: I1204 00:27:52.252346 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:52.252429 master-0 kubenswrapper[4799]: I1204 00:27:52.252354 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:52.252429 master-0 kubenswrapper[4799]: I1204 00:27:52.252400 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:27:52.627831 master-0 kubenswrapper[4799]: I1204 00:27:52.627764 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/0.log" Dec 04 00:27:52.628527 master-0 kubenswrapper[4799]: I1204 00:27:52.628468 4799 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="d67b139af93c29c4cb84f0b8a41adce0affb52d2afea04a38c7d8c3fedd49f11" exitCode=1 Dec 04 00:27:52.628617 master-0 kubenswrapper[4799]: I1204 00:27:52.628568 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"d67b139af93c29c4cb84f0b8a41adce0affb52d2afea04a38c7d8c3fedd49f11"} Dec 04 00:27:52.628617 master-0 kubenswrapper[4799]: I1204 00:27:52.628581 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:52.629878 master-0 kubenswrapper[4799]: I1204 00:27:52.629783 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:52.629878 master-0 kubenswrapper[4799]: I1204 00:27:52.629839 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:52.629878 master-0 kubenswrapper[4799]: I1204 00:27:52.629860 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:52.630463 master-0 kubenswrapper[4799]: I1204 00:27:52.630332 4799 scope.go:117] "RemoveContainer" containerID="d67b139af93c29c4cb84f0b8a41adce0affb52d2afea04a38c7d8c3fedd49f11" Dec 04 00:27:52.632117 master-0 kubenswrapper[4799]: I1204 00:27:52.631101 4799 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742" exitCode=1 Dec 04 00:27:52.632117 master-0 kubenswrapper[4799]: I1204 00:27:52.631202 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerDied","Data":"7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742"} Dec 04 00:27:52.633835 master-0 kubenswrapper[4799]: I1204 00:27:52.633788 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b"} Dec 04 00:27:52.633835 master-0 kubenswrapper[4799]: I1204 00:27:52.633822 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:52.634004 master-0 kubenswrapper[4799]: I1204 00:27:52.633963 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:52.634668 master-0 kubenswrapper[4799]: I1204 00:27:52.634636 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:52.634721 master-0 kubenswrapper[4799]: I1204 00:27:52.634673 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:52.634721 master-0 kubenswrapper[4799]: I1204 00:27:52.634683 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:52.634810 master-0 kubenswrapper[4799]: I1204 00:27:52.634777 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:52.634844 master-0 kubenswrapper[4799]: I1204 00:27:52.634819 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:52.634844 master-0 kubenswrapper[4799]: I1204 00:27:52.634838 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:53.646373 master-0 kubenswrapper[4799]: I1204 00:27:53.646297 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/1.log" Dec 04 00:27:53.647191 master-0 kubenswrapper[4799]: I1204 00:27:53.647143 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/0.log" Dec 04 00:27:53.647732 master-0 kubenswrapper[4799]: I1204 00:27:53.647690 4799 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3" exitCode=1 Dec 04 00:27:53.647779 master-0 kubenswrapper[4799]: I1204 00:27:53.647745 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3"} Dec 04 00:27:53.647847 master-0 kubenswrapper[4799]: I1204 00:27:53.647815 4799 scope.go:117] "RemoveContainer" containerID="d67b139af93c29c4cb84f0b8a41adce0affb52d2afea04a38c7d8c3fedd49f11" Dec 04 00:27:53.647991 master-0 kubenswrapper[4799]: I1204 00:27:53.647957 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:53.648990 master-0 kubenswrapper[4799]: I1204 00:27:53.648950 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:53.649028 master-0 kubenswrapper[4799]: I1204 00:27:53.649000 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:53.649028 master-0 kubenswrapper[4799]: I1204 00:27:53.649022 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:53.649485 master-0 kubenswrapper[4799]: I1204 00:27:53.649448 4799 scope.go:117] "RemoveContainer" containerID="51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3" Dec 04 00:27:53.649760 master-0 kubenswrapper[4799]: E1204 00:27:53.649713 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="b495b0c38f2c54e7cc46282c5f92aab5" Dec 04 00:27:53.743170 master-0 kubenswrapper[4799]: I1204 00:27:53.743046 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 00:27:53.766220 master-0 kubenswrapper[4799]: E1204 00:27:53.766140 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 00:27:53.766478 master-0 kubenswrapper[4799]: I1204 00:27:53.766325 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:53.766548 master-0 kubenswrapper[4799]: E1204 00:27:53.766466 4799 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: certificatesigningrequests.certificates.k8s.io is forbidden: User \"system:serviceaccount:openshift-machine-config-operator:node-bootstrapper\" cannot create resource \"certificatesigningrequests\" in API group \"certificates.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 00:27:53.766548 master-0 kubenswrapper[4799]: E1204 00:27:53.766521 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 00:27:54.402756 master-0 kubenswrapper[4799]: I1204 00:27:54.402626 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:54.651726 master-0 kubenswrapper[4799]: I1204 00:27:54.651619 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/1.log" Dec 04 00:27:54.652362 master-0 kubenswrapper[4799]: I1204 00:27:54.652218 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:54.653019 master-0 kubenswrapper[4799]: I1204 00:27:54.652971 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:54.653019 master-0 kubenswrapper[4799]: I1204 00:27:54.653015 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:54.653019 master-0 kubenswrapper[4799]: I1204 00:27:54.653023 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:54.653307 master-0 kubenswrapper[4799]: I1204 00:27:54.653268 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"dc41179c1a580bee9c34b2c3240d03c90cf58b6d028827131798a90b8fc42f51"} Dec 04 00:27:54.653353 master-0 kubenswrapper[4799]: I1204 00:27:54.653344 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:54.653393 master-0 kubenswrapper[4799]: I1204 00:27:54.653380 4799 scope.go:117] "RemoveContainer" containerID="51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3" Dec 04 00:27:54.653529 master-0 kubenswrapper[4799]: E1204 00:27:54.653497 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="b495b0c38f2c54e7cc46282c5f92aab5" Dec 04 00:27:54.653764 master-0 kubenswrapper[4799]: I1204 00:27:54.653736 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:54.653764 master-0 kubenswrapper[4799]: I1204 00:27:54.653761 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:54.653836 master-0 kubenswrapper[4799]: I1204 00:27:54.653771 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:54.653971 master-0 kubenswrapper[4799]: I1204 00:27:54.653953 4799 scope.go:117] "RemoveContainer" containerID="7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742" Dec 04 00:27:54.655319 master-0 kubenswrapper[4799]: I1204 00:27:54.655279 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be"} Dec 04 00:27:54.655394 master-0 kubenswrapper[4799]: I1204 00:27:54.655347 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:54.655877 master-0 kubenswrapper[4799]: I1204 00:27:54.655841 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:54.655877 master-0 kubenswrapper[4799]: I1204 00:27:54.655863 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:54.655877 master-0 kubenswrapper[4799]: I1204 00:27:54.655871 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:55.402581 master-0 kubenswrapper[4799]: I1204 00:27:55.402508 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:55.445231 master-0 kubenswrapper[4799]: I1204 00:27:55.445132 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:55.456001 master-0 kubenswrapper[4799]: I1204 00:27:55.455864 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:55.660969 master-0 kubenswrapper[4799]: I1204 00:27:55.660816 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792"} Dec 04 00:27:55.660969 master-0 kubenswrapper[4799]: I1204 00:27:55.660860 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:55.660969 master-0 kubenswrapper[4799]: I1204 00:27:55.660907 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:55.661599 master-0 kubenswrapper[4799]: I1204 00:27:55.661076 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662226 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662253 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662265 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662367 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662412 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:55.662788 master-0 kubenswrapper[4799]: I1204 00:27:55.662435 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:55.806588 master-0 kubenswrapper[4799]: I1204 00:27:55.806507 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:55.813130 master-0 kubenswrapper[4799]: I1204 00:27:55.813090 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:56.403627 master-0 kubenswrapper[4799]: I1204 00:27:56.403520 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:56.548867 master-0 kubenswrapper[4799]: E1204 00:27:56.548552 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb94647d021e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,LastTimestamp:2025-12-04 00:27:39.386659358 +0000 UTC m=+0.203279876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.554823 master-0 kubenswrapper[4799]: E1204 00:27:56.554610 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.559081 master-0 kubenswrapper[4799]: E1204 00:27:56.558899 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.564858 master-0 kubenswrapper[4799]: E1204 00:27:56.564697 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.571898 master-0 kubenswrapper[4799]: E1204 00:27:56.571472 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946d0f1e35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.530452533 +0000 UTC m=+0.347073051,LastTimestamp:2025-12-04 00:27:39.530452533 +0000 UTC m=+0.347073051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.576946 master-0 kubenswrapper[4799]: E1204 00:27:56.576757 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.630321027 +0000 UTC m=+0.446941535,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.582299 master-0 kubenswrapper[4799]: E1204 00:27:56.582126 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.630343578 +0000 UTC m=+0.446964086,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.586817 master-0 kubenswrapper[4799]: E1204 00:27:56.586652 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.630361638 +0000 UTC m=+0.446982146,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.591917 master-0 kubenswrapper[4799]: E1204 00:27:56.591683 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.673080456 +0000 UTC m=+0.489700964,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.596324 master-0 kubenswrapper[4799]: E1204 00:27:56.596149 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.673095506 +0000 UTC m=+0.489716004,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.600416 master-0 kubenswrapper[4799]: E1204 00:27:56.600292 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.673106366 +0000 UTC m=+0.489726874,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.604945 master-0 kubenswrapper[4799]: E1204 00:27:56.604810 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.674352739 +0000 UTC m=+0.490973247,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.610745 master-0 kubenswrapper[4799]: E1204 00:27:56.610627 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.674370569 +0000 UTC m=+0.490991077,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.615980 master-0 kubenswrapper[4799]: E1204 00:27:56.615881 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.674381619 +0000 UTC m=+0.491002127,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.621386 master-0 kubenswrapper[4799]: E1204 00:27:56.621173 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.675118717 +0000 UTC m=+0.491739225,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.626606 master-0 kubenswrapper[4799]: E1204 00:27:56.626479 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.675128687 +0000 UTC m=+0.491749195,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.630951 master-0 kubenswrapper[4799]: E1204 00:27:56.630730 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.675138627 +0000 UTC m=+0.491759125,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.638236 master-0 kubenswrapper[4799]: E1204 00:27:56.638049 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.675201158 +0000 UTC m=+0.491821666,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.643076 master-0 kubenswrapper[4799]: E1204 00:27:56.642900 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.675227408 +0000 UTC m=+0.491847916,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.647316 master-0 kubenswrapper[4799]: E1204 00:27:56.647146 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.675238648 +0000 UTC m=+0.491859156,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.652605 master-0 kubenswrapper[4799]: E1204 00:27:56.652477 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.676542001 +0000 UTC m=+0.493162509,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.660695 master-0 kubenswrapper[4799]: E1204 00:27:56.660517 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.676561482 +0000 UTC m=+0.493181990,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.662598 master-0 kubenswrapper[4799]: I1204 00:27:56.662562 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:56.663226 master-0 kubenswrapper[4799]: I1204 00:27:56.662631 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:56.663226 master-0 kubenswrapper[4799]: I1204 00:27:56.662885 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:56.663612 master-0 kubenswrapper[4799]: I1204 00:27:56.663585 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:56.663673 master-0 kubenswrapper[4799]: I1204 00:27:56.663616 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:56.663673 master-0 kubenswrapper[4799]: I1204 00:27:56.663634 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:56.663818 master-0 kubenswrapper[4799]: I1204 00:27:56.663778 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:56.663862 master-0 kubenswrapper[4799]: I1204 00:27:56.663839 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:56.663862 master-0 kubenswrapper[4799]: I1204 00:27:56.663856 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:56.667803 master-0 kubenswrapper[4799]: E1204 00:27:56.667684 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb9468342fcb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb9468342fcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.448995787 +0000 UTC m=+0.265616315,LastTimestamp:2025-12-04 00:27:39.676559612 +0000 UTC m=+0.493180120,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.672056 master-0 kubenswrapper[4799]: I1204 00:27:56.672019 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:27:56.672589 master-0 kubenswrapper[4799]: E1204 00:27:56.672444 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ed86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ed86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449044358 +0000 UTC m=+0.265664876,LastTimestamp:2025-12-04 00:27:39.676574552 +0000 UTC m=+0.493195060,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.679416 master-0 kubenswrapper[4799]: E1204 00:27:56.679225 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187ddb946834ae5c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187ddb946834ae5c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:39.449028188 +0000 UTC m=+0.265648706,LastTimestamp:2025-12-04 00:27:39.676580262 +0000 UTC m=+0.493200760,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.686830 master-0 kubenswrapper[4799]: E1204 00:27:56.686676 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb94b615adff openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:40.755619327 +0000 UTC m=+1.572239845,LastTimestamp:2025-12-04 00:27:40.755619327 +0000 UTC m=+1.572239845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.694176 master-0 kubenswrapper[4799]: E1204 00:27:56.694013 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb94b6f7f0e7 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:40.770447591 +0000 UTC m=+1.587068109,LastTimestamp:2025-12-04 00:27:40.770447591 +0000 UTC m=+1.587068109,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.699561 master-0 kubenswrapper[4799]: E1204 00:27:56.699348 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb94b985b302 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:40.81329229 +0000 UTC m=+1.629912848,LastTimestamp:2025-12-04 00:27:40.81329229 +0000 UTC m=+1.629912848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.703782 master-0 kubenswrapper[4799]: E1204 00:27:56.703652 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb94bcf95323 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:40.871201571 +0000 UTC m=+1.687822119,LastTimestamp:2025-12-04 00:27:40.871201571 +0000 UTC m=+1.687822119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.707745 master-0 kubenswrapper[4799]: E1204 00:27:56.707626 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187ddb94bf6b30ae kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:d78739a7694769882b7e47ea5ac08a10,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:40.912218286 +0000 UTC m=+1.728838834,LastTimestamp:2025-12-04 00:27:40.912218286 +0000 UTC m=+1.728838834,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.712706 master-0 kubenswrapper[4799]: E1204 00:27:56.712544 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb97173a3c9f openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\" in 10.104s (10.104s including waiting). Image size: 459566623 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:50.975339679 +0000 UTC m=+11.791960187,LastTimestamp:2025-12-04 00:27:50.975339679 +0000 UTC m=+11.791960187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.718700 master-0 kubenswrapper[4799]: E1204 00:27:56.718551 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb97187daee0 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\" in 10.183s (10.183s including waiting). Image size: 532668041 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:50.996537056 +0000 UTC m=+11.813157564,LastTimestamp:2025-12-04 00:27:50.996537056 +0000 UTC m=+11.813157564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.725015 master-0 kubenswrapper[4799]: E1204 00:27:56.724808 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187ddb9719c501bd kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:d78739a7694769882b7e47ea5ac08a10,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" in 10.105s (10.105s including waiting). Image size: 938321573 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.017988541 +0000 UTC m=+11.834609079,LastTimestamp:2025-12-04 00:27:51.017988541 +0000 UTC m=+11.834609079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.731864 master-0 kubenswrapper[4799]: E1204 00:27:56.731705 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb971b663be5 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" in 10.289s (10.289s including waiting). Image size: 938321573 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.045331941 +0000 UTC m=+11.861952479,LastTimestamp:2025-12-04 00:27:51.045331941 +0000 UTC m=+11.861952479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.738032 master-0 kubenswrapper[4799]: E1204 00:27:56.737823 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb971de15109 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" in 10.316s (10.316s including waiting). Image size: 938321573 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.086952713 +0000 UTC m=+11.903573261,LastTimestamp:2025-12-04 00:27:51.086952713 +0000 UTC m=+11.903573261,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.744660 master-0 kubenswrapper[4799]: E1204 00:27:56.744404 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb9727ecd975 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.255480693 +0000 UTC m=+12.072101221,LastTimestamp:2025-12-04 00:27:51.255480693 +0000 UTC m=+12.072101221,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.751637 master-0 kubenswrapper[4799]: E1204 00:27:56.751466 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb9728bb702e openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Created,Message:Created container: etcdctl,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.269019694 +0000 UTC m=+12.085640202,LastTimestamp:2025-12-04 00:27:51.269019694 +0000 UTC m=+12.085640202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.757843 master-0 kubenswrapper[4799]: E1204 00:27:56.757678 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb972914c20d openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.274873357 +0000 UTC m=+12.091493865,LastTimestamp:2025-12-04 00:27:51.274873357 +0000 UTC m=+12.091493865,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.763519 master-0 kubenswrapper[4799]: E1204 00:27:56.763263 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb972948cffe kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.278284798 +0000 UTC m=+12.094905306,LastTimestamp:2025-12-04 00:27:51.278284798 +0000 UTC m=+12.094905306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.772557 master-0 kubenswrapper[4799]: E1204 00:27:56.772389 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb97297cd06b openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.281692779 +0000 UTC m=+12.098313287,LastTimestamp:2025-12-04 00:27:51.281692779 +0000 UTC m=+12.098313287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.779799 master-0 kubenswrapper[4799]: E1204 00:27:56.779624 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb97298a71d1 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Started,Message:Started container etcdctl,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.282586065 +0000 UTC m=+12.099206573,LastTimestamp:2025-12-04 00:27:51.282586065 +0000 UTC m=+12.099206573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.785449 master-0 kubenswrapper[4799]: E1204 00:27:56.785310 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb9729acddae openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.284841902 +0000 UTC m=+12.101462410,LastTimestamp:2025-12-04 00:27:51.284841902 +0000 UTC m=+12.101462410,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.792602 master-0 kubenswrapper[4799]: E1204 00:27:56.792414 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb9729f2baa0 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.289420448 +0000 UTC m=+12.106040966,LastTimestamp:2025-12-04 00:27:51.289420448 +0000 UTC m=+12.106040966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.799702 master-0 kubenswrapper[4799]: E1204 00:27:56.799557 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb972a0d4da3 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.291162019 +0000 UTC m=+12.107782527,LastTimestamp:2025-12-04 00:27:51.291162019 +0000 UTC m=+12.107782527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.804986 master-0 kubenswrapper[4799]: E1204 00:27:56.804824 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb972a709e1a openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.297670682 +0000 UTC m=+12.114291190,LastTimestamp:2025-12-04 00:27:51.297670682 +0000 UTC m=+12.114291190,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.811614 master-0 kubenswrapper[4799]: E1204 00:27:56.811486 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187ddb97326227fc kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:d78739a7694769882b7e47ea5ac08a10,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Created,Message:Created container: kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.430940668 +0000 UTC m=+12.247561186,LastTimestamp:2025-12-04 00:27:51.430940668 +0000 UTC m=+12.247561186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.816047 master-0 kubenswrapper[4799]: E1204 00:27:56.815880 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187ddb97332b8aac kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:d78739a7694769882b7e47ea5ac08a10,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Started,Message:Started container kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.444138668 +0000 UTC m=+12.260759176,LastTimestamp:2025-12-04 00:27:51.444138668 +0000 UTC m=+12.260759176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.820955 master-0 kubenswrapper[4799]: E1204 00:27:56.820767 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb97365c91f4 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Created,Message:Created container: etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.497683444 +0000 UTC m=+12.314303962,LastTimestamp:2025-12-04 00:27:51.497683444 +0000 UTC m=+12.314303962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.825346 master-0 kubenswrapper[4799]: E1204 00:27:56.825176 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddb9737365cd8 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Started,Message:Started container etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.511956696 +0000 UTC m=+12.328577244,LastTimestamp:2025-12-04 00:27:51.511956696 +0000 UTC m=+12.328577244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.830967 master-0 kubenswrapper[4799]: E1204 00:27:56.830827 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb973dabc985 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.620315525 +0000 UTC m=+12.436936073,LastTimestamp:2025-12-04 00:27:51.620315525 +0000 UTC m=+12.436936073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.836691 master-0 kubenswrapper[4799]: E1204 00:27:56.836497 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb973e5b741b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.631827995 +0000 UTC m=+12.448448513,LastTimestamp:2025-12-04 00:27:51.631827995 +0000 UTC m=+12.448448513,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.844109 master-0 kubenswrapper[4799]: E1204 00:27:56.843908 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb974afa0844 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Created,Message:Created container: kube-apiserver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.843547204 +0000 UTC m=+12.660167712,LastTimestamp:2025-12-04 00:27:51.843547204 +0000 UTC m=+12.660167712,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.851454 master-0 kubenswrapper[4799]: E1204 00:27:56.851315 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb974b98cc0c openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Started,Message:Started container kube-apiserver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.853952012 +0000 UTC m=+12.670572530,LastTimestamp:2025-12-04 00:27:51.853952012 +0000 UTC m=+12.670572530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.858978 master-0 kubenswrapper[4799]: E1204 00:27:56.858787 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb974ba95e52 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.855038034 +0000 UTC m=+12.671658582,LastTimestamp:2025-12-04 00:27:51.855038034 +0000 UTC m=+12.671658582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.865850 master-0 kubenswrapper[4799]: E1204 00:27:56.865487 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974c28f07a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.863398522 +0000 UTC m=+12.680019040,LastTimestamp:2025-12-04 00:27:51.863398522 +0000 UTC m=+12.680019040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.871401 master-0 kubenswrapper[4799]: E1204 00:27:56.871258 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974da0eb2d openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.888038701 +0000 UTC m=+12.704659239,LastTimestamp:2025-12-04 00:27:51.888038701 +0000 UTC m=+12.704659239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.878979 master-0 kubenswrapper[4799]: E1204 00:27:56.878809 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb973e5b741b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb973e5b741b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.631827995 +0000 UTC m=+12.448448513,LastTimestamp:2025-12-04 00:27:52.632629287 +0000 UTC m=+13.449249795,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.884659 master-0 kubenswrapper[4799]: E1204 00:27:56.884548 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb974c28f07a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974c28f07a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.863398522 +0000 UTC m=+12.680019040,LastTimestamp:2025-12-04 00:27:52.834816733 +0000 UTC m=+13.651437261,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.890024 master-0 kubenswrapper[4799]: E1204 00:27:56.889881 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb974da0eb2d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974da0eb2d openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.888038701 +0000 UTC m=+12.704659239,LastTimestamp:2025-12-04 00:27:52.848739775 +0000 UTC m=+13.665360293,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.897554 master-0 kubenswrapper[4799]: E1204 00:27:56.897470 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb97b6a0ba91 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:53.649633937 +0000 UTC m=+14.466254475,LastTimestamp:2025-12-04 00:27:53.649633937 +0000 UTC m=+14.466254475,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.902947 master-0 kubenswrapper[4799]: E1204 00:27:56.902710 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb97dbf993ae kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\" in 2.985s (2.985s including waiting). Image size: 499719811 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.276213678 +0000 UTC m=+15.092834186,LastTimestamp:2025-12-04 00:27:54.276213678 +0000 UTC m=+15.092834186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.909547 master-0 kubenswrapper[4799]: E1204 00:27:56.909434 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb97dc7e5682 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\" in 2.429s (2.429s including waiting). Image size: 509451797 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.284914306 +0000 UTC m=+15.101534814,LastTimestamp:2025-12-04 00:27:54.284914306 +0000 UTC m=+15.101534814,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.916505 master-0 kubenswrapper[4799]: E1204 00:27:56.916325 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb97e7999b40 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Created,Message:Created container: kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.471250752 +0000 UTC m=+15.287871260,LastTimestamp:2025-12-04 00:27:54.471250752 +0000 UTC m=+15.287871260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.922391 master-0 kubenswrapper[4799]: E1204 00:27:56.922252 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb97e7c82731 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Created,Message:Created container: cluster-policy-controller,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.474301233 +0000 UTC m=+15.290921741,LastTimestamp:2025-12-04 00:27:54.474301233 +0000 UTC m=+15.290921741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.928815 master-0 kubenswrapper[4799]: E1204 00:27:56.928685 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187ddb97e84ddc4a openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:13238af3704fe583f617f61e755cf4c2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Started,Message:Started container kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.483063882 +0000 UTC m=+15.299684390,LastTimestamp:2025-12-04 00:27:54.483063882 +0000 UTC m=+15.299684390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.933575 master-0 kubenswrapper[4799]: E1204 00:27:56.933443 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb97e880d0bd kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Started,Message:Started container cluster-policy-controller,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.486403261 +0000 UTC m=+15.303023769,LastTimestamp:2025-12-04 00:27:54.486403261 +0000 UTC m=+15.303023769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.941119 master-0 kubenswrapper[4799]: E1204 00:27:56.940906 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb97b6a0ba91\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb97b6a0ba91 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:53.649633937 +0000 UTC m=+14.466254475,LastTimestamp:2025-12-04 00:27:54.653481758 +0000 UTC m=+15.470102266,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.948018 master-0 kubenswrapper[4799]: E1204 00:27:56.947699 4799 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb97f29f2bbd kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:54.656164797 +0000 UTC m=+15.472785315,LastTimestamp:2025-12-04 00:27:54.656164797 +0000 UTC m=+15.472785315,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.955498 master-0 kubenswrapper[4799]: E1204 00:27:56.955323 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"bootstrap-kube-controller-manager-master-0.187ddb972948cffe\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb972948cffe kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.278284798 +0000 UTC m=+12.094905306,LastTimestamp:2025-12-04 00:27:54.930773568 +0000 UTC m=+15.747394076,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:56.962392 master-0 kubenswrapper[4799]: E1204 00:27:56.962304 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"bootstrap-kube-controller-manager-master-0.187ddb9729f2baa0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187ddb9729f2baa0 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:7bce50c457ac1f4721bc81a570dd238a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.289420448 +0000 UTC m=+12.106040966,LastTimestamp:2025-12-04 00:27:54.939080744 +0000 UTC m=+15.755701252,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:27:57.404426 master-0 kubenswrapper[4799]: I1204 00:27:57.404370 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:57.637905 master-0 kubenswrapper[4799]: W1204 00:27:57.637813 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Dec 04 00:27:57.637905 master-0 kubenswrapper[4799]: E1204 00:27:57.637883 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 00:27:57.665472 master-0 kubenswrapper[4799]: I1204 00:27:57.665004 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:57.666290 master-0 kubenswrapper[4799]: I1204 00:27:57.666064 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:57.666290 master-0 kubenswrapper[4799]: I1204 00:27:57.666100 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:57.666290 master-0 kubenswrapper[4799]: I1204 00:27:57.666116 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:57.753462 master-0 kubenswrapper[4799]: W1204 00:27:57.753399 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope Dec 04 00:27:57.753697 master-0 kubenswrapper[4799]: E1204 00:27:57.753498 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 00:27:57.808338 master-0 kubenswrapper[4799]: I1204 00:27:57.808234 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:27:57.808626 master-0 kubenswrapper[4799]: I1204 00:27:57.808396 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:57.813751 master-0 kubenswrapper[4799]: I1204 00:27:57.813682 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:57.813904 master-0 kubenswrapper[4799]: I1204 00:27:57.813780 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:57.813904 master-0 kubenswrapper[4799]: I1204 00:27:57.813844 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:57.918128 master-0 kubenswrapper[4799]: W1204 00:27:57.917973 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Dec 04 00:27:57.918128 master-0 kubenswrapper[4799]: E1204 00:27:57.918044 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 00:27:58.405173 master-0 kubenswrapper[4799]: I1204 00:27:58.405057 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:58.668549 master-0 kubenswrapper[4799]: I1204 00:27:58.668364 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:27:58.669787 master-0 kubenswrapper[4799]: I1204 00:27:58.669699 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:27:58.669889 master-0 kubenswrapper[4799]: I1204 00:27:58.669789 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:27:58.669889 master-0 kubenswrapper[4799]: I1204 00:27:58.669817 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:27:59.405989 master-0 kubenswrapper[4799]: I1204 00:27:59.405888 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:27:59.530829 master-0 kubenswrapper[4799]: E1204 00:27:59.530702 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:28:00.405755 master-0 kubenswrapper[4799]: I1204 00:28:00.405647 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:00.766818 master-0 kubenswrapper[4799]: I1204 00:28:00.766649 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:00.770719 master-0 kubenswrapper[4799]: I1204 00:28:00.767668 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:00.770719 master-0 kubenswrapper[4799]: I1204 00:28:00.767694 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:00.770719 master-0 kubenswrapper[4799]: I1204 00:28:00.767706 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:00.770719 master-0 kubenswrapper[4799]: I1204 00:28:00.767751 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:28:00.777834 master-0 kubenswrapper[4799]: E1204 00:28:00.777763 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 00:28:00.778220 master-0 kubenswrapper[4799]: E1204 00:28:00.777863 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 00:28:01.405844 master-0 kubenswrapper[4799]: I1204 00:28:01.405765 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:02.405701 master-0 kubenswrapper[4799]: I1204 00:28:02.405605 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:02.881427 master-0 kubenswrapper[4799]: I1204 00:28:02.881343 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:28:02.882430 master-0 kubenswrapper[4799]: I1204 00:28:02.881515 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:02.882607 master-0 kubenswrapper[4799]: I1204 00:28:02.882531 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:02.882607 master-0 kubenswrapper[4799]: I1204 00:28:02.882587 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:02.882607 master-0 kubenswrapper[4799]: I1204 00:28:02.882597 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:02.886476 master-0 kubenswrapper[4799]: I1204 00:28:02.886407 4799 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:28:03.405756 master-0 kubenswrapper[4799]: I1204 00:28:03.405618 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:03.682264 master-0 kubenswrapper[4799]: I1204 00:28:03.682067 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:03.683546 master-0 kubenswrapper[4799]: I1204 00:28:03.683487 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:03.683682 master-0 kubenswrapper[4799]: I1204 00:28:03.683562 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:03.683682 master-0 kubenswrapper[4799]: I1204 00:28:03.683584 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:04.405242 master-0 kubenswrapper[4799]: I1204 00:28:04.405173 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:05.404311 master-0 kubenswrapper[4799]: I1204 00:28:05.404234 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:06.403574 master-0 kubenswrapper[4799]: I1204 00:28:06.403395 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:07.403584 master-0 kubenswrapper[4799]: I1204 00:28:07.403428 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:07.779002 master-0 kubenswrapper[4799]: I1204 00:28:07.778754 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:07.781216 master-0 kubenswrapper[4799]: I1204 00:28:07.781073 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:07.781216 master-0 kubenswrapper[4799]: I1204 00:28:07.781146 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:07.781216 master-0 kubenswrapper[4799]: I1204 00:28:07.781211 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:07.781648 master-0 kubenswrapper[4799]: I1204 00:28:07.781290 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:28:07.787535 master-0 kubenswrapper[4799]: E1204 00:28:07.787478 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 00:28:07.787736 master-0 kubenswrapper[4799]: E1204 00:28:07.787652 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 00:28:07.813485 master-0 kubenswrapper[4799]: I1204 00:28:07.813407 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:28:07.813822 master-0 kubenswrapper[4799]: I1204 00:28:07.813588 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:07.815108 master-0 kubenswrapper[4799]: I1204 00:28:07.815059 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:07.815173 master-0 kubenswrapper[4799]: I1204 00:28:07.815113 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:07.815173 master-0 kubenswrapper[4799]: I1204 00:28:07.815135 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:07.820560 master-0 kubenswrapper[4799]: I1204 00:28:07.820512 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:28:08.214597 master-0 kubenswrapper[4799]: W1204 00:28:08.214480 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:08.214597 master-0 kubenswrapper[4799]: E1204 00:28:08.214562 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 00:28:08.404728 master-0 kubenswrapper[4799]: I1204 00:28:08.404630 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:08.571199 master-0 kubenswrapper[4799]: I1204 00:28:08.571039 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:08.572623 master-0 kubenswrapper[4799]: I1204 00:28:08.572558 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:08.572623 master-0 kubenswrapper[4799]: I1204 00:28:08.572623 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:08.572801 master-0 kubenswrapper[4799]: I1204 00:28:08.572637 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:08.573172 master-0 kubenswrapper[4799]: I1204 00:28:08.573135 4799 scope.go:117] "RemoveContainer" containerID="51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3" Dec 04 00:28:08.585976 master-0 kubenswrapper[4799]: E1204 00:28:08.585761 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb973e5b741b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb973e5b741b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.631827995 +0000 UTC m=+12.448448513,LastTimestamp:2025-12-04 00:28:08.576788374 +0000 UTC m=+29.393408892,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:28:08.696340 master-0 kubenswrapper[4799]: I1204 00:28:08.696179 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:08.697840 master-0 kubenswrapper[4799]: I1204 00:28:08.697791 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:08.697959 master-0 kubenswrapper[4799]: I1204 00:28:08.697848 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:08.697959 master-0 kubenswrapper[4799]: I1204 00:28:08.697868 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:08.847259 master-0 kubenswrapper[4799]: E1204 00:28:08.846900 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb974c28f07a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974c28f07a openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.863398522 +0000 UTC m=+12.680019040,LastTimestamp:2025-12-04 00:28:08.838969877 +0000 UTC m=+29.655590425,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:28:08.865461 master-0 kubenswrapper[4799]: E1204 00:28:08.865228 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb974da0eb2d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb974da0eb2d openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:51.888038701 +0000 UTC m=+12.704659239,LastTimestamp:2025-12-04 00:28:08.858155155 +0000 UTC m=+29.674775673,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:28:09.405836 master-0 kubenswrapper[4799]: I1204 00:28:09.405336 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:09.531622 master-0 kubenswrapper[4799]: E1204 00:28:09.531542 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:28:09.701970 master-0 kubenswrapper[4799]: I1204 00:28:09.701725 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/2.log" Dec 04 00:28:09.702623 master-0 kubenswrapper[4799]: I1204 00:28:09.702511 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/1.log" Dec 04 00:28:09.703952 master-0 kubenswrapper[4799]: I1204 00:28:09.703098 4799 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" exitCode=1 Dec 04 00:28:09.703952 master-0 kubenswrapper[4799]: I1204 00:28:09.703147 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c"} Dec 04 00:28:09.703952 master-0 kubenswrapper[4799]: I1204 00:28:09.703199 4799 scope.go:117] "RemoveContainer" containerID="51a18202a7126cd8d8d82d4f9bb03a9a591e022cf6fe38ce9bff3c6dc21a31e3" Dec 04 00:28:09.703952 master-0 kubenswrapper[4799]: I1204 00:28:09.703391 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:09.706066 master-0 kubenswrapper[4799]: I1204 00:28:09.704608 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:09.706066 master-0 kubenswrapper[4799]: I1204 00:28:09.704640 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:09.706066 master-0 kubenswrapper[4799]: I1204 00:28:09.704656 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:09.706066 master-0 kubenswrapper[4799]: I1204 00:28:09.705081 4799 scope.go:117] "RemoveContainer" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" Dec 04 00:28:09.706066 master-0 kubenswrapper[4799]: E1204 00:28:09.705279 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="b495b0c38f2c54e7cc46282c5f92aab5" Dec 04 00:28:09.715236 master-0 kubenswrapper[4799]: E1204 00:28:09.715056 4799 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187ddb97b6a0ba91\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187ddb97b6a0ba91 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:b495b0c38f2c54e7cc46282c5f92aab5,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:27:53.649633937 +0000 UTC m=+14.466254475,LastTimestamp:2025-12-04 00:28:09.705249506 +0000 UTC m=+30.521870054,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:28:10.406225 master-0 kubenswrapper[4799]: I1204 00:28:10.406110 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:10.708134 master-0 kubenswrapper[4799]: I1204 00:28:10.707902 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/2.log" Dec 04 00:28:10.893174 master-0 kubenswrapper[4799]: I1204 00:28:10.893123 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 00:28:10.907222 master-0 kubenswrapper[4799]: I1204 00:28:10.907154 4799 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Dec 04 00:28:11.405712 master-0 kubenswrapper[4799]: I1204 00:28:11.405653 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:11.543924 master-0 kubenswrapper[4799]: W1204 00:28:11.543832 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Dec 04 00:28:11.543924 master-0 kubenswrapper[4799]: E1204 00:28:11.543905 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 00:28:12.401916 master-0 kubenswrapper[4799]: I1204 00:28:12.401872 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:13.404640 master-0 kubenswrapper[4799]: I1204 00:28:13.404565 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:13.730952 master-0 kubenswrapper[4799]: W1204 00:28:13.730818 4799 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Dec 04 00:28:13.730952 master-0 kubenswrapper[4799]: E1204 00:28:13.730886 4799 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 00:28:14.403773 master-0 kubenswrapper[4799]: I1204 00:28:14.403705 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:14.788546 master-0 kubenswrapper[4799]: I1204 00:28:14.788426 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:14.790947 master-0 kubenswrapper[4799]: I1204 00:28:14.790888 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:14.791003 master-0 kubenswrapper[4799]: I1204 00:28:14.790977 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:14.791003 master-0 kubenswrapper[4799]: I1204 00:28:14.790998 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:14.791087 master-0 kubenswrapper[4799]: I1204 00:28:14.791067 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:28:14.797022 master-0 kubenswrapper[4799]: E1204 00:28:14.796964 4799 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 00:28:14.797098 master-0 kubenswrapper[4799]: E1204 00:28:14.797035 4799 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 00:28:15.398812 master-0 kubenswrapper[4799]: I1204 00:28:15.398738 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:16.406061 master-0 kubenswrapper[4799]: I1204 00:28:16.405776 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:17.405055 master-0 kubenswrapper[4799]: I1204 00:28:17.404742 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:18.406389 master-0 kubenswrapper[4799]: I1204 00:28:18.406301 4799 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 00:28:18.803573 master-0 kubenswrapper[4799]: I1204 00:28:18.802968 4799 csr.go:261] certificate signing request csr-cq7qz is approved, waiting to be issued Dec 04 00:28:18.812532 master-0 kubenswrapper[4799]: I1204 00:28:18.812107 4799 csr.go:257] certificate signing request csr-cq7qz is issued Dec 04 00:28:19.309751 master-0 kubenswrapper[4799]: I1204 00:28:19.309658 4799 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Dec 04 00:28:19.412053 master-0 kubenswrapper[4799]: I1204 00:28:19.411972 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.428399 master-0 kubenswrapper[4799]: I1204 00:28:19.428337 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.489825 master-0 kubenswrapper[4799]: I1204 00:28:19.489740 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.532576 master-0 kubenswrapper[4799]: E1204 00:28:19.532481 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:28:19.756920 master-0 kubenswrapper[4799]: I1204 00:28:19.756872 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.757325 master-0 kubenswrapper[4799]: E1204 00:28:19.757297 4799 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 00:28:19.779692 master-0 kubenswrapper[4799]: I1204 00:28:19.779614 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.795819 master-0 kubenswrapper[4799]: I1204 00:28:19.795789 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:19.815367 master-0 kubenswrapper[4799]: I1204 00:28:19.815280 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 20:24:27.398112612 +0000 UTC Dec 04 00:28:19.815367 master-0 kubenswrapper[4799]: I1204 00:28:19.815335 4799 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 19h56m7.582782946s for next certificate rotation Dec 04 00:28:19.855607 master-0 kubenswrapper[4799]: I1204 00:28:19.855569 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.120556 master-0 kubenswrapper[4799]: I1204 00:28:20.120475 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.120556 master-0 kubenswrapper[4799]: E1204 00:28:20.120528 4799 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 00:28:20.220751 master-0 kubenswrapper[4799]: I1204 00:28:20.220661 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.237394 master-0 kubenswrapper[4799]: I1204 00:28:20.237363 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.299618 master-0 kubenswrapper[4799]: I1204 00:28:20.299525 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.556744 master-0 kubenswrapper[4799]: I1204 00:28:20.556617 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:20.556744 master-0 kubenswrapper[4799]: E1204 00:28:20.556688 4799 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 00:28:20.579232 master-0 kubenswrapper[4799]: I1204 00:28:20.579170 4799 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 00:28:21.127703 master-0 kubenswrapper[4799]: I1204 00:28:21.127593 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:21.145430 master-0 kubenswrapper[4799]: I1204 00:28:21.145345 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:21.205853 master-0 kubenswrapper[4799]: I1204 00:28:21.205762 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:21.482788 master-0 kubenswrapper[4799]: I1204 00:28:21.482624 4799 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 00:28:21.482788 master-0 kubenswrapper[4799]: E1204 00:28:21.482679 4799 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 00:28:21.797552 master-0 kubenswrapper[4799]: I1204 00:28:21.797275 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:21.799633 master-0 kubenswrapper[4799]: I1204 00:28:21.799563 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:21.799723 master-0 kubenswrapper[4799]: I1204 00:28:21.799642 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:21.799723 master-0 kubenswrapper[4799]: I1204 00:28:21.799665 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:21.799829 master-0 kubenswrapper[4799]: I1204 00:28:21.799762 4799 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:28:21.804373 master-0 kubenswrapper[4799]: E1204 00:28:21.804294 4799 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"master-0\" not found" node="master-0" Dec 04 00:28:21.810337 master-0 kubenswrapper[4799]: I1204 00:28:21.810279 4799 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 00:28:21.810337 master-0 kubenswrapper[4799]: E1204 00:28:21.810328 4799 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 00:28:21.824665 master-0 kubenswrapper[4799]: E1204 00:28:21.824612 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:21.925702 master-0 kubenswrapper[4799]: E1204 00:28:21.925602 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.026350 master-0 kubenswrapper[4799]: E1204 00:28:22.026248 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.127045 master-0 kubenswrapper[4799]: E1204 00:28:22.126941 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.228145 master-0 kubenswrapper[4799]: E1204 00:28:22.228014 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.329115 master-0 kubenswrapper[4799]: E1204 00:28:22.329012 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.414261 master-0 kubenswrapper[4799]: I1204 00:28:22.414067 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Rotating certificates Dec 04 00:28:22.428252 master-0 kubenswrapper[4799]: I1204 00:28:22.428153 4799 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Dec 04 00:28:22.429770 master-0 kubenswrapper[4799]: E1204 00:28:22.429701 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.530279 master-0 kubenswrapper[4799]: E1204 00:28:22.530206 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.630821 master-0 kubenswrapper[4799]: E1204 00:28:22.630692 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.732070 master-0 kubenswrapper[4799]: E1204 00:28:22.731856 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.833184 master-0 kubenswrapper[4799]: E1204 00:28:22.833044 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:22.933982 master-0 kubenswrapper[4799]: E1204 00:28:22.933825 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.035026 master-0 kubenswrapper[4799]: E1204 00:28:23.034801 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.135636 master-0 kubenswrapper[4799]: E1204 00:28:23.135566 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.236673 master-0 kubenswrapper[4799]: E1204 00:28:23.236585 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.337522 master-0 kubenswrapper[4799]: E1204 00:28:23.337335 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.438608 master-0 kubenswrapper[4799]: E1204 00:28:23.438504 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.539380 master-0 kubenswrapper[4799]: E1204 00:28:23.539292 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.571258 master-0 kubenswrapper[4799]: I1204 00:28:23.571140 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:23.572638 master-0 kubenswrapper[4799]: I1204 00:28:23.572579 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:23.572638 master-0 kubenswrapper[4799]: I1204 00:28:23.572635 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:23.572831 master-0 kubenswrapper[4799]: I1204 00:28:23.572652 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:23.573140 master-0 kubenswrapper[4799]: I1204 00:28:23.573102 4799 scope.go:117] "RemoveContainer" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" Dec 04 00:28:23.573338 master-0 kubenswrapper[4799]: E1204 00:28:23.573298 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(b495b0c38f2c54e7cc46282c5f92aab5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="b495b0c38f2c54e7cc46282c5f92aab5" Dec 04 00:28:23.640096 master-0 kubenswrapper[4799]: E1204 00:28:23.640020 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.740682 master-0 kubenswrapper[4799]: E1204 00:28:23.740606 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.841514 master-0 kubenswrapper[4799]: E1204 00:28:23.841404 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:23.942741 master-0 kubenswrapper[4799]: E1204 00:28:23.942580 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.043706 master-0 kubenswrapper[4799]: E1204 00:28:24.043627 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.144549 master-0 kubenswrapper[4799]: E1204 00:28:24.144463 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.245321 master-0 kubenswrapper[4799]: E1204 00:28:24.245193 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.345397 master-0 kubenswrapper[4799]: E1204 00:28:24.345317 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.445868 master-0 kubenswrapper[4799]: E1204 00:28:24.445770 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.547045 master-0 kubenswrapper[4799]: E1204 00:28:24.546862 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.647407 master-0 kubenswrapper[4799]: E1204 00:28:24.647283 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.747637 master-0 kubenswrapper[4799]: E1204 00:28:24.747537 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.848295 master-0 kubenswrapper[4799]: E1204 00:28:24.848212 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:24.949553 master-0 kubenswrapper[4799]: E1204 00:28:24.949418 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.050425 master-0 kubenswrapper[4799]: E1204 00:28:25.050305 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.151539 master-0 kubenswrapper[4799]: E1204 00:28:25.151306 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.252132 master-0 kubenswrapper[4799]: E1204 00:28:25.252050 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.353274 master-0 kubenswrapper[4799]: E1204 00:28:25.353137 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.454479 master-0 kubenswrapper[4799]: E1204 00:28:25.454232 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.555133 master-0 kubenswrapper[4799]: E1204 00:28:25.555005 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.655643 master-0 kubenswrapper[4799]: E1204 00:28:25.655568 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.755879 master-0 kubenswrapper[4799]: E1204 00:28:25.755683 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.856520 master-0 kubenswrapper[4799]: E1204 00:28:25.856384 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:25.956894 master-0 kubenswrapper[4799]: E1204 00:28:25.956795 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.057892 master-0 kubenswrapper[4799]: E1204 00:28:26.057674 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.158651 master-0 kubenswrapper[4799]: E1204 00:28:26.158525 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.259637 master-0 kubenswrapper[4799]: E1204 00:28:26.259551 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.360745 master-0 kubenswrapper[4799]: E1204 00:28:26.360656 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.461620 master-0 kubenswrapper[4799]: E1204 00:28:26.461521 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.562752 master-0 kubenswrapper[4799]: E1204 00:28:26.562642 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.663750 master-0 kubenswrapper[4799]: E1204 00:28:26.663485 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.764146 master-0 kubenswrapper[4799]: E1204 00:28:26.764019 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.865252 master-0 kubenswrapper[4799]: E1204 00:28:26.865151 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:26.966158 master-0 kubenswrapper[4799]: E1204 00:28:26.965914 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.066901 master-0 kubenswrapper[4799]: E1204 00:28:27.066785 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.168065 master-0 kubenswrapper[4799]: E1204 00:28:27.167985 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.269035 master-0 kubenswrapper[4799]: E1204 00:28:27.268767 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.369625 master-0 kubenswrapper[4799]: E1204 00:28:27.369524 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.470141 master-0 kubenswrapper[4799]: E1204 00:28:27.470058 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.571404 master-0 kubenswrapper[4799]: E1204 00:28:27.571241 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.671971 master-0 kubenswrapper[4799]: E1204 00:28:27.671877 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.773285 master-0 kubenswrapper[4799]: E1204 00:28:27.773117 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.873878 master-0 kubenswrapper[4799]: E1204 00:28:27.873795 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:27.974652 master-0 kubenswrapper[4799]: E1204 00:28:27.974568 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.075397 master-0 kubenswrapper[4799]: E1204 00:28:28.075295 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.176345 master-0 kubenswrapper[4799]: E1204 00:28:28.176118 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.277007 master-0 kubenswrapper[4799]: E1204 00:28:28.276899 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.377797 master-0 kubenswrapper[4799]: E1204 00:28:28.377716 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.478510 master-0 kubenswrapper[4799]: E1204 00:28:28.478305 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.579141 master-0 kubenswrapper[4799]: E1204 00:28:28.579061 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.680160 master-0 kubenswrapper[4799]: E1204 00:28:28.680034 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.781212 master-0 kubenswrapper[4799]: E1204 00:28:28.781017 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.882068 master-0 kubenswrapper[4799]: E1204 00:28:28.881980 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:28.983347 master-0 kubenswrapper[4799]: E1204 00:28:28.983175 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.084182 master-0 kubenswrapper[4799]: E1204 00:28:29.083961 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.184756 master-0 kubenswrapper[4799]: E1204 00:28:29.184655 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.285396 master-0 kubenswrapper[4799]: E1204 00:28:29.285258 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.372348 master-0 kubenswrapper[4799]: I1204 00:28:29.372272 4799 csr.go:261] certificate signing request csr-nrxp2 is approved, waiting to be issued Dec 04 00:28:29.383290 master-0 kubenswrapper[4799]: I1204 00:28:29.383207 4799 csr.go:257] certificate signing request csr-nrxp2 is issued Dec 04 00:28:29.386436 master-0 kubenswrapper[4799]: E1204 00:28:29.386370 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.487019 master-0 kubenswrapper[4799]: E1204 00:28:29.486896 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.533739 master-0 kubenswrapper[4799]: E1204 00:28:29.533663 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:28:29.587320 master-0 kubenswrapper[4799]: E1204 00:28:29.587188 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.688094 master-0 kubenswrapper[4799]: E1204 00:28:29.687951 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.788965 master-0 kubenswrapper[4799]: E1204 00:28:29.788851 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.889138 master-0 kubenswrapper[4799]: E1204 00:28:29.889055 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:29.989540 master-0 kubenswrapper[4799]: E1204 00:28:29.989298 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.090397 master-0 kubenswrapper[4799]: E1204 00:28:30.090268 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.191502 master-0 kubenswrapper[4799]: E1204 00:28:30.191363 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.292522 master-0 kubenswrapper[4799]: E1204 00:28:30.292292 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.385430 master-0 kubenswrapper[4799]: I1204 00:28:30.385321 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 21:38:17.940129237 +0000 UTC Dec 04 00:28:30.385430 master-0 kubenswrapper[4799]: I1204 00:28:30.385366 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 21h9m47.554766593s for next certificate rotation Dec 04 00:28:30.392644 master-0 kubenswrapper[4799]: E1204 00:28:30.392566 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.493461 master-0 kubenswrapper[4799]: E1204 00:28:30.493345 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.594120 master-0 kubenswrapper[4799]: E1204 00:28:30.593916 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.694973 master-0 kubenswrapper[4799]: E1204 00:28:30.694839 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.795211 master-0 kubenswrapper[4799]: E1204 00:28:30.795054 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.896122 master-0 kubenswrapper[4799]: E1204 00:28:30.896007 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:30.996964 master-0 kubenswrapper[4799]: E1204 00:28:30.996774 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.097770 master-0 kubenswrapper[4799]: E1204 00:28:31.097677 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.198785 master-0 kubenswrapper[4799]: E1204 00:28:31.198539 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.298797 master-0 kubenswrapper[4799]: E1204 00:28:31.298732 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.386180 master-0 kubenswrapper[4799]: I1204 00:28:31.386083 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 19:58:15.939767921 +0000 UTC Dec 04 00:28:31.386180 master-0 kubenswrapper[4799]: I1204 00:28:31.386147 4799 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 19h29m44.553625836s for next certificate rotation Dec 04 00:28:31.399641 master-0 kubenswrapper[4799]: E1204 00:28:31.399591 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.500012 master-0 kubenswrapper[4799]: E1204 00:28:31.499786 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.600371 master-0 kubenswrapper[4799]: E1204 00:28:31.600285 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.701269 master-0 kubenswrapper[4799]: E1204 00:28:31.701171 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.801714 master-0 kubenswrapper[4799]: E1204 00:28:31.801538 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.902261 master-0 kubenswrapper[4799]: E1204 00:28:31.902203 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:31.999214 master-0 kubenswrapper[4799]: E1204 00:28:31.999118 4799 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 00:28:32.015826 master-0 kubenswrapper[4799]: E1204 00:28:32.015724 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.116130 master-0 kubenswrapper[4799]: E1204 00:28:32.115997 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.216869 master-0 kubenswrapper[4799]: E1204 00:28:32.216738 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.317836 master-0 kubenswrapper[4799]: E1204 00:28:32.317738 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.418442 master-0 kubenswrapper[4799]: E1204 00:28:32.418245 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.519307 master-0 kubenswrapper[4799]: E1204 00:28:32.519170 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.619617 master-0 kubenswrapper[4799]: E1204 00:28:32.619442 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.720622 master-0 kubenswrapper[4799]: E1204 00:28:32.720346 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.821619 master-0 kubenswrapper[4799]: E1204 00:28:32.821469 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:32.922459 master-0 kubenswrapper[4799]: E1204 00:28:32.922313 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.023691 master-0 kubenswrapper[4799]: E1204 00:28:33.023472 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.124752 master-0 kubenswrapper[4799]: E1204 00:28:33.124628 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.225292 master-0 kubenswrapper[4799]: E1204 00:28:33.225170 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.326335 master-0 kubenswrapper[4799]: E1204 00:28:33.326157 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.427041 master-0 kubenswrapper[4799]: E1204 00:28:33.426922 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.527973 master-0 kubenswrapper[4799]: E1204 00:28:33.527860 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.628081 master-0 kubenswrapper[4799]: E1204 00:28:33.628019 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.729170 master-0 kubenswrapper[4799]: E1204 00:28:33.729025 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.829591 master-0 kubenswrapper[4799]: E1204 00:28:33.829478 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:33.930848 master-0 kubenswrapper[4799]: E1204 00:28:33.930544 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.031567 master-0 kubenswrapper[4799]: E1204 00:28:34.031406 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.132546 master-0 kubenswrapper[4799]: E1204 00:28:34.132360 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.233533 master-0 kubenswrapper[4799]: E1204 00:28:34.233347 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.333894 master-0 kubenswrapper[4799]: E1204 00:28:34.333776 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.434504 master-0 kubenswrapper[4799]: E1204 00:28:34.434415 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.535699 master-0 kubenswrapper[4799]: E1204 00:28:34.535517 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.636332 master-0 kubenswrapper[4799]: E1204 00:28:34.636243 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.737088 master-0 kubenswrapper[4799]: E1204 00:28:34.737009 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.838261 master-0 kubenswrapper[4799]: E1204 00:28:34.838097 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:34.939381 master-0 kubenswrapper[4799]: E1204 00:28:34.939249 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.040324 master-0 kubenswrapper[4799]: E1204 00:28:35.040231 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.141354 master-0 kubenswrapper[4799]: E1204 00:28:35.141254 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.242316 master-0 kubenswrapper[4799]: E1204 00:28:35.242190 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.342545 master-0 kubenswrapper[4799]: E1204 00:28:35.342378 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.443315 master-0 kubenswrapper[4799]: E1204 00:28:35.443174 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.544264 master-0 kubenswrapper[4799]: E1204 00:28:35.544160 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.570869 master-0 kubenswrapper[4799]: I1204 00:28:35.570772 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:35.572315 master-0 kubenswrapper[4799]: I1204 00:28:35.572252 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:35.572315 master-0 kubenswrapper[4799]: I1204 00:28:35.572296 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:35.572315 master-0 kubenswrapper[4799]: I1204 00:28:35.572308 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:35.572708 master-0 kubenswrapper[4799]: I1204 00:28:35.572678 4799 scope.go:117] "RemoveContainer" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" Dec 04 00:28:35.644828 master-0 kubenswrapper[4799]: E1204 00:28:35.644733 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.745690 master-0 kubenswrapper[4799]: E1204 00:28:35.745506 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.846097 master-0 kubenswrapper[4799]: E1204 00:28:35.846035 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:35.946283 master-0 kubenswrapper[4799]: E1204 00:28:35.946198 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.047369 master-0 kubenswrapper[4799]: E1204 00:28:36.047221 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.148205 master-0 kubenswrapper[4799]: E1204 00:28:36.148122 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.249073 master-0 kubenswrapper[4799]: E1204 00:28:36.249019 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.350226 master-0 kubenswrapper[4799]: E1204 00:28:36.350158 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.450713 master-0 kubenswrapper[4799]: E1204 00:28:36.450635 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.551449 master-0 kubenswrapper[4799]: E1204 00:28:36.551397 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.653031 master-0 kubenswrapper[4799]: E1204 00:28:36.652836 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.754065 master-0 kubenswrapper[4799]: E1204 00:28:36.753871 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.783786 master-0 kubenswrapper[4799]: I1204 00:28:36.783677 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/2.log" Dec 04 00:28:36.784981 master-0 kubenswrapper[4799]: I1204 00:28:36.784859 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"d3bf5f95f064d6d4c06a0006d3f20c777a30163e26ecd49576d8d891cf10c17b"} Dec 04 00:28:36.785126 master-0 kubenswrapper[4799]: I1204 00:28:36.785072 4799 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:28:36.786285 master-0 kubenswrapper[4799]: I1204 00:28:36.786222 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:28:36.786400 master-0 kubenswrapper[4799]: I1204 00:28:36.786333 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:28:36.786400 master-0 kubenswrapper[4799]: I1204 00:28:36.786353 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:28:36.854802 master-0 kubenswrapper[4799]: E1204 00:28:36.854726 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:36.955982 master-0 kubenswrapper[4799]: E1204 00:28:36.955695 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.056772 master-0 kubenswrapper[4799]: E1204 00:28:37.056686 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.157487 master-0 kubenswrapper[4799]: E1204 00:28:37.157366 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.258302 master-0 kubenswrapper[4799]: E1204 00:28:37.258129 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.359248 master-0 kubenswrapper[4799]: E1204 00:28:37.359169 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.460044 master-0 kubenswrapper[4799]: E1204 00:28:37.459917 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.561000 master-0 kubenswrapper[4799]: E1204 00:28:37.560780 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.661338 master-0 kubenswrapper[4799]: E1204 00:28:37.661208 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.762593 master-0 kubenswrapper[4799]: E1204 00:28:37.762504 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.863203 master-0 kubenswrapper[4799]: E1204 00:28:37.863127 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:37.964402 master-0 kubenswrapper[4799]: E1204 00:28:37.964270 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.065280 master-0 kubenswrapper[4799]: E1204 00:28:38.065160 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.166308 master-0 kubenswrapper[4799]: E1204 00:28:38.166098 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.267161 master-0 kubenswrapper[4799]: E1204 00:28:38.267026 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.368321 master-0 kubenswrapper[4799]: E1204 00:28:38.368213 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.469239 master-0 kubenswrapper[4799]: E1204 00:28:38.469016 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.569974 master-0 kubenswrapper[4799]: E1204 00:28:38.569853 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.670630 master-0 kubenswrapper[4799]: E1204 00:28:38.670558 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.772021 master-0 kubenswrapper[4799]: E1204 00:28:38.771770 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.872748 master-0 kubenswrapper[4799]: E1204 00:28:38.872644 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:38.973544 master-0 kubenswrapper[4799]: E1204 00:28:38.972921 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.074219 master-0 kubenswrapper[4799]: E1204 00:28:39.074038 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.175076 master-0 kubenswrapper[4799]: E1204 00:28:39.174963 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.276071 master-0 kubenswrapper[4799]: E1204 00:28:39.275890 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.376728 master-0 kubenswrapper[4799]: E1204 00:28:39.376591 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.477797 master-0 kubenswrapper[4799]: E1204 00:28:39.477687 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.535059 master-0 kubenswrapper[4799]: E1204 00:28:39.534668 4799 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 00:28:39.578600 master-0 kubenswrapper[4799]: E1204 00:28:39.578520 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.678846 master-0 kubenswrapper[4799]: E1204 00:28:39.678715 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.779719 master-0 kubenswrapper[4799]: E1204 00:28:39.779626 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.880130 master-0 kubenswrapper[4799]: E1204 00:28:39.880051 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:39.981533 master-0 kubenswrapper[4799]: E1204 00:28:39.981324 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.081663 master-0 kubenswrapper[4799]: E1204 00:28:40.081560 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.094178 master-0 kubenswrapper[4799]: I1204 00:28:40.094105 4799 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 00:28:40.181835 master-0 kubenswrapper[4799]: E1204 00:28:40.181735 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.282678 master-0 kubenswrapper[4799]: E1204 00:28:40.282521 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.383792 master-0 kubenswrapper[4799]: E1204 00:28:40.383696 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.483911 master-0 kubenswrapper[4799]: E1204 00:28:40.483850 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.584569 master-0 kubenswrapper[4799]: E1204 00:28:40.584337 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.685509 master-0 kubenswrapper[4799]: E1204 00:28:40.685391 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.786438 master-0 kubenswrapper[4799]: E1204 00:28:40.786319 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.887600 master-0 kubenswrapper[4799]: E1204 00:28:40.887494 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:40.988661 master-0 kubenswrapper[4799]: E1204 00:28:40.988544 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.089618 master-0 kubenswrapper[4799]: E1204 00:28:41.089518 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.190793 master-0 kubenswrapper[4799]: E1204 00:28:41.190582 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.290820 master-0 kubenswrapper[4799]: E1204 00:28:41.290701 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.391398 master-0 kubenswrapper[4799]: E1204 00:28:41.391296 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.491893 master-0 kubenswrapper[4799]: E1204 00:28:41.491700 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.592446 master-0 kubenswrapper[4799]: E1204 00:28:41.592357 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.693494 master-0 kubenswrapper[4799]: E1204 00:28:41.693322 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.794415 master-0 kubenswrapper[4799]: E1204 00:28:41.794170 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.894748 master-0 kubenswrapper[4799]: E1204 00:28:41.894663 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:41.995618 master-0 kubenswrapper[4799]: E1204 00:28:41.995525 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.096707 master-0 kubenswrapper[4799]: E1204 00:28:42.096626 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.138425 master-0 kubenswrapper[4799]: E1204 00:28:42.138337 4799 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 00:28:42.197326 master-0 kubenswrapper[4799]: E1204 00:28:42.197252 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.298452 master-0 kubenswrapper[4799]: E1204 00:28:42.298338 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.398666 master-0 kubenswrapper[4799]: E1204 00:28:42.398522 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.499041 master-0 kubenswrapper[4799]: E1204 00:28:42.498949 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.599723 master-0 kubenswrapper[4799]: E1204 00:28:42.599596 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.700690 master-0 kubenswrapper[4799]: E1204 00:28:42.700536 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.801041 master-0 kubenswrapper[4799]: E1204 00:28:42.800962 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:42.901772 master-0 kubenswrapper[4799]: E1204 00:28:42.901661 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.002880 master-0 kubenswrapper[4799]: E1204 00:28:43.002715 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.103226 master-0 kubenswrapper[4799]: E1204 00:28:43.103155 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.204070 master-0 kubenswrapper[4799]: E1204 00:28:43.203995 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.305298 master-0 kubenswrapper[4799]: E1204 00:28:43.305130 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.405847 master-0 kubenswrapper[4799]: E1204 00:28:43.405765 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.506147 master-0 kubenswrapper[4799]: E1204 00:28:43.506069 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.606755 master-0 kubenswrapper[4799]: E1204 00:28:43.606649 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.707913 master-0 kubenswrapper[4799]: E1204 00:28:43.707800 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.808303 master-0 kubenswrapper[4799]: E1204 00:28:43.808184 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:43.909497 master-0 kubenswrapper[4799]: E1204 00:28:43.909338 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.010307 master-0 kubenswrapper[4799]: E1204 00:28:44.010220 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.111330 master-0 kubenswrapper[4799]: E1204 00:28:44.111230 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.212440 master-0 kubenswrapper[4799]: E1204 00:28:44.212248 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.313541 master-0 kubenswrapper[4799]: E1204 00:28:44.313426 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.413712 master-0 kubenswrapper[4799]: E1204 00:28:44.413590 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.514376 master-0 kubenswrapper[4799]: E1204 00:28:44.514201 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.615244 master-0 kubenswrapper[4799]: E1204 00:28:44.615127 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.715677 master-0 kubenswrapper[4799]: E1204 00:28:44.715579 4799 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:28:44.733139 master-0 kubenswrapper[4799]: I1204 00:28:44.733057 4799 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 00:28:45.429561 master-0 kubenswrapper[4799]: I1204 00:28:45.429462 4799 apiserver.go:52] "Watching apiserver" Dec 04 00:28:45.432965 master-0 kubenswrapper[4799]: I1204 00:28:45.432891 4799 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 00:28:45.433337 master-0 kubenswrapper[4799]: I1204 00:28:45.433222 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["assisted-installer/assisted-installer-controller-6cf87","openshift-cluster-version/cluster-version-operator-869c786959-rg92r","openshift-network-operator/network-operator-6cbf58c977-vjwnj"] Dec 04 00:28:45.433973 master-0 kubenswrapper[4799]: I1204 00:28:45.433851 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.433973 master-0 kubenswrapper[4799]: I1204 00:28:45.433914 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.434219 master-0 kubenswrapper[4799]: I1204 00:28:45.434125 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.438996 master-0 kubenswrapper[4799]: I1204 00:28:45.437492 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"openshift-service-ca.crt" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.440707 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.440719 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.441542 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"assisted-installer-controller-config" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.441643 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"kube-root-ca.crt" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.441977 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.442062 4799 reflector.go:368] Caches populated for *v1.Secret from object-"assisted-installer"/"assisted-installer-controller-secret" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.442386 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 00:28:45.443435 master-0 kubenswrapper[4799]: I1204 00:28:45.442566 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:28:45.445475 master-0 kubenswrapper[4799]: I1204 00:28:45.444098 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 00:28:45.497507 master-0 kubenswrapper[4799]: I1204 00:28:45.497437 4799 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554657 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554707 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxxs6\" (UniqueName: \"kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554730 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554752 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554775 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.554864 master-0 kubenswrapper[4799]: I1204 00:28:45.554795 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.554997 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555063 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555104 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555138 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555221 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555258 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.555538 master-0 kubenswrapper[4799]: I1204 00:28:45.555295 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656105 master-0 kubenswrapper[4799]: I1204 00:28:45.655869 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656105 master-0 kubenswrapper[4799]: I1204 00:28:45.655989 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.656105 master-0 kubenswrapper[4799]: I1204 00:28:45.656039 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656152 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656187 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656220 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656255 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wxxs6\" (UniqueName: \"kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656261 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656290 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656289 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656337 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: E1204 00:28:45.656417 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656473 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.656594 master-0 kubenswrapper[4799]: I1204 00:28:45.656574 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656640 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656420 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: E1204 00:28:45.656678 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:28:46.156635246 +0000 UTC m=+66.973255894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656737 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656781 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656826 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.656983 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.657612 master-0 kubenswrapper[4799]: I1204 00:28:45.657077 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.658441 master-0 kubenswrapper[4799]: I1204 00:28:45.658160 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.658812 master-0 kubenswrapper[4799]: I1204 00:28:45.658725 4799 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 00:28:45.667158 master-0 kubenswrapper[4799]: I1204 00:28:45.666783 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.692158 master-0 kubenswrapper[4799]: I1204 00:28:45.691995 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxxs6\" (UniqueName: \"kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6\") pod \"assisted-installer-controller-6cf87\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.702758 master-0 kubenswrapper[4799]: I1204 00:28:45.702684 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.703223 master-0 kubenswrapper[4799]: I1204 00:28:45.703163 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:45.768063 master-0 kubenswrapper[4799]: I1204 00:28:45.767910 4799 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 00:28:45.780118 master-0 kubenswrapper[4799]: I1204 00:28:45.780046 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:45.795969 master-0 kubenswrapper[4799]: I1204 00:28:45.795828 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:28:45.797521 master-0 kubenswrapper[4799]: W1204 00:28:45.797375 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc89c4eb9_3543_4fc1_bb2d_8395b5d573c4.slice/crio-ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081 WatchSource:0}: Error finding container ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081: Status 404 returned error can't find the container with id ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081 Dec 04 00:28:45.812177 master-0 kubenswrapper[4799]: W1204 00:28:45.811584 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa373a8f_8a9c_4f90_ae62_1d48fd88550b.slice/crio-ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67 WatchSource:0}: Error finding container ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67: Status 404 returned error can't find the container with id ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67 Dec 04 00:28:45.813233 master-0 kubenswrapper[4799]: I1204 00:28:45.813186 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-6cf87" event={"ID":"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4","Type":"ContainerStarted","Data":"ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081"} Dec 04 00:28:46.160277 master-0 kubenswrapper[4799]: I1204 00:28:46.160070 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:46.160277 master-0 kubenswrapper[4799]: E1204 00:28:46.160309 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:46.160992 master-0 kubenswrapper[4799]: E1204 00:28:46.160432 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:28:47.160395441 +0000 UTC m=+67.977015989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:46.816551 master-0 kubenswrapper[4799]: I1204 00:28:46.816459 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" event={"ID":"aa373a8f-8a9c-4f90-ae62-1d48fd88550b","Type":"ContainerStarted","Data":"ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67"} Dec 04 00:28:47.166763 master-0 kubenswrapper[4799]: I1204 00:28:47.166702 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:47.167082 master-0 kubenswrapper[4799]: E1204 00:28:47.166849 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:47.167082 master-0 kubenswrapper[4799]: E1204 00:28:47.166904 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:28:49.16688905 +0000 UTC m=+69.983509558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:49.180957 master-0 kubenswrapper[4799]: I1204 00:28:49.180857 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:49.181579 master-0 kubenswrapper[4799]: E1204 00:28:49.181136 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:49.181579 master-0 kubenswrapper[4799]: E1204 00:28:49.181277 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:28:53.18124578 +0000 UTC m=+73.997866318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:50.829830 master-0 kubenswrapper[4799]: I1204 00:28:50.829726 4799 generic.go:334] "Generic (PLEG): container finished" podID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerID="fedd774b5398f0119e888631e667565bbef54e542a0cb27a2bea0c11c45d161f" exitCode=0 Dec 04 00:28:50.831007 master-0 kubenswrapper[4799]: I1204 00:28:50.829945 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-6cf87" event={"ID":"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4","Type":"ContainerDied","Data":"fedd774b5398f0119e888631e667565bbef54e542a0cb27a2bea0c11c45d161f"} Dec 04 00:28:50.832698 master-0 kubenswrapper[4799]: I1204 00:28:50.832629 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" event={"ID":"aa373a8f-8a9c-4f90-ae62-1d48fd88550b","Type":"ContainerStarted","Data":"016eb70a46f10bedd7dec24049021571b4b28da368391342d032b50cbe92ce70"} Dec 04 00:28:51.357853 master-0 kubenswrapper[4799]: I1204 00:28:51.357751 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" podStartSLOduration=24.90337726 podStartE2EDuration="29.357671691s" podCreationTimestamp="2025-12-04 00:28:22 +0000 UTC" firstStartedPulling="2025-12-04 00:28:45.814045797 +0000 UTC m=+66.630666345" lastFinishedPulling="2025-12-04 00:28:50.268340258 +0000 UTC m=+71.084960776" observedRunningTime="2025-12-04 00:28:51.357209897 +0000 UTC m=+72.173830425" watchObservedRunningTime="2025-12-04 00:28:51.357671691 +0000 UTC m=+72.174292199" Dec 04 00:28:51.853503 master-0 kubenswrapper[4799]: I1204 00:28:51.853446 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:52.000981 master-0 kubenswrapper[4799]: I1204 00:28:52.000791 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle\") pod \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " Dec 04 00:28:52.001488 master-0 kubenswrapper[4799]: I1204 00:28:52.001015 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf\") pod \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " Dec 04 00:28:52.001488 master-0 kubenswrapper[4799]: I1204 00:28:52.001092 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxxs6\" (UniqueName: \"kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6\") pod \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " Dec 04 00:28:52.001488 master-0 kubenswrapper[4799]: I1204 00:28:52.001193 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf\") pod \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " Dec 04 00:28:52.001488 master-0 kubenswrapper[4799]: I1204 00:28:52.001201 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle" (OuterVolumeSpecName: "host-ca-bundle") pod "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" (UID: "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4"). InnerVolumeSpecName "host-ca-bundle". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:28:52.001488 master-0 kubenswrapper[4799]: I1204 00:28:52.001426 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files\") pod \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\" (UID: \"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4\") " Dec 04 00:28:52.001807 master-0 kubenswrapper[4799]: I1204 00:28:52.001567 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files" (OuterVolumeSpecName: "sno-bootstrap-files") pod "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" (UID: "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4"). InnerVolumeSpecName "sno-bootstrap-files". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:28:52.001807 master-0 kubenswrapper[4799]: I1204 00:28:52.001578 4799 reconciler_common.go:293] "Volume detached for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:52.001807 master-0 kubenswrapper[4799]: I1204 00:28:52.001529 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf" (OuterVolumeSpecName: "host-var-run-resolv-conf") pod "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" (UID: "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4"). InnerVolumeSpecName "host-var-run-resolv-conf". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:28:52.001807 master-0 kubenswrapper[4799]: I1204 00:28:52.001677 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf" (OuterVolumeSpecName: "host-resolv-conf") pod "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" (UID: "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4"). InnerVolumeSpecName "host-resolv-conf". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:28:52.008044 master-0 kubenswrapper[4799]: I1204 00:28:52.007977 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6" (OuterVolumeSpecName: "kube-api-access-wxxs6") pod "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" (UID: "c89c4eb9-3543-4fc1-bb2d-8395b5d573c4"). InnerVolumeSpecName "kube-api-access-wxxs6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:28:52.102955 master-0 kubenswrapper[4799]: I1204 00:28:52.102793 4799 reconciler_common.go:293] "Volume detached for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-resolv-conf\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:52.102955 master-0 kubenswrapper[4799]: I1204 00:28:52.102888 4799 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wxxs6\" (UniqueName: \"kubernetes.io/projected/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-kube-api-access-wxxs6\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:52.102955 master-0 kubenswrapper[4799]: I1204 00:28:52.102914 4799 reconciler_common.go:293] "Volume detached for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-host-var-run-resolv-conf\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:52.102955 master-0 kubenswrapper[4799]: I1204 00:28:52.102962 4799 reconciler_common.go:293] "Volume detached for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/c89c4eb9-3543-4fc1-bb2d-8395b5d573c4-sno-bootstrap-files\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:52.840059 master-0 kubenswrapper[4799]: I1204 00:28:52.839975 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-6cf87" event={"ID":"c89c4eb9-3543-4fc1-bb2d-8395b5d573c4","Type":"ContainerDied","Data":"ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081"} Dec 04 00:28:52.840059 master-0 kubenswrapper[4799]: I1204 00:28:52.840062 4799 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081" Dec 04 00:28:52.840410 master-0 kubenswrapper[4799]: I1204 00:28:52.840075 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:28:53.212636 master-0 kubenswrapper[4799]: I1204 00:28:53.212525 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:28:53.213875 master-0 kubenswrapper[4799]: E1204 00:28:53.212697 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:53.213875 master-0 kubenswrapper[4799]: E1204 00:28:53.212781 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:01.212761283 +0000 UTC m=+82.029381791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:28:53.329199 master-0 kubenswrapper[4799]: I1204 00:28:53.329123 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/mtu-prober-6hbrj"] Dec 04 00:28:53.329440 master-0 kubenswrapper[4799]: E1204 00:28:53.329217 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:28:53.329440 master-0 kubenswrapper[4799]: I1204 00:28:53.329234 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:28:53.329440 master-0 kubenswrapper[4799]: I1204 00:28:53.329265 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:28:53.329587 master-0 kubenswrapper[4799]: I1204 00:28:53.329480 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:53.414209 master-0 kubenswrapper[4799]: I1204 00:28:53.414130 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzlqg\" (UniqueName: \"kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg\") pod \"mtu-prober-6hbrj\" (UID: \"034a82b3-4202-433a-8718-c9f9a33ce2e0\") " pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:53.515393 master-0 kubenswrapper[4799]: I1204 00:28:53.515187 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzlqg\" (UniqueName: \"kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg\") pod \"mtu-prober-6hbrj\" (UID: \"034a82b3-4202-433a-8718-c9f9a33ce2e0\") " pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:53.544557 master-0 kubenswrapper[4799]: I1204 00:28:53.544471 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzlqg\" (UniqueName: \"kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg\") pod \"mtu-prober-6hbrj\" (UID: \"034a82b3-4202-433a-8718-c9f9a33ce2e0\") " pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:53.644266 master-0 kubenswrapper[4799]: I1204 00:28:53.644166 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:53.661424 master-0 kubenswrapper[4799]: W1204 00:28:53.661345 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034a82b3_4202_433a_8718_c9f9a33ce2e0.slice/crio-db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4 WatchSource:0}: Error finding container db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4: Status 404 returned error can't find the container with id db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4 Dec 04 00:28:53.857690 master-0 kubenswrapper[4799]: I1204 00:28:53.856419 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-6hbrj" event={"ID":"034a82b3-4202-433a-8718-c9f9a33ce2e0","Type":"ContainerStarted","Data":"db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4"} Dec 04 00:28:54.587990 master-0 kubenswrapper[4799]: W1204 00:28:54.587824 4799 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 00:28:54.589185 master-0 kubenswrapper[4799]: I1204 00:28:54.588152 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 00:28:54.867997 master-0 kubenswrapper[4799]: I1204 00:28:54.867889 4799 generic.go:334] "Generic (PLEG): container finished" podID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerID="80b056ca713cc669a16b4ed101f0051a28fedc8060007822265803cbfc4e3a86" exitCode=0 Dec 04 00:28:54.868270 master-0 kubenswrapper[4799]: I1204 00:28:54.868127 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-6hbrj" event={"ID":"034a82b3-4202-433a-8718-c9f9a33ce2e0","Type":"ContainerDied","Data":"80b056ca713cc669a16b4ed101f0051a28fedc8060007822265803cbfc4e3a86"} Dec 04 00:28:55.898558 master-0 kubenswrapper[4799]: I1204 00:28:55.898481 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:55.914446 master-0 kubenswrapper[4799]: I1204 00:28:55.914344 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0-master-0" podStartSLOduration=1.914308968 podStartE2EDuration="1.914308968s" podCreationTimestamp="2025-12-04 00:28:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:28:54.907038554 +0000 UTC m=+75.723659082" watchObservedRunningTime="2025-12-04 00:28:55.914308968 +0000 UTC m=+76.730929496" Dec 04 00:28:56.036205 master-0 kubenswrapper[4799]: I1204 00:28:56.036078 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzlqg\" (UniqueName: \"kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg\") pod \"034a82b3-4202-433a-8718-c9f9a33ce2e0\" (UID: \"034a82b3-4202-433a-8718-c9f9a33ce2e0\") " Dec 04 00:28:56.039726 master-0 kubenswrapper[4799]: I1204 00:28:56.039657 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg" (OuterVolumeSpecName: "kube-api-access-nzlqg") pod "034a82b3-4202-433a-8718-c9f9a33ce2e0" (UID: "034a82b3-4202-433a-8718-c9f9a33ce2e0"). InnerVolumeSpecName "kube-api-access-nzlqg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:28:56.136827 master-0 kubenswrapper[4799]: I1204 00:28:56.136648 4799 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzlqg\" (UniqueName: \"kubernetes.io/projected/034a82b3-4202-433a-8718-c9f9a33ce2e0-kube-api-access-nzlqg\") on node \"master-0\" DevicePath \"\"" Dec 04 00:28:56.878495 master-0 kubenswrapper[4799]: I1204 00:28:56.878370 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-6hbrj" event={"ID":"034a82b3-4202-433a-8718-c9f9a33ce2e0","Type":"ContainerDied","Data":"db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4"} Dec 04 00:28:56.878495 master-0 kubenswrapper[4799]: I1204 00:28:56.878470 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-6hbrj" Dec 04 00:28:56.878888 master-0 kubenswrapper[4799]: I1204 00:28:56.878481 4799 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4" Dec 04 00:28:58.348897 master-0 kubenswrapper[4799]: I1204 00:28:58.348782 4799 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-network-operator/mtu-prober-6hbrj"] Dec 04 00:28:58.351330 master-0 kubenswrapper[4799]: I1204 00:28:58.351264 4799 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-network-operator/mtu-prober-6hbrj"] Dec 04 00:28:59.575546 master-0 kubenswrapper[4799]: I1204 00:28:59.575457 4799 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" path="/var/lib/kubelet/pods/034a82b3-4202-433a-8718-c9f9a33ce2e0/volumes" Dec 04 00:29:01.275254 master-0 kubenswrapper[4799]: I1204 00:29:01.275128 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:29:01.276310 master-0 kubenswrapper[4799]: E1204 00:29:01.275363 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:01.276310 master-0 kubenswrapper[4799]: E1204 00:29:01.275497 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:17.27546033 +0000 UTC m=+98.092080878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:03.249185 master-0 kubenswrapper[4799]: I1204 00:29:03.249098 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-w7796"] Dec 04 00:29:03.249889 master-0 kubenswrapper[4799]: E1204 00:29:03.249214 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:29:03.249889 master-0 kubenswrapper[4799]: I1204 00:29:03.249230 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:29:03.249889 master-0 kubenswrapper[4799]: I1204 00:29:03.249251 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:29:03.249889 master-0 kubenswrapper[4799]: I1204 00:29:03.249538 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7796" Dec 04 00:29:03.251913 master-0 kubenswrapper[4799]: I1204 00:29:03.251377 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 00:29:03.254368 master-0 kubenswrapper[4799]: I1204 00:29:03.254325 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 00:29:03.254758 master-0 kubenswrapper[4799]: I1204 00:29:03.254723 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 00:29:03.255387 master-0 kubenswrapper[4799]: I1204 00:29:03.255354 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 00:29:03.392844 master-0 kubenswrapper[4799]: I1204 00:29:03.392753 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.392844 master-0 kubenswrapper[4799]: I1204 00:29:03.392825 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.392869 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.392908 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.392958 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.392987 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393016 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393061 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393088 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393109 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393128 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393178 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393202 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393254 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.393266 master-0 kubenswrapper[4799]: I1204 00:29:03.393282 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.394012 master-0 kubenswrapper[4799]: I1204 00:29:03.393305 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.394012 master-0 kubenswrapper[4799]: I1204 00:29:03.393328 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.430816 master-0 kubenswrapper[4799]: I1204 00:29:03.430750 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-jglkq"] Dec 04 00:29:03.431636 master-0 kubenswrapper[4799]: I1204 00:29:03.431612 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.435441 master-0 kubenswrapper[4799]: I1204 00:29:03.435405 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 00:29:03.435531 master-0 kubenswrapper[4799]: I1204 00:29:03.435451 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 00:29:03.494385 master-0 kubenswrapper[4799]: I1204 00:29:03.494273 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494385 master-0 kubenswrapper[4799]: I1204 00:29:03.494339 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494385 master-0 kubenswrapper[4799]: I1204 00:29:03.494382 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494385 master-0 kubenswrapper[4799]: I1204 00:29:03.494401 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494423 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494449 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494470 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494487 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494509 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494534 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494551 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494570 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494584 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494599 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494614 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494630 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494654 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494725 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494778 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494808 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.494862 master-0 kubenswrapper[4799]: I1204 00:29:03.494839 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.494917 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495003 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495092 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495146 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495177 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495204 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495219 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495279 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495245 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.495893 master-0 kubenswrapper[4799]: I1204 00:29:03.495235 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.496645 master-0 kubenswrapper[4799]: I1204 00:29:03.496137 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.496645 master-0 kubenswrapper[4799]: I1204 00:29:03.496292 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.519122 master-0 kubenswrapper[4799]: I1204 00:29:03.518893 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:29:03.565695 master-0 kubenswrapper[4799]: I1204 00:29:03.565568 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7796" Dec 04 00:29:03.591059 master-0 kubenswrapper[4799]: I1204 00:29:03.590990 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 00:29:03.595478 master-0 kubenswrapper[4799]: I1204 00:29:03.595359 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.595769 master-0 kubenswrapper[4799]: I1204 00:29:03.595488 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.595769 master-0 kubenswrapper[4799]: I1204 00:29:03.595546 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.595858 master-0 kubenswrapper[4799]: I1204 00:29:03.595804 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.596224 master-0 kubenswrapper[4799]: I1204 00:29:03.595883 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.596224 master-0 kubenswrapper[4799]: I1204 00:29:03.595981 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.596224 master-0 kubenswrapper[4799]: I1204 00:29:03.596044 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.596224 master-0 kubenswrapper[4799]: I1204 00:29:03.596110 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697254 master-0 kubenswrapper[4799]: I1204 00:29:03.697141 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697254 master-0 kubenswrapper[4799]: I1204 00:29:03.697215 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697254 master-0 kubenswrapper[4799]: I1204 00:29:03.697265 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697303 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697338 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697372 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697404 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697444 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.697647 master-0 kubenswrapper[4799]: I1204 00:29:03.697444 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698035 master-0 kubenswrapper[4799]: I1204 00:29:03.697813 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698035 master-0 kubenswrapper[4799]: I1204 00:29:03.697850 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698035 master-0 kubenswrapper[4799]: I1204 00:29:03.697906 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698218 master-0 kubenswrapper[4799]: I1204 00:29:03.698184 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698675 master-0 kubenswrapper[4799]: I1204 00:29:03.698607 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.698752 master-0 kubenswrapper[4799]: I1204 00:29:03.698586 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.716116 master-0 kubenswrapper[4799]: I1204 00:29:03.716010 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.750869 master-0 kubenswrapper[4799]: I1204 00:29:03.750777 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:29:03.768679 master-0 kubenswrapper[4799]: W1204 00:29:03.768558 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d5dd7e_7ac5_4c41_8f62_404bc5919857.slice/crio-c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b WatchSource:0}: Error finding container c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b: Status 404 returned error can't find the container with id c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b Dec 04 00:29:03.901276 master-0 kubenswrapper[4799]: I1204 00:29:03.901157 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7796" event={"ID":"d7a0402f-755b-44a1-8cb8-c95b6ecff780","Type":"ContainerStarted","Data":"a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8"} Dec 04 00:29:03.902592 master-0 kubenswrapper[4799]: I1204 00:29:03.902544 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerStarted","Data":"c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b"} Dec 04 00:29:04.213563 master-0 kubenswrapper[4799]: I1204 00:29:04.213455 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-t85qp"] Dec 04 00:29:04.214162 master-0 kubenswrapper[4799]: I1204 00:29:04.214103 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.214302 master-0 kubenswrapper[4799]: E1204 00:29:04.214239 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:04.246283 master-0 kubenswrapper[4799]: I1204 00:29:04.246168 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podStartSLOduration=1.246143676 podStartE2EDuration="1.246143676s" podCreationTimestamp="2025-12-04 00:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:29:04.246045933 +0000 UTC m=+85.062666451" watchObservedRunningTime="2025-12-04 00:29:04.246143676 +0000 UTC m=+85.062764194" Dec 04 00:29:04.302248 master-0 kubenswrapper[4799]: I1204 00:29:04.302164 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.303581 master-0 kubenswrapper[4799]: I1204 00:29:04.302449 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.404029 master-0 kubenswrapper[4799]: I1204 00:29:04.403916 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.404263 master-0 kubenswrapper[4799]: I1204 00:29:04.404044 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.404263 master-0 kubenswrapper[4799]: E1204 00:29:04.404116 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:04.404263 master-0 kubenswrapper[4799]: E1204 00:29:04.404225 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:04.904202129 +0000 UTC m=+85.720822647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:04.425613 master-0 kubenswrapper[4799]: I1204 00:29:04.425568 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.907422 master-0 kubenswrapper[4799]: I1204 00:29:04.907367 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:04.907743 master-0 kubenswrapper[4799]: E1204 00:29:04.907584 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:04.907743 master-0 kubenswrapper[4799]: E1204 00:29:04.907717 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:05.907680096 +0000 UTC m=+86.724300654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:05.919813 master-0 kubenswrapper[4799]: I1204 00:29:05.919754 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:05.920420 master-0 kubenswrapper[4799]: E1204 00:29:05.919955 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:05.920420 master-0 kubenswrapper[4799]: E1204 00:29:05.920013 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:07.919995645 +0000 UTC m=+88.736616153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:06.571257 master-0 kubenswrapper[4799]: I1204 00:29:06.571153 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:06.571417 master-0 kubenswrapper[4799]: E1204 00:29:06.571321 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:06.911752 master-0 kubenswrapper[4799]: I1204 00:29:06.911683 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="f2410f4e6fc6ca15d32c345499d7fa49d4ebf0368ee0349e5f7ab0bbf2ca3cf1" exitCode=0 Dec 04 00:29:06.911752 master-0 kubenswrapper[4799]: I1204 00:29:06.911741 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"f2410f4e6fc6ca15d32c345499d7fa49d4ebf0368ee0349e5f7ab0bbf2ca3cf1"} Dec 04 00:29:07.946120 master-0 kubenswrapper[4799]: I1204 00:29:07.946053 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:07.947071 master-0 kubenswrapper[4799]: E1204 00:29:07.946205 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:07.947071 master-0 kubenswrapper[4799]: E1204 00:29:07.946265 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:11.946250826 +0000 UTC m=+92.762871334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:08.571578 master-0 kubenswrapper[4799]: I1204 00:29:08.571498 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:08.571968 master-0 kubenswrapper[4799]: E1204 00:29:08.571674 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:09.585205 master-0 kubenswrapper[4799]: I1204 00:29:09.585139 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:29:10.570664 master-0 kubenswrapper[4799]: I1204 00:29:10.570592 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:10.571287 master-0 kubenswrapper[4799]: E1204 00:29:10.570731 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:11.981649 master-0 kubenswrapper[4799]: I1204 00:29:11.981538 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:11.982498 master-0 kubenswrapper[4799]: E1204 00:29:11.981722 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:11.982498 master-0 kubenswrapper[4799]: E1204 00:29:11.981800 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:19.9817812 +0000 UTC m=+100.798401708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:12.571476 master-0 kubenswrapper[4799]: I1204 00:29:12.571417 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:12.571841 master-0 kubenswrapper[4799]: E1204 00:29:12.571585 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:14.571235 master-0 kubenswrapper[4799]: I1204 00:29:14.571178 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:14.571748 master-0 kubenswrapper[4799]: E1204 00:29:14.571365 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:15.614375 master-0 kubenswrapper[4799]: I1204 00:29:15.614236 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc"] Dec 04 00:29:15.616395 master-0 kubenswrapper[4799]: I1204 00:29:15.616269 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.620660 master-0 kubenswrapper[4799]: I1204 00:29:15.620613 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 00:29:15.620841 master-0 kubenswrapper[4799]: I1204 00:29:15.620752 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 00:29:15.621148 master-0 kubenswrapper[4799]: I1204 00:29:15.621015 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 00:29:15.621148 master-0 kubenswrapper[4799]: I1204 00:29:15.621059 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 00:29:15.621327 master-0 kubenswrapper[4799]: I1204 00:29:15.621301 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 00:29:15.624401 master-0 kubenswrapper[4799]: I1204 00:29:15.624298 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.625254 master-0 kubenswrapper[4799]: I1204 00:29:15.624394 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.625254 master-0 kubenswrapper[4799]: I1204 00:29:15.624475 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.625254 master-0 kubenswrapper[4799]: I1204 00:29:15.624509 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.642706 master-0 kubenswrapper[4799]: I1204 00:29:15.642619 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/bootstrap-kube-scheduler-master-0" podStartSLOduration=6.642590224 podStartE2EDuration="6.642590224s" podCreationTimestamp="2025-12-04 00:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:29:15.630683805 +0000 UTC m=+96.447304313" watchObservedRunningTime="2025-12-04 00:29:15.642590224 +0000 UTC m=+96.459210732" Dec 04 00:29:15.725770 master-0 kubenswrapper[4799]: I1204 00:29:15.724914 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.725770 master-0 kubenswrapper[4799]: I1204 00:29:15.725007 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.725770 master-0 kubenswrapper[4799]: I1204 00:29:15.725068 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.725770 master-0 kubenswrapper[4799]: I1204 00:29:15.725116 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.725770 master-0 kubenswrapper[4799]: I1204 00:29:15.725710 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.726160 master-0 kubenswrapper[4799]: I1204 00:29:15.725793 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.733509 master-0 kubenswrapper[4799]: I1204 00:29:15.732358 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.741316 master-0 kubenswrapper[4799]: I1204 00:29:15.741277 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:15.825754 master-0 kubenswrapper[4799]: I1204 00:29:15.825698 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xvv6s"] Dec 04 00:29:15.826635 master-0 kubenswrapper[4799]: I1204 00:29:15.826598 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.832029 master-0 kubenswrapper[4799]: I1204 00:29:15.829249 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 00:29:15.833240 master-0 kubenswrapper[4799]: I1204 00:29:15.833188 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 00:29:15.927237 master-0 kubenswrapper[4799]: I1204 00:29:15.927127 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927237 master-0 kubenswrapper[4799]: I1204 00:29:15.927217 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927237 master-0 kubenswrapper[4799]: I1204 00:29:15.927242 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927375 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927436 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927467 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927535 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927556 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927576 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjf5w\" (UniqueName: \"kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927600 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927637 master-0 kubenswrapper[4799]: I1204 00:29:15.927617 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927959 master-0 kubenswrapper[4799]: I1204 00:29:15.927730 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927959 master-0 kubenswrapper[4799]: I1204 00:29:15.927801 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927959 master-0 kubenswrapper[4799]: I1204 00:29:15.927897 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.927959 master-0 kubenswrapper[4799]: I1204 00:29:15.927944 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.928123 master-0 kubenswrapper[4799]: I1204 00:29:15.927972 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.928123 master-0 kubenswrapper[4799]: I1204 00:29:15.927991 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.928123 master-0 kubenswrapper[4799]: I1204 00:29:15.928013 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.928123 master-0 kubenswrapper[4799]: I1204 00:29:15.928114 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.928274 master-0 kubenswrapper[4799]: I1204 00:29:15.928147 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:15.942843 master-0 kubenswrapper[4799]: I1204 00:29:15.942797 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028633 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028737 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028779 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028798 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028818 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028890 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028891 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028910 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.029029 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029029 master-0 kubenswrapper[4799]: I1204 00:29:16.028982 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029034 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029117 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029054 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029243 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029300 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029347 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029388 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qjf5w\" (UniqueName: \"kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029427 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.029485 master-0 kubenswrapper[4799]: I1204 00:29:16.029465 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029548 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029607 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029622 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029678 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029468 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029655 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029635 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029732 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029741 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.030083 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029769 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.030130 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.029771 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030151 master-0 kubenswrapper[4799]: I1204 00:29:16.030167 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030733 master-0 kubenswrapper[4799]: I1204 00:29:16.030201 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030733 master-0 kubenswrapper[4799]: I1204 00:29:16.030216 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030733 master-0 kubenswrapper[4799]: I1204 00:29:16.030280 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030733 master-0 kubenswrapper[4799]: I1204 00:29:16.030456 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.030970 master-0 kubenswrapper[4799]: I1204 00:29:16.030851 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.034602 master-0 kubenswrapper[4799]: I1204 00:29:16.034566 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.047744 master-0 kubenswrapper[4799]: I1204 00:29:16.047718 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjf5w\" (UniqueName: \"kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w\") pod \"ovnkube-node-xvv6s\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.144218 master-0 kubenswrapper[4799]: I1204 00:29:16.143842 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:16.176287 master-0 kubenswrapper[4799]: W1204 00:29:16.176170 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54d77f2_3f5e_4725_b553_eb4fbe9b68ca.slice/crio-6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e WatchSource:0}: Error finding container 6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e: Status 404 returned error can't find the container with id 6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e Dec 04 00:29:16.571718 master-0 kubenswrapper[4799]: I1204 00:29:16.571513 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:16.572047 master-0 kubenswrapper[4799]: E1204 00:29:16.571723 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:16.938028 master-0 kubenswrapper[4799]: I1204 00:29:16.937965 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e"} Dec 04 00:29:16.939988 master-0 kubenswrapper[4799]: I1204 00:29:16.939914 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7796" event={"ID":"d7a0402f-755b-44a1-8cb8-c95b6ecff780","Type":"ContainerStarted","Data":"f407dd869a88403aaf014f338e2a708d07486f35b0d1b1d74512a8c92a0b8367"} Dec 04 00:29:16.944449 master-0 kubenswrapper[4799]: I1204 00:29:16.943598 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerStarted","Data":"eeb4ca21443df786926f97a2c63bc3a11f4fae4ea56ba3e5061345e37c60fb37"} Dec 04 00:29:16.944449 master-0 kubenswrapper[4799]: I1204 00:29:16.943654 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerStarted","Data":"90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47"} Dec 04 00:29:16.948851 master-0 kubenswrapper[4799]: I1204 00:29:16.948807 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="6f0ebba6a9c03ec96d055a8afe226473e6d6b3f268074fd934a991ed33ca39ec" exitCode=0 Dec 04 00:29:16.948942 master-0 kubenswrapper[4799]: I1204 00:29:16.948867 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"6f0ebba6a9c03ec96d055a8afe226473e6d6b3f268074fd934a991ed33ca39ec"} Dec 04 00:29:16.961364 master-0 kubenswrapper[4799]: I1204 00:29:16.961269 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-w7796" podStartSLOduration=1.613105478 podStartE2EDuration="13.961245737s" podCreationTimestamp="2025-12-04 00:29:03 +0000 UTC" firstStartedPulling="2025-12-04 00:29:03.590174039 +0000 UTC m=+84.406794547" lastFinishedPulling="2025-12-04 00:29:15.938314298 +0000 UTC m=+96.754934806" observedRunningTime="2025-12-04 00:29:16.95810294 +0000 UTC m=+97.774723458" watchObservedRunningTime="2025-12-04 00:29:16.961245737 +0000 UTC m=+97.777866245" Dec 04 00:29:17.341399 master-0 kubenswrapper[4799]: I1204 00:29:17.341267 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:29:17.341588 master-0 kubenswrapper[4799]: E1204 00:29:17.341497 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:17.341631 master-0 kubenswrapper[4799]: E1204 00:29:17.341597 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:49.341570671 +0000 UTC m=+130.158191169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:18.570726 master-0 kubenswrapper[4799]: I1204 00:29:18.570669 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:18.571286 master-0 kubenswrapper[4799]: E1204 00:29:18.570850 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:18.980095 master-0 kubenswrapper[4799]: I1204 00:29:18.980016 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 00:29:20.073810 master-0 kubenswrapper[4799]: I1204 00:29:20.073690 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:20.074335 master-0 kubenswrapper[4799]: E1204 00:29:20.073996 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:20.074335 master-0 kubenswrapper[4799]: E1204 00:29:20.074116 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:36.074092046 +0000 UTC m=+116.890712564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:20.403121 master-0 kubenswrapper[4799]: I1204 00:29:20.403008 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/bootstrap-kube-controller-manager-master-0" podStartSLOduration=2.402981778 podStartE2EDuration="2.402981778s" podCreationTimestamp="2025-12-04 00:29:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:29:20.400733919 +0000 UTC m=+101.217354457" watchObservedRunningTime="2025-12-04 00:29:20.402981778 +0000 UTC m=+101.219602306" Dec 04 00:29:20.442686 master-0 kubenswrapper[4799]: I1204 00:29:20.442605 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-w5f2j"] Dec 04 00:29:20.443360 master-0 kubenswrapper[4799]: I1204 00:29:20.443083 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:20.443360 master-0 kubenswrapper[4799]: E1204 00:29:20.443157 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:20.478386 master-0 kubenswrapper[4799]: I1204 00:29:20.476441 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:20.571409 master-0 kubenswrapper[4799]: I1204 00:29:20.571355 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:20.571660 master-0 kubenswrapper[4799]: E1204 00:29:20.571516 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:20.577972 master-0 kubenswrapper[4799]: I1204 00:29:20.577893 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:20.597242 master-0 kubenswrapper[4799]: E1204 00:29:20.597189 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:20.597242 master-0 kubenswrapper[4799]: E1204 00:29:20.597232 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:20.597242 master-0 kubenswrapper[4799]: E1204 00:29:20.597249 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:20.597490 master-0 kubenswrapper[4799]: E1204 00:29:20.597332 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:21.097308324 +0000 UTC m=+101.913928832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:20.961903 master-0 kubenswrapper[4799]: I1204 00:29:20.961683 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="d5609818cd8c2efbda7153e648a8259ae917c74f4ff0c93048f634b456d737d1" exitCode=0 Dec 04 00:29:20.961903 master-0 kubenswrapper[4799]: I1204 00:29:20.961780 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"d5609818cd8c2efbda7153e648a8259ae917c74f4ff0c93048f634b456d737d1"} Dec 04 00:29:21.183312 master-0 kubenswrapper[4799]: I1204 00:29:21.183233 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:21.185188 master-0 kubenswrapper[4799]: E1204 00:29:21.183466 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:21.185188 master-0 kubenswrapper[4799]: E1204 00:29:21.183485 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:21.185188 master-0 kubenswrapper[4799]: E1204 00:29:21.183497 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:21.185188 master-0 kubenswrapper[4799]: E1204 00:29:21.183552 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:22.183535193 +0000 UTC m=+103.000155701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:21.420815 master-0 kubenswrapper[4799]: I1204 00:29:21.420735 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-node-identity/network-node-identity-lxpmq"] Dec 04 00:29:21.422615 master-0 kubenswrapper[4799]: I1204 00:29:21.421717 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.423860 master-0 kubenswrapper[4799]: I1204 00:29:21.423821 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 00:29:21.425461 master-0 kubenswrapper[4799]: I1204 00:29:21.425154 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 00:29:21.425461 master-0 kubenswrapper[4799]: I1204 00:29:21.425257 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 00:29:21.425461 master-0 kubenswrapper[4799]: I1204 00:29:21.425390 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 00:29:21.426782 master-0 kubenswrapper[4799]: I1204 00:29:21.426748 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 00:29:21.485377 master-0 kubenswrapper[4799]: I1204 00:29:21.485291 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.485377 master-0 kubenswrapper[4799]: I1204 00:29:21.485382 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.485624 master-0 kubenswrapper[4799]: I1204 00:29:21.485414 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.485624 master-0 kubenswrapper[4799]: I1204 00:29:21.485454 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.586458 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.586521 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.586547 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.586577 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.587689 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.588292 master-0 kubenswrapper[4799]: I1204 00:29:21.588246 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.600028 master-0 kubenswrapper[4799]: I1204 00:29:21.599929 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.736690 master-0 kubenswrapper[4799]: I1204 00:29:21.736591 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.736951 master-0 kubenswrapper[4799]: I1204 00:29:21.736730 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:29:21.749088 master-0 kubenswrapper[4799]: W1204 00:29:21.749053 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0616abbd_748a_4451_96b7_df0178c99e8f.slice/crio-f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e WatchSource:0}: Error finding container f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e: Status 404 returned error can't find the container with id f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e Dec 04 00:29:21.967047 master-0 kubenswrapper[4799]: I1204 00:29:21.966983 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerStarted","Data":"f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e"} Dec 04 00:29:22.192818 master-0 kubenswrapper[4799]: I1204 00:29:22.192711 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:22.193342 master-0 kubenswrapper[4799]: E1204 00:29:22.192981 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:22.193342 master-0 kubenswrapper[4799]: E1204 00:29:22.193028 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:22.193342 master-0 kubenswrapper[4799]: E1204 00:29:22.193044 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:22.193342 master-0 kubenswrapper[4799]: E1204 00:29:22.193122 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:24.193098968 +0000 UTC m=+105.009719556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:22.571673 master-0 kubenswrapper[4799]: I1204 00:29:22.571176 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:22.571673 master-0 kubenswrapper[4799]: I1204 00:29:22.571217 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:22.571673 master-0 kubenswrapper[4799]: E1204 00:29:22.571327 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:22.571673 master-0 kubenswrapper[4799]: E1204 00:29:22.571498 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:22.972769 master-0 kubenswrapper[4799]: I1204 00:29:22.972581 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="8ff5104678eaba3eecd736a278e1661792ddc36a8b68f4b69f7019b814f16993" exitCode=0 Dec 04 00:29:22.972769 master-0 kubenswrapper[4799]: I1204 00:29:22.972656 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"8ff5104678eaba3eecd736a278e1661792ddc36a8b68f4b69f7019b814f16993"} Dec 04 00:29:24.212567 master-0 kubenswrapper[4799]: I1204 00:29:24.212512 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:24.213221 master-0 kubenswrapper[4799]: E1204 00:29:24.212707 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:24.213221 master-0 kubenswrapper[4799]: E1204 00:29:24.212725 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:24.213221 master-0 kubenswrapper[4799]: E1204 00:29:24.212737 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:24.213221 master-0 kubenswrapper[4799]: E1204 00:29:24.212792 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:28.212777473 +0000 UTC m=+109.029397971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:24.570913 master-0 kubenswrapper[4799]: I1204 00:29:24.570802 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:24.571092 master-0 kubenswrapper[4799]: E1204 00:29:24.570960 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:24.571092 master-0 kubenswrapper[4799]: I1204 00:29:24.571033 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:24.571092 master-0 kubenswrapper[4799]: E1204 00:29:24.571086 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:26.571513 master-0 kubenswrapper[4799]: I1204 00:29:26.571462 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:26.572080 master-0 kubenswrapper[4799]: I1204 00:29:26.571524 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:26.572080 master-0 kubenswrapper[4799]: E1204 00:29:26.571618 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:26.572080 master-0 kubenswrapper[4799]: E1204 00:29:26.571752 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:28.240171 master-0 kubenswrapper[4799]: I1204 00:29:28.240059 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:28.240886 master-0 kubenswrapper[4799]: E1204 00:29:28.240290 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:28.240886 master-0 kubenswrapper[4799]: E1204 00:29:28.240328 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:28.240886 master-0 kubenswrapper[4799]: E1204 00:29:28.240345 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:28.240886 master-0 kubenswrapper[4799]: E1204 00:29:28.240420 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:36.240393473 +0000 UTC m=+117.057014181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:28.571447 master-0 kubenswrapper[4799]: I1204 00:29:28.571301 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:28.571447 master-0 kubenswrapper[4799]: I1204 00:29:28.571368 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:28.571690 master-0 kubenswrapper[4799]: E1204 00:29:28.571480 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:28.571690 master-0 kubenswrapper[4799]: E1204 00:29:28.571610 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:30.571070 master-0 kubenswrapper[4799]: I1204 00:29:30.570986 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:30.572161 master-0 kubenswrapper[4799]: I1204 00:29:30.570986 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:30.572161 master-0 kubenswrapper[4799]: E1204 00:29:30.571131 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:30.572161 master-0 kubenswrapper[4799]: E1204 00:29:30.571215 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:32.570913 master-0 kubenswrapper[4799]: I1204 00:29:32.570840 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:32.571708 master-0 kubenswrapper[4799]: E1204 00:29:32.571003 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:32.571708 master-0 kubenswrapper[4799]: I1204 00:29:32.571448 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:32.571708 master-0 kubenswrapper[4799]: E1204 00:29:32.571532 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:34.001118 master-0 kubenswrapper[4799]: I1204 00:29:34.000550 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" exitCode=0 Dec 04 00:29:34.002489 master-0 kubenswrapper[4799]: I1204 00:29:34.000644 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} Dec 04 00:29:34.004272 master-0 kubenswrapper[4799]: I1204 00:29:34.004195 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerStarted","Data":"0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee"} Dec 04 00:29:34.004272 master-0 kubenswrapper[4799]: I1204 00:29:34.004267 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerStarted","Data":"bfccd081e21d82a3d1f2a334db9dec041d02bafbf5211e78f263ad6ad3336051"} Dec 04 00:29:34.010908 master-0 kubenswrapper[4799]: I1204 00:29:34.010708 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="42a43c5406cc22adb9b3ba42d732fa8cb77848a82bb7e49ec7284642472baad4" exitCode=0 Dec 04 00:29:34.010908 master-0 kubenswrapper[4799]: I1204 00:29:34.010801 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"42a43c5406cc22adb9b3ba42d732fa8cb77848a82bb7e49ec7284642472baad4"} Dec 04 00:29:34.013212 master-0 kubenswrapper[4799]: I1204 00:29:34.013172 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerStarted","Data":"7630ed34c5afaf7ec052397359ddb4e03d2aaa0074ba8d9aa9989ae1eab28f0b"} Dec 04 00:29:34.101802 master-0 kubenswrapper[4799]: I1204 00:29:34.101690 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-node-identity/network-node-identity-lxpmq" podStartSLOduration=1.805830037 podStartE2EDuration="13.101662189s" podCreationTimestamp="2025-12-04 00:29:21 +0000 UTC" firstStartedPulling="2025-12-04 00:29:21.751631041 +0000 UTC m=+102.568251549" lastFinishedPulling="2025-12-04 00:29:33.047463193 +0000 UTC m=+113.864083701" observedRunningTime="2025-12-04 00:29:34.084962262 +0000 UTC m=+114.901582770" watchObservedRunningTime="2025-12-04 00:29:34.101662189 +0000 UTC m=+114.918282707" Dec 04 00:29:34.571486 master-0 kubenswrapper[4799]: I1204 00:29:34.570898 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:34.571637 master-0 kubenswrapper[4799]: E1204 00:29:34.571582 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:34.571637 master-0 kubenswrapper[4799]: I1204 00:29:34.570915 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:34.572301 master-0 kubenswrapper[4799]: E1204 00:29:34.572246 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:35.026541 master-0 kubenswrapper[4799]: I1204 00:29:35.026415 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} Dec 04 00:29:35.026541 master-0 kubenswrapper[4799]: I1204 00:29:35.026507 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} Dec 04 00:29:35.026541 master-0 kubenswrapper[4799]: I1204 00:29:35.026527 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} Dec 04 00:29:35.026541 master-0 kubenswrapper[4799]: I1204 00:29:35.026544 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} Dec 04 00:29:35.026541 master-0 kubenswrapper[4799]: I1204 00:29:35.026562 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:35.028383 master-0 kubenswrapper[4799]: I1204 00:29:35.026581 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:35.031953 master-0 kubenswrapper[4799]: I1204 00:29:35.031846 4799 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="5310369388b9d57f1136135213aab2547b7606ff55df76063a2bfab7824144bd" exitCode=0 Dec 04 00:29:35.032066 master-0 kubenswrapper[4799]: I1204 00:29:35.031965 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerDied","Data":"5310369388b9d57f1136135213aab2547b7606ff55df76063a2bfab7824144bd"} Dec 04 00:29:35.059052 master-0 kubenswrapper[4799]: I1204 00:29:35.058953 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" podStartSLOduration=3.243252335 podStartE2EDuration="20.058905964s" podCreationTimestamp="2025-12-04 00:29:15 +0000 UTC" firstStartedPulling="2025-12-04 00:29:16.203065294 +0000 UTC m=+97.019685802" lastFinishedPulling="2025-12-04 00:29:33.018718923 +0000 UTC m=+113.835339431" observedRunningTime="2025-12-04 00:29:34.104582619 +0000 UTC m=+114.921203137" watchObservedRunningTime="2025-12-04 00:29:35.058905964 +0000 UTC m=+115.875526532" Dec 04 00:29:36.053844 master-0 kubenswrapper[4799]: I1204 00:29:36.053688 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jglkq" event={"ID":"36d5dd7e-7ac5-4c41-8f62-404bc5919857","Type":"ContainerStarted","Data":"6f95016b79c09abb0d59063ab3f565cff11aea3822d0984f343b41528b00f84f"} Dec 04 00:29:36.098629 master-0 kubenswrapper[4799]: I1204 00:29:36.096917 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jglkq" podStartSLOduration=3.832584859 podStartE2EDuration="33.096770575s" podCreationTimestamp="2025-12-04 00:29:03 +0000 UTC" firstStartedPulling="2025-12-04 00:29:03.772527504 +0000 UTC m=+84.589148052" lastFinishedPulling="2025-12-04 00:29:33.03671325 +0000 UTC m=+113.853333768" observedRunningTime="2025-12-04 00:29:36.095521936 +0000 UTC m=+116.912142484" watchObservedRunningTime="2025-12-04 00:29:36.096770575 +0000 UTC m=+116.913391123" Dec 04 00:29:36.108769 master-0 kubenswrapper[4799]: I1204 00:29:36.108208 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:36.108769 master-0 kubenswrapper[4799]: E1204 00:29:36.108457 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:36.108769 master-0 kubenswrapper[4799]: E1204 00:29:36.108585 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:08.10855362 +0000 UTC m=+148.925174168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 00:29:36.310533 master-0 kubenswrapper[4799]: I1204 00:29:36.310412 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:36.310788 master-0 kubenswrapper[4799]: E1204 00:29:36.310734 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:36.310849 master-0 kubenswrapper[4799]: E1204 00:29:36.310792 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:36.310849 master-0 kubenswrapper[4799]: E1204 00:29:36.310814 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:36.311019 master-0 kubenswrapper[4799]: E1204 00:29:36.310900 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:29:52.310874763 +0000 UTC m=+133.127495311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:36.571237 master-0 kubenswrapper[4799]: I1204 00:29:36.571059 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:36.571542 master-0 kubenswrapper[4799]: E1204 00:29:36.571269 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:36.571636 master-0 kubenswrapper[4799]: I1204 00:29:36.571097 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:36.571871 master-0 kubenswrapper[4799]: E1204 00:29:36.571843 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:38.069148 master-0 kubenswrapper[4799]: I1204 00:29:38.069084 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} Dec 04 00:29:38.570662 master-0 kubenswrapper[4799]: I1204 00:29:38.570573 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:38.570977 master-0 kubenswrapper[4799]: E1204 00:29:38.570731 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:38.571167 master-0 kubenswrapper[4799]: I1204 00:29:38.570573 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:38.571365 master-0 kubenswrapper[4799]: E1204 00:29:38.571318 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:39.461707 master-0 kubenswrapper[4799]: E1204 00:29:39.461647 4799 kubelet_node_status.go:497] "Node not becoming ready in time after startup" Dec 04 00:29:39.562001 master-0 kubenswrapper[4799]: E1204 00:29:39.561522 4799 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 00:29:40.571584 master-0 kubenswrapper[4799]: I1204 00:29:40.571388 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:40.571584 master-0 kubenswrapper[4799]: I1204 00:29:40.571388 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:40.572959 master-0 kubenswrapper[4799]: E1204 00:29:40.571657 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:40.572959 master-0 kubenswrapper[4799]: E1204 00:29:40.571730 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:41.092983 master-0 kubenswrapper[4799]: I1204 00:29:41.092836 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerStarted","Data":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} Dec 04 00:29:42.571487 master-0 kubenswrapper[4799]: I1204 00:29:42.571395 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:42.572294 master-0 kubenswrapper[4799]: I1204 00:29:42.571587 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:42.572294 master-0 kubenswrapper[4799]: E1204 00:29:42.571690 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:42.572294 master-0 kubenswrapper[4799]: E1204 00:29:42.571857 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:43.100472 master-0 kubenswrapper[4799]: I1204 00:29:43.099813 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:43.100472 master-0 kubenswrapper[4799]: I1204 00:29:43.100372 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:43.100472 master-0 kubenswrapper[4799]: I1204 00:29:43.100403 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:43.137920 master-0 kubenswrapper[4799]: I1204 00:29:43.137853 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:43.140201 master-0 kubenswrapper[4799]: I1204 00:29:43.140156 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:44.563424 master-0 kubenswrapper[4799]: E1204 00:29:44.563343 4799 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 00:29:44.570839 master-0 kubenswrapper[4799]: I1204 00:29:44.570773 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:44.571084 master-0 kubenswrapper[4799]: E1204 00:29:44.571020 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:44.571653 master-0 kubenswrapper[4799]: I1204 00:29:44.570838 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:44.571914 master-0 kubenswrapper[4799]: E1204 00:29:44.571812 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:44.835575 master-0 kubenswrapper[4799]: I1204 00:29:44.835391 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podStartSLOduration=12.981151235 podStartE2EDuration="29.835364007s" podCreationTimestamp="2025-12-04 00:29:15 +0000 UTC" firstStartedPulling="2025-12-04 00:29:16.17966563 +0000 UTC m=+96.996286138" lastFinishedPulling="2025-12-04 00:29:33.033878392 +0000 UTC m=+113.850498910" observedRunningTime="2025-12-04 00:29:44.834902912 +0000 UTC m=+125.651523470" watchObservedRunningTime="2025-12-04 00:29:44.835364007 +0000 UTC m=+125.651984545" Dec 04 00:29:44.983488 master-0 kubenswrapper[4799]: I1204 00:29:44.983410 4799 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xvv6s"] Dec 04 00:29:45.124382 master-0 kubenswrapper[4799]: I1204 00:29:45.124197 4799 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" probeResult="failure" output="" Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108192 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-node" containerID="cri-o://60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" gracePeriod=30 Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108276 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="nbdb" containerID="cri-o://24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" gracePeriod=30 Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108296 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="sbdb" containerID="cri-o://9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" gracePeriod=30 Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108291 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" gracePeriod=30 Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108309 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-acl-logging" containerID="cri-o://69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" gracePeriod=30 Dec 04 00:29:46.108521 master-0 kubenswrapper[4799]: I1204 00:29:46.108225 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="northd" containerID="cri-o://7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" gracePeriod=30 Dec 04 00:29:46.109329 master-0 kubenswrapper[4799]: I1204 00:29:46.109286 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-controller" containerID="cri-o://f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" gracePeriod=30 Dec 04 00:29:46.132607 master-0 kubenswrapper[4799]: I1204 00:29:46.132370 4799 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" probeResult="failure" output="" Dec 04 00:29:46.133328 master-0 kubenswrapper[4799]: I1204 00:29:46.133018 4799 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" containerID="cri-o://400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" gracePeriod=30 Dec 04 00:29:46.146688 master-0 kubenswrapper[4799]: E1204 00:29:46.146612 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Dec 04 00:29:46.147170 master-0 kubenswrapper[4799]: E1204 00:29:46.147136 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Dec 04 00:29:46.148053 master-0 kubenswrapper[4799]: E1204 00:29:46.148014 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Dec 04 00:29:46.148729 master-0 kubenswrapper[4799]: E1204 00:29:46.148682 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Dec 04 00:29:46.148779 master-0 kubenswrapper[4799]: E1204 00:29:46.148750 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" cmd=["/bin/bash","-c","#!/bin/bash\ntest -f /etc/cni/net.d/10-ovn-kubernetes.conf\n"] Dec 04 00:29:46.149383 master-0 kubenswrapper[4799]: E1204 00:29:46.149264 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Dec 04 00:29:46.149383 master-0 kubenswrapper[4799]: E1204 00:29:46.149324 4799 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="sbdb" Dec 04 00:29:46.150868 master-0 kubenswrapper[4799]: E1204 00:29:46.150696 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Dec 04 00:29:46.150868 master-0 kubenswrapper[4799]: E1204 00:29:46.150741 4799 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="nbdb" Dec 04 00:29:46.156216 master-0 kubenswrapper[4799]: E1204 00:29:46.156175 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" cmd=["/bin/bash","-c","#!/bin/bash\ntest -f /etc/cni/net.d/10-ovn-kubernetes.conf\n"] Dec 04 00:29:46.157059 master-0 kubenswrapper[4799]: E1204 00:29:46.156968 4799 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 is running failed: container process not found" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" cmd=["/bin/bash","-c","#!/bin/bash\ntest -f /etc/cni/net.d/10-ovn-kubernetes.conf\n"] Dec 04 00:29:46.157126 master-0 kubenswrapper[4799]: E1204 00:29:46.157083 4799 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" Dec 04 00:29:46.357248 master-0 kubenswrapper[4799]: I1204 00:29:46.357196 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovnkube-controller/0.log" Dec 04 00:29:46.359758 master-0 kubenswrapper[4799]: I1204 00:29:46.359562 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/kube-rbac-proxy-ovn-metrics/0.log" Dec 04 00:29:46.360120 master-0 kubenswrapper[4799]: I1204 00:29:46.360088 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/kube-rbac-proxy-node/0.log" Dec 04 00:29:46.360727 master-0 kubenswrapper[4799]: I1204 00:29:46.360695 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovn-acl-logging/0.log" Dec 04 00:29:46.361292 master-0 kubenswrapper[4799]: I1204 00:29:46.361246 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovn-controller/0.log" Dec 04 00:29:46.361844 master-0 kubenswrapper[4799]: I1204 00:29:46.361821 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:46.408040 master-0 kubenswrapper[4799]: I1204 00:29:46.407946 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408040 master-0 kubenswrapper[4799]: I1204 00:29:46.408009 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408040 master-0 kubenswrapper[4799]: I1204 00:29:46.408046 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408074 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408116 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408147 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjf5w\" (UniqueName: \"kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408174 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408200 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408224 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408247 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408268 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408294 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408319 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408342 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408376 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408397 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408424 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408447 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.408477 master-0 kubenswrapper[4799]: I1204 00:29:46.408482 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.409425 master-0 kubenswrapper[4799]: I1204 00:29:46.408508 4799 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns\") pod \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\" (UID: \"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca\") " Dec 04 00:29:46.409425 master-0 kubenswrapper[4799]: I1204 00:29:46.408751 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409425 master-0 kubenswrapper[4799]: I1204 00:29:46.408806 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log" (OuterVolumeSpecName: "node-log") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409425 master-0 kubenswrapper[4799]: I1204 00:29:46.408835 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket" (OuterVolumeSpecName: "log-socket") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409406 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409487 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409514 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409541 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409563 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409592 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409573 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409624 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.409649 master-0 kubenswrapper[4799]: I1204 00:29:46.409654 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.410178 master-0 kubenswrapper[4799]: I1204 00:29:46.409681 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.410178 master-0 kubenswrapper[4799]: I1204 00:29:46.409688 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash" (OuterVolumeSpecName: "host-slash") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.410178 master-0 kubenswrapper[4799]: I1204 00:29:46.409712 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.410178 master-0 kubenswrapper[4799]: I1204 00:29:46.409740 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.410178 master-0 kubenswrapper[4799]: I1204 00:29:46.409736 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.415697 master-0 kubenswrapper[4799]: I1204 00:29:46.415558 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:29:46.417253 master-0 kubenswrapper[4799]: I1204 00:29:46.417179 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w" (OuterVolumeSpecName: "kube-api-access-qjf5w") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "kube-api-access-qjf5w". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:29:46.420241 master-0 kubenswrapper[4799]: I1204 00:29:46.420100 4799 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" (UID: "c54d77f2-3f5e-4725-b553-eb4fbe9b68ca"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:29:46.430864 master-0 kubenswrapper[4799]: I1204 00:29:46.430809 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kgflj"] Dec 04 00:29:46.431016 master-0 kubenswrapper[4799]: E1204 00:29:46.430990 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 00:29:46.431055 master-0 kubenswrapper[4799]: I1204 00:29:46.431021 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 00:29:46.431055 master-0 kubenswrapper[4799]: E1204 00:29:46.431039 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="sbdb" Dec 04 00:29:46.431109 master-0 kubenswrapper[4799]: I1204 00:29:46.431052 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="sbdb" Dec 04 00:29:46.431109 master-0 kubenswrapper[4799]: E1204 00:29:46.431069 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="northd" Dec 04 00:29:46.431109 master-0 kubenswrapper[4799]: I1204 00:29:46.431084 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="northd" Dec 04 00:29:46.431109 master-0 kubenswrapper[4799]: E1204 00:29:46.431098 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="nbdb" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: I1204 00:29:46.431111 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="nbdb" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: E1204 00:29:46.431129 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kubecfg-setup" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: I1204 00:29:46.431143 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kubecfg-setup" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: E1204 00:29:46.431159 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-node" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: I1204 00:29:46.431172 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-node" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: E1204 00:29:46.431185 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-controller" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: I1204 00:29:46.431198 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-controller" Dec 04 00:29:46.431219 master-0 kubenswrapper[4799]: E1204 00:29:46.431212 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-acl-logging" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431228 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-acl-logging" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: E1204 00:29:46.431244 4799 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431258 4799 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431336 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="nbdb" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431355 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-node" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431370 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-controller" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431383 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431397 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="sbdb" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431412 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovn-acl-logging" Dec 04 00:29:46.431422 master-0 kubenswrapper[4799]: I1204 00:29:46.431427 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="northd" Dec 04 00:29:46.431773 master-0 kubenswrapper[4799]: I1204 00:29:46.431443 4799 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerName="ovnkube-controller" Dec 04 00:29:46.432752 master-0 kubenswrapper[4799]: I1204 00:29:46.432696 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510121 master-0 kubenswrapper[4799]: I1204 00:29:46.510007 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510121 master-0 kubenswrapper[4799]: I1204 00:29:46.510101 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510162 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510212 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510313 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510439 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510483 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510535 master-0 kubenswrapper[4799]: I1204 00:29:46.510502 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510569 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510588 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510614 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510636 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510677 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510716 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.510756 master-0 kubenswrapper[4799]: I1204 00:29:46.510755 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511065 master-0 kubenswrapper[4799]: I1204 00:29:46.510813 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511065 master-0 kubenswrapper[4799]: I1204 00:29:46.510831 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511065 master-0 kubenswrapper[4799]: I1204 00:29:46.510953 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511065 master-0 kubenswrapper[4799]: I1204 00:29:46.510986 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511065 master-0 kubenswrapper[4799]: I1204 00:29:46.511032 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511082 4799 reconciler_common.go:293] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-systemd-units\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511099 4799 reconciler_common.go:293] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-bin\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511112 4799 reconciler_common.go:293] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511125 4799 reconciler_common.go:293] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-var-lib-cni-networks-ovn-kubernetes\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511142 4799 reconciler_common.go:293] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovn-node-metrics-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511155 4799 reconciler_common.go:293] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-netns\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511167 4799 reconciler_common.go:293] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511178 4799 reconciler_common.go:293] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-ovnkube-script-lib\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511188 4799 reconciler_common.go:293] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-env-overrides\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511200 4799 reconciler_common.go:293] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-node-log\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511233 4799 reconciler_common.go:293] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-log-socket\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511245 4799 reconciler_common.go:293] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-slash\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511250 master-0 kubenswrapper[4799]: I1204 00:29:46.511257 4799 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qjf5w\" (UniqueName: \"kubernetes.io/projected/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-kube-api-access-qjf5w\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511272 4799 reconciler_common.go:293] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-run-ovn-kubernetes\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511284 4799 reconciler_common.go:293] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-etc-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511298 4799 reconciler_common.go:293] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-kubelet\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511309 4799 reconciler_common.go:293] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511321 4799 reconciler_common.go:293] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-var-lib-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511333 4799 reconciler_common.go:293] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-run-systemd\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.511676 master-0 kubenswrapper[4799]: I1204 00:29:46.511347 4799 reconciler_common.go:293] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca-host-cni-netd\") on node \"master-0\" DevicePath \"\"" Dec 04 00:29:46.571261 master-0 kubenswrapper[4799]: I1204 00:29:46.571142 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:46.571557 master-0 kubenswrapper[4799]: I1204 00:29:46.571166 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:46.571557 master-0 kubenswrapper[4799]: E1204 00:29:46.571368 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:46.571682 master-0 kubenswrapper[4799]: E1204 00:29:46.571553 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612711 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612796 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612874 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612904 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612962 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.612992 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613029 master-0 kubenswrapper[4799]: I1204 00:29:46.613018 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613037 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613095 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613144 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613050 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613178 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613203 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613125 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613112 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613249 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613273 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613299 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613321 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613325 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613395 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613362 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613362 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.613500 master-0 kubenswrapper[4799]: I1204 00:29:46.613449 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613492 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613526 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613553 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613586 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613548 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613590 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613585 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613622 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613619 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613663 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613653 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614047 master-0 kubenswrapper[4799]: I1204 00:29:46.613956 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614366 master-0 kubenswrapper[4799]: I1204 00:29:46.614211 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.614704 master-0 kubenswrapper[4799]: I1204 00:29:46.614662 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.619040 master-0 kubenswrapper[4799]: I1204 00:29:46.618961 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.646319 master-0 kubenswrapper[4799]: I1204 00:29:46.646239 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.749985 master-0 kubenswrapper[4799]: I1204 00:29:46.749864 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:46.771824 master-0 kubenswrapper[4799]: W1204 00:29:46.771751 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cb9838_2d09_46ab_8e2d_08d5868056fc.slice/crio-d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71 WatchSource:0}: Error finding container d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71: Status 404 returned error can't find the container with id d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71 Dec 04 00:29:47.114502 master-0 kubenswrapper[4799]: I1204 00:29:47.114437 4799 generic.go:334] "Generic (PLEG): container finished" podID="68cb9838-2d09-46ab-8e2d-08d5868056fc" containerID="c9521e4b338a729f24968935eb69431972eafc3079f28819c337f948d3e9346b" exitCode=0 Dec 04 00:29:47.116116 master-0 kubenswrapper[4799]: I1204 00:29:47.114565 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerDied","Data":"c9521e4b338a729f24968935eb69431972eafc3079f28819c337f948d3e9346b"} Dec 04 00:29:47.116116 master-0 kubenswrapper[4799]: I1204 00:29:47.114632 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71"} Dec 04 00:29:47.123786 master-0 kubenswrapper[4799]: I1204 00:29:47.120706 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovnkube-controller/0.log" Dec 04 00:29:47.126915 master-0 kubenswrapper[4799]: I1204 00:29:47.126653 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/kube-rbac-proxy-ovn-metrics/0.log" Dec 04 00:29:47.128039 master-0 kubenswrapper[4799]: I1204 00:29:47.127984 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/kube-rbac-proxy-node/0.log" Dec 04 00:29:47.129240 master-0 kubenswrapper[4799]: I1204 00:29:47.129027 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovn-acl-logging/0.log" Dec 04 00:29:47.130012 master-0 kubenswrapper[4799]: I1204 00:29:47.129977 4799 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvv6s_c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/ovn-controller/0.log" Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130640 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" exitCode=1 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130710 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" exitCode=0 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130689 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130779 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130797 4799 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130833 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130732 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" exitCode=0 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130880 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" exitCode=0 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130901 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" exitCode=143 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130810 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130918 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" exitCode=143 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130969 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" exitCode=143 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130991 4799 generic.go:334] "Generic (PLEG): container finished" podID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" exitCode=143 Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.130997 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131024 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131036 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131049 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131140 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131146 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131154 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131163 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131170 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131176 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131182 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131188 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} Dec 04 00:29:47.131139 master-0 kubenswrapper[4799]: I1204 00:29:47.131194 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131200 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131208 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131214 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131222 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131230 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131236 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131243 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131249 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131253 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131258 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131263 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131268 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131273 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131280 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvv6s" event={"ID":"c54d77f2-3f5e-4725-b553-eb4fbe9b68ca","Type":"ContainerDied","Data":"6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131288 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131294 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131299 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131304 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131309 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131363 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131383 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131388 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} Dec 04 00:29:47.132235 master-0 kubenswrapper[4799]: I1204 00:29:47.131393 4799 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} Dec 04 00:29:47.156992 master-0 kubenswrapper[4799]: I1204 00:29:47.156532 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.183414 master-0 kubenswrapper[4799]: I1204 00:29:47.182730 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.190647 master-0 kubenswrapper[4799]: I1204 00:29:47.189679 4799 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xvv6s"] Dec 04 00:29:47.190647 master-0 kubenswrapper[4799]: I1204 00:29:47.190521 4799 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xvv6s"] Dec 04 00:29:47.201280 master-0 kubenswrapper[4799]: I1204 00:29:47.201238 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.214225 master-0 kubenswrapper[4799]: I1204 00:29:47.214176 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.235675 master-0 kubenswrapper[4799]: I1204 00:29:47.235628 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.245563 master-0 kubenswrapper[4799]: I1204 00:29:47.245003 4799 scope.go:117] "RemoveContainer" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.263168 master-0 kubenswrapper[4799]: I1204 00:29:47.260167 4799 scope.go:117] "RemoveContainer" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.284248 master-0 kubenswrapper[4799]: I1204 00:29:47.282466 4799 scope.go:117] "RemoveContainer" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.325595 master-0 kubenswrapper[4799]: I1204 00:29:47.325519 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.326645 master-0 kubenswrapper[4799]: E1204 00:29:47.326577 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.326798 master-0 kubenswrapper[4799]: I1204 00:29:47.326649 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} err="failed to get container status \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" Dec 04 00:29:47.326798 master-0 kubenswrapper[4799]: I1204 00:29:47.326710 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.327332 master-0 kubenswrapper[4799]: E1204 00:29:47.327266 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.327453 master-0 kubenswrapper[4799]: I1204 00:29:47.327318 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} err="failed to get container status \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" Dec 04 00:29:47.327453 master-0 kubenswrapper[4799]: I1204 00:29:47.327356 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.327959 master-0 kubenswrapper[4799]: E1204 00:29:47.327844 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.328064 master-0 kubenswrapper[4799]: I1204 00:29:47.327975 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} err="failed to get container status \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" Dec 04 00:29:47.328064 master-0 kubenswrapper[4799]: I1204 00:29:47.328029 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.328656 master-0 kubenswrapper[4799]: E1204 00:29:47.328568 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.328781 master-0 kubenswrapper[4799]: I1204 00:29:47.328647 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} err="failed to get container status \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" Dec 04 00:29:47.328781 master-0 kubenswrapper[4799]: I1204 00:29:47.328702 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.329354 master-0 kubenswrapper[4799]: E1204 00:29:47.329294 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.329444 master-0 kubenswrapper[4799]: I1204 00:29:47.329347 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} err="failed to get container status \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" Dec 04 00:29:47.329444 master-0 kubenswrapper[4799]: I1204 00:29:47.329378 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.330093 master-0 kubenswrapper[4799]: E1204 00:29:47.330019 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.330207 master-0 kubenswrapper[4799]: I1204 00:29:47.330083 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} err="failed to get container status \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" Dec 04 00:29:47.330207 master-0 kubenswrapper[4799]: I1204 00:29:47.330126 4799 scope.go:117] "RemoveContainer" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.330577 master-0 kubenswrapper[4799]: E1204 00:29:47.330523 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": container with ID starting with 69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd not found: ID does not exist" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.330648 master-0 kubenswrapper[4799]: I1204 00:29:47.330574 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} err="failed to get container status \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": rpc error: code = NotFound desc = could not find container \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": container with ID starting with 69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd not found: ID does not exist" Dec 04 00:29:47.330648 master-0 kubenswrapper[4799]: I1204 00:29:47.330604 4799 scope.go:117] "RemoveContainer" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.331182 master-0 kubenswrapper[4799]: E1204 00:29:47.331115 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": container with ID starting with f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0 not found: ID does not exist" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.331273 master-0 kubenswrapper[4799]: I1204 00:29:47.331192 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} err="failed to get container status \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": rpc error: code = NotFound desc = could not find container \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": container with ID starting with f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0 not found: ID does not exist" Dec 04 00:29:47.331273 master-0 kubenswrapper[4799]: I1204 00:29:47.331240 4799 scope.go:117] "RemoveContainer" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.331740 master-0 kubenswrapper[4799]: E1204 00:29:47.331676 4799 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": container with ID starting with b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8 not found: ID does not exist" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.331847 master-0 kubenswrapper[4799]: I1204 00:29:47.331767 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} err="failed to get container status \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": rpc error: code = NotFound desc = could not find container \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": container with ID starting with b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8 not found: ID does not exist" Dec 04 00:29:47.331847 master-0 kubenswrapper[4799]: I1204 00:29:47.331799 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.332247 master-0 kubenswrapper[4799]: I1204 00:29:47.332183 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} err="failed to get container status \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" Dec 04 00:29:47.332247 master-0 kubenswrapper[4799]: I1204 00:29:47.332240 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.332651 master-0 kubenswrapper[4799]: I1204 00:29:47.332597 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} err="failed to get container status \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" Dec 04 00:29:47.332651 master-0 kubenswrapper[4799]: I1204 00:29:47.332637 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.333239 master-0 kubenswrapper[4799]: I1204 00:29:47.333158 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} err="failed to get container status \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" Dec 04 00:29:47.333239 master-0 kubenswrapper[4799]: I1204 00:29:47.333222 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.333811 master-0 kubenswrapper[4799]: I1204 00:29:47.333747 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} err="failed to get container status \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" Dec 04 00:29:47.333811 master-0 kubenswrapper[4799]: I1204 00:29:47.333799 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.334557 master-0 kubenswrapper[4799]: I1204 00:29:47.334485 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} err="failed to get container status \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" Dec 04 00:29:47.334557 master-0 kubenswrapper[4799]: I1204 00:29:47.334536 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.335103 master-0 kubenswrapper[4799]: I1204 00:29:47.335048 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} err="failed to get container status \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" Dec 04 00:29:47.335103 master-0 kubenswrapper[4799]: I1204 00:29:47.335095 4799 scope.go:117] "RemoveContainer" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.335767 master-0 kubenswrapper[4799]: I1204 00:29:47.335527 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} err="failed to get container status \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": rpc error: code = NotFound desc = could not find container \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": container with ID starting with 69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd not found: ID does not exist" Dec 04 00:29:47.335767 master-0 kubenswrapper[4799]: I1204 00:29:47.335566 4799 scope.go:117] "RemoveContainer" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.336189 master-0 kubenswrapper[4799]: I1204 00:29:47.336120 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} err="failed to get container status \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": rpc error: code = NotFound desc = could not find container \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": container with ID starting with f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0 not found: ID does not exist" Dec 04 00:29:47.336501 master-0 kubenswrapper[4799]: I1204 00:29:47.336171 4799 scope.go:117] "RemoveContainer" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.336738 master-0 kubenswrapper[4799]: I1204 00:29:47.336691 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} err="failed to get container status \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": rpc error: code = NotFound desc = could not find container \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": container with ID starting with b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8 not found: ID does not exist" Dec 04 00:29:47.336826 master-0 kubenswrapper[4799]: I1204 00:29:47.336741 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.337330 master-0 kubenswrapper[4799]: I1204 00:29:47.337265 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} err="failed to get container status \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" Dec 04 00:29:47.337330 master-0 kubenswrapper[4799]: I1204 00:29:47.337321 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.337888 master-0 kubenswrapper[4799]: I1204 00:29:47.337830 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} err="failed to get container status \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" Dec 04 00:29:47.337888 master-0 kubenswrapper[4799]: I1204 00:29:47.337879 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.338503 master-0 kubenswrapper[4799]: I1204 00:29:47.338431 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} err="failed to get container status \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" Dec 04 00:29:47.338503 master-0 kubenswrapper[4799]: I1204 00:29:47.338496 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.339213 master-0 kubenswrapper[4799]: I1204 00:29:47.339150 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} err="failed to get container status \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" Dec 04 00:29:47.339299 master-0 kubenswrapper[4799]: I1204 00:29:47.339210 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.339721 master-0 kubenswrapper[4799]: I1204 00:29:47.339650 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} err="failed to get container status \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" Dec 04 00:29:47.339721 master-0 kubenswrapper[4799]: I1204 00:29:47.339709 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.340272 master-0 kubenswrapper[4799]: I1204 00:29:47.340168 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} err="failed to get container status \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" Dec 04 00:29:47.340396 master-0 kubenswrapper[4799]: I1204 00:29:47.340227 4799 scope.go:117] "RemoveContainer" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.340814 master-0 kubenswrapper[4799]: I1204 00:29:47.340751 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} err="failed to get container status \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": rpc error: code = NotFound desc = could not find container \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": container with ID starting with 69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd not found: ID does not exist" Dec 04 00:29:47.340814 master-0 kubenswrapper[4799]: I1204 00:29:47.340800 4799 scope.go:117] "RemoveContainer" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.341271 master-0 kubenswrapper[4799]: I1204 00:29:47.341211 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} err="failed to get container status \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": rpc error: code = NotFound desc = could not find container \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": container with ID starting with f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0 not found: ID does not exist" Dec 04 00:29:47.341271 master-0 kubenswrapper[4799]: I1204 00:29:47.341254 4799 scope.go:117] "RemoveContainer" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.341758 master-0 kubenswrapper[4799]: I1204 00:29:47.341697 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} err="failed to get container status \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": rpc error: code = NotFound desc = could not find container \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": container with ID starting with b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8 not found: ID does not exist" Dec 04 00:29:47.341758 master-0 kubenswrapper[4799]: I1204 00:29:47.341749 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.342244 master-0 kubenswrapper[4799]: I1204 00:29:47.342193 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} err="failed to get container status \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" Dec 04 00:29:47.342244 master-0 kubenswrapper[4799]: I1204 00:29:47.342233 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.342702 master-0 kubenswrapper[4799]: I1204 00:29:47.342644 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} err="failed to get container status \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" Dec 04 00:29:47.342781 master-0 kubenswrapper[4799]: I1204 00:29:47.342696 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.343200 master-0 kubenswrapper[4799]: I1204 00:29:47.343150 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} err="failed to get container status \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" Dec 04 00:29:47.343200 master-0 kubenswrapper[4799]: I1204 00:29:47.343186 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.343667 master-0 kubenswrapper[4799]: I1204 00:29:47.343610 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} err="failed to get container status \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" Dec 04 00:29:47.343732 master-0 kubenswrapper[4799]: I1204 00:29:47.343659 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.344199 master-0 kubenswrapper[4799]: I1204 00:29:47.344138 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} err="failed to get container status \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" Dec 04 00:29:47.344199 master-0 kubenswrapper[4799]: I1204 00:29:47.344176 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.344731 master-0 kubenswrapper[4799]: I1204 00:29:47.344661 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} err="failed to get container status \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" Dec 04 00:29:47.344731 master-0 kubenswrapper[4799]: I1204 00:29:47.344710 4799 scope.go:117] "RemoveContainer" containerID="69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd" Dec 04 00:29:47.345260 master-0 kubenswrapper[4799]: I1204 00:29:47.345200 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd"} err="failed to get container status \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": rpc error: code = NotFound desc = could not find container \"69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd\": container with ID starting with 69da02d323a58f3af396e60d38abc8f83fa5efc54238fe5afa52921d0424f7bd not found: ID does not exist" Dec 04 00:29:47.345260 master-0 kubenswrapper[4799]: I1204 00:29:47.345239 4799 scope.go:117] "RemoveContainer" containerID="f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0" Dec 04 00:29:47.345771 master-0 kubenswrapper[4799]: I1204 00:29:47.345706 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0"} err="failed to get container status \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": rpc error: code = NotFound desc = could not find container \"f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0\": container with ID starting with f268f58629f7beba87820e9483e6231c4cf7e24c3393b83f75594451f8871eb0 not found: ID does not exist" Dec 04 00:29:47.345771 master-0 kubenswrapper[4799]: I1204 00:29:47.345745 4799 scope.go:117] "RemoveContainer" containerID="b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8" Dec 04 00:29:47.346273 master-0 kubenswrapper[4799]: I1204 00:29:47.346211 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8"} err="failed to get container status \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": rpc error: code = NotFound desc = could not find container \"b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8\": container with ID starting with b4a04db0b8358176b0273fb60c98dd58e68f00c42b556e2a4242210e6c33f1f8 not found: ID does not exist" Dec 04 00:29:47.346273 master-0 kubenswrapper[4799]: I1204 00:29:47.346248 4799 scope.go:117] "RemoveContainer" containerID="400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093" Dec 04 00:29:47.346725 master-0 kubenswrapper[4799]: I1204 00:29:47.346659 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093"} err="failed to get container status \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": rpc error: code = NotFound desc = could not find container \"400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093\": container with ID starting with 400bba325d7c8e7b67d876e39c42a70bd065fdccf9230f17d7dc6c0806ce9093 not found: ID does not exist" Dec 04 00:29:47.346725 master-0 kubenswrapper[4799]: I1204 00:29:47.346707 4799 scope.go:117] "RemoveContainer" containerID="9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df" Dec 04 00:29:47.347236 master-0 kubenswrapper[4799]: I1204 00:29:47.347187 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df"} err="failed to get container status \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": rpc error: code = NotFound desc = could not find container \"9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df\": container with ID starting with 9e2801105b542fd2feea34f74e5fdaccfa121ab7d458c27842c957f17ea4d8df not found: ID does not exist" Dec 04 00:29:47.347236 master-0 kubenswrapper[4799]: I1204 00:29:47.347215 4799 scope.go:117] "RemoveContainer" containerID="24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503" Dec 04 00:29:47.347583 master-0 kubenswrapper[4799]: I1204 00:29:47.347535 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503"} err="failed to get container status \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": rpc error: code = NotFound desc = could not find container \"24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503\": container with ID starting with 24202c25061271652d12fa8483dd80f8b9968cd833df2b2a418c148ceb4ad503 not found: ID does not exist" Dec 04 00:29:47.347583 master-0 kubenswrapper[4799]: I1204 00:29:47.347563 4799 scope.go:117] "RemoveContainer" containerID="7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9" Dec 04 00:29:47.348019 master-0 kubenswrapper[4799]: I1204 00:29:47.347920 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9"} err="failed to get container status \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": rpc error: code = NotFound desc = could not find container \"7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9\": container with ID starting with 7f579296d3318e91e31d014b8d506fca77a217be26facccf19ffb6e807d8fea9 not found: ID does not exist" Dec 04 00:29:47.348019 master-0 kubenswrapper[4799]: I1204 00:29:47.347979 4799 scope.go:117] "RemoveContainer" containerID="6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d" Dec 04 00:29:47.348494 master-0 kubenswrapper[4799]: I1204 00:29:47.348447 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d"} err="failed to get container status \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": rpc error: code = NotFound desc = could not find container \"6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d\": container with ID starting with 6c5f0cd90e92c6b427ef8f37553ac164dd6caee578299ff3aef6440db900f29d not found: ID does not exist" Dec 04 00:29:47.348582 master-0 kubenswrapper[4799]: I1204 00:29:47.348490 4799 scope.go:117] "RemoveContainer" containerID="60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209" Dec 04 00:29:47.349045 master-0 kubenswrapper[4799]: I1204 00:29:47.348994 4799 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209"} err="failed to get container status \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": rpc error: code = NotFound desc = could not find container \"60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209\": container with ID starting with 60fafcb4c539213d951f8f9aad3e8de1b8a3771cc38361d0f80b9c25332b0209 not found: ID does not exist" Dec 04 00:29:47.579457 master-0 kubenswrapper[4799]: I1204 00:29:47.579374 4799 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54d77f2-3f5e-4725-b553-eb4fbe9b68ca" path="/var/lib/kubelet/pods/c54d77f2-3f5e-4725-b553-eb4fbe9b68ca/volumes" Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.142920 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"db50e970d25eee596b04df4df6879a106c527cd83dc2f4f0d1707e6db1a9c62e"} Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.143015 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"93b49fdd7d525fef1f1a42c278ef9cd14eb3e469c98a2d1590dc4801d994b0ef"} Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.143032 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"9ab212f36f155f85d2d091a3f9a56c80b2279c0b758498911f23f9c4b08cc252"} Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.143042 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"67eaa89158bd8981039f406f9b055c599b3c4a0643e1d85da0bf24483baa2cdb"} Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.143052 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"127c19e8b0523c93ccc20df2bc30a2586c85c1ee781159788c04a63ea0d3a516"} Dec 04 00:29:48.143060 master-0 kubenswrapper[4799]: I1204 00:29:48.143061 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"2a323cea55cc2314032155911075ca41966948b5ff15b2c67d9367ff6415a31a"} Dec 04 00:29:48.571541 master-0 kubenswrapper[4799]: I1204 00:29:48.571385 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:48.571895 master-0 kubenswrapper[4799]: I1204 00:29:48.571402 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:48.571895 master-0 kubenswrapper[4799]: E1204 00:29:48.571602 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:48.572176 master-0 kubenswrapper[4799]: E1204 00:29:48.572095 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:48.591474 master-0 kubenswrapper[4799]: I1204 00:29:48.591370 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0"] Dec 04 00:29:49.439642 master-0 kubenswrapper[4799]: I1204 00:29:49.439539 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:29:49.440535 master-0 kubenswrapper[4799]: E1204 00:29:49.439773 4799 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:49.440535 master-0 kubenswrapper[4799]: E1204 00:29:49.439898 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:53.439865375 +0000 UTC m=+194.256485923 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:29:49.564449 master-0 kubenswrapper[4799]: E1204 00:29:49.564337 4799 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 00:29:49.590869 master-0 kubenswrapper[4799]: I1204 00:29:49.590765 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podStartSLOduration=1.590732746 podStartE2EDuration="1.590732746s" podCreationTimestamp="2025-12-04 00:29:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:29:49.588366733 +0000 UTC m=+130.404987281" watchObservedRunningTime="2025-12-04 00:29:49.590732746 +0000 UTC m=+130.407353314" Dec 04 00:29:50.157977 master-0 kubenswrapper[4799]: I1204 00:29:50.157850 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"f7b0dc67459fe85c5df274f7b55a6669e1ed5259473d8be31868ebb077f53662"} Dec 04 00:29:50.571094 master-0 kubenswrapper[4799]: I1204 00:29:50.570912 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:50.571094 master-0 kubenswrapper[4799]: I1204 00:29:50.571060 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:50.572290 master-0 kubenswrapper[4799]: E1204 00:29:50.571199 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:50.572290 master-0 kubenswrapper[4799]: E1204 00:29:50.571327 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:52.371868 master-0 kubenswrapper[4799]: I1204 00:29:52.368422 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:52.371868 master-0 kubenswrapper[4799]: E1204 00:29:52.368602 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 00:29:52.371868 master-0 kubenswrapper[4799]: E1204 00:29:52.368621 4799 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 00:29:52.371868 master-0 kubenswrapper[4799]: E1204 00:29:52.368634 4799 projected.go:194] Error preparing data for projected volume kube-api-access-9kssf for pod openshift-network-diagnostics/network-check-target-w5f2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:52.371868 master-0 kubenswrapper[4799]: E1204 00:29:52.368700 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf podName:060f2a39-e40c-495b-885d-5acd967e6c25 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:24.368682607 +0000 UTC m=+165.185303125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kssf" (UniqueName: "kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf") pod "network-check-target-w5f2j" (UID: "060f2a39-e40c-495b-885d-5acd967e6c25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 00:29:52.571410 master-0 kubenswrapper[4799]: I1204 00:29:52.570990 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:52.571641 master-0 kubenswrapper[4799]: I1204 00:29:52.571052 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:52.571755 master-0 kubenswrapper[4799]: E1204 00:29:52.571538 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:52.571755 master-0 kubenswrapper[4799]: E1204 00:29:52.571721 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:53.178638 master-0 kubenswrapper[4799]: I1204 00:29:53.177071 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" event={"ID":"68cb9838-2d09-46ab-8e2d-08d5868056fc","Type":"ContainerStarted","Data":"25b918d7e0ef146378dc1f73f7792845ddcda1e3dc0f2dff22b4a5248584cf77"} Dec 04 00:29:53.178638 master-0 kubenswrapper[4799]: I1204 00:29:53.177591 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:53.178638 master-0 kubenswrapper[4799]: I1204 00:29:53.177656 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:53.213656 master-0 kubenswrapper[4799]: I1204 00:29:53.212538 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" podStartSLOduration=7.212508651 podStartE2EDuration="7.212508651s" podCreationTimestamp="2025-12-04 00:29:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:29:53.211205131 +0000 UTC m=+134.027825669" watchObservedRunningTime="2025-12-04 00:29:53.212508651 +0000 UTC m=+134.029129199" Dec 04 00:29:53.218321 master-0 kubenswrapper[4799]: I1204 00:29:53.218259 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:53.417907 master-0 kubenswrapper[4799]: I1204 00:29:53.417819 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t85qp"] Dec 04 00:29:53.418342 master-0 kubenswrapper[4799]: I1204 00:29:53.418045 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:53.418342 master-0 kubenswrapper[4799]: E1204 00:29:53.418187 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:53.424907 master-0 kubenswrapper[4799]: I1204 00:29:53.424819 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5f2j"] Dec 04 00:29:53.425095 master-0 kubenswrapper[4799]: I1204 00:29:53.425035 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:53.425204 master-0 kubenswrapper[4799]: E1204 00:29:53.425156 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:54.181637 master-0 kubenswrapper[4799]: I1204 00:29:54.181573 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:54.213032 master-0 kubenswrapper[4799]: I1204 00:29:54.212965 4799 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:29:54.566791 master-0 kubenswrapper[4799]: E1204 00:29:54.566721 4799 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 00:29:55.570711 master-0 kubenswrapper[4799]: I1204 00:29:55.570639 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:55.571467 master-0 kubenswrapper[4799]: I1204 00:29:55.570656 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:55.571467 master-0 kubenswrapper[4799]: E1204 00:29:55.570812 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:55.571467 master-0 kubenswrapper[4799]: E1204 00:29:55.570883 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:57.571522 master-0 kubenswrapper[4799]: I1204 00:29:57.571045 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:57.572428 master-0 kubenswrapper[4799]: I1204 00:29:57.571173 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:57.572428 master-0 kubenswrapper[4799]: E1204 00:29:57.571628 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t85qp" podUID="9a83a76c-050e-4378-ac3a-1213d6d53773" Dec 04 00:29:57.572428 master-0 kubenswrapper[4799]: E1204 00:29:57.571798 4799 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5f2j" podUID="060f2a39-e40c-495b-885d-5acd967e6c25" Dec 04 00:29:59.571623 master-0 kubenswrapper[4799]: I1204 00:29:59.571514 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:29:59.572799 master-0 kubenswrapper[4799]: I1204 00:29:59.571527 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:29:59.575718 master-0 kubenswrapper[4799]: I1204 00:29:59.575627 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 00:29:59.576241 master-0 kubenswrapper[4799]: I1204 00:29:59.575745 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 00:29:59.576241 master-0 kubenswrapper[4799]: I1204 00:29:59.575750 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 00:30:05.358753 master-0 kubenswrapper[4799]: I1204 00:30:05.358640 4799 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeReady" Dec 04 00:30:08.116873 master-0 kubenswrapper[4799]: I1204 00:30:08.116759 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:08.117533 master-0 kubenswrapper[4799]: E1204 00:30:08.117004 4799 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:08.117533 master-0 kubenswrapper[4799]: E1204 00:30:08.117092 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:31:12.117061546 +0000 UTC m=+212.933682064 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:09.035349 master-0 kubenswrapper[4799]: I1204 00:30:09.035047 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p"] Dec 04 00:30:09.035794 master-0 kubenswrapper[4799]: I1204 00:30:09.035741 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.038260 master-0 kubenswrapper[4799]: I1204 00:30:09.038188 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2"] Dec 04 00:30:09.038890 master-0 kubenswrapper[4799]: I1204 00:30:09.038848 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:09.039853 master-0 kubenswrapper[4799]: I1204 00:30:09.039777 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.040017 master-0 kubenswrapper[4799]: I1204 00:30:09.039976 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 00:30:09.040092 master-0 kubenswrapper[4799]: I1204 00:30:09.040007 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn"] Dec 04 00:30:09.040224 master-0 kubenswrapper[4799]: I1204 00:30:09.040182 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 00:30:09.040721 master-0 kubenswrapper[4799]: I1204 00:30:09.040670 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.041994 master-0 kubenswrapper[4799]: I1204 00:30:09.041891 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5"] Dec 04 00:30:09.043122 master-0 kubenswrapper[4799]: I1204 00:30:09.043066 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.043552 master-0 kubenswrapper[4799]: I1204 00:30:09.043486 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx"] Dec 04 00:30:09.044398 master-0 kubenswrapper[4799]: I1204 00:30:09.044349 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.047974 master-0 kubenswrapper[4799]: I1204 00:30:09.047876 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz"] Dec 04 00:30:09.049034 master-0 kubenswrapper[4799]: I1204 00:30:09.048983 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.051304 master-0 kubenswrapper[4799]: I1204 00:30:09.051243 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 00:30:09.051304 master-0 kubenswrapper[4799]: I1204 00:30:09.051291 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 00:30:09.051543 master-0 kubenswrapper[4799]: I1204 00:30:09.051483 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 00:30:09.051668 master-0 kubenswrapper[4799]: I1204 00:30:09.051621 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 00:30:09.051668 master-0 kubenswrapper[4799]: I1204 00:30:09.051645 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 00:30:09.051885 master-0 kubenswrapper[4799]: I1204 00:30:09.051813 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.052247 master-0 kubenswrapper[4799]: I1204 00:30:09.052210 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 00:30:09.052370 master-0 kubenswrapper[4799]: I1204 00:30:09.052339 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.052472 master-0 kubenswrapper[4799]: I1204 00:30:09.052447 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 00:30:09.053144 master-0 kubenswrapper[4799]: I1204 00:30:09.053112 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 00:30:09.053252 master-0 kubenswrapper[4799]: I1204 00:30:09.053228 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 00:30:09.053907 master-0 kubenswrapper[4799]: I1204 00:30:09.053848 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf"] Dec 04 00:30:09.054439 master-0 kubenswrapper[4799]: I1204 00:30:09.054394 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.055307 master-0 kubenswrapper[4799]: I1204 00:30:09.055264 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 00:30:09.055544 master-0 kubenswrapper[4799]: I1204 00:30:09.055504 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 00:30:09.055719 master-0 kubenswrapper[4799]: I1204 00:30:09.055682 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7"] Dec 04 00:30:09.056825 master-0 kubenswrapper[4799]: I1204 00:30:09.056060 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.059770 master-0 kubenswrapper[4799]: I1204 00:30:09.059706 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-operator/ingress-operator-85dbd94574-7clvx"] Dec 04 00:30:09.061646 master-0 kubenswrapper[4799]: I1204 00:30:09.061595 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g"] Dec 04 00:30:09.062362 master-0 kubenswrapper[4799]: I1204 00:30:09.062315 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.068117 master-0 kubenswrapper[4799]: I1204 00:30:09.068059 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.074967 master-0 kubenswrapper[4799]: I1204 00:30:09.074432 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p"] Dec 04 00:30:09.078952 master-0 kubenswrapper[4799]: I1204 00:30:09.075447 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.078952 master-0 kubenswrapper[4799]: I1204 00:30:09.076621 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm"] Dec 04 00:30:09.086876 master-0 kubenswrapper[4799]: I1204 00:30:09.084358 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.099943 master-0 kubenswrapper[4799]: I1204 00:30:09.098113 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 00:30:09.099943 master-0 kubenswrapper[4799]: I1204 00:30:09.098376 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.100613 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf"] Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.101020 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.101369 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.101875 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102021 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102224 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102379 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102539 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102685 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102831 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.102975 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr"] Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.103404 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m"] Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.103700 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.103943 master-0 kubenswrapper[4799]: I1204 00:30:09.103871 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:30:09.104453 master-0 kubenswrapper[4799]: I1204 00:30:09.104086 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.105095 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.105391 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6"] Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.105732 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.105762 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj"] Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.106093 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.107956 master-0 kubenswrapper[4799]: I1204 00:30:09.107559 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r"] Dec 04 00:30:09.108311 master-0 kubenswrapper[4799]: I1204 00:30:09.108215 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.119753 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.119780 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.120045 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.120254 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.120435 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.120644 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.120871 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121327 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121411 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121329 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121632 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs"] Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121790 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:30:09.121949 master-0 kubenswrapper[4799]: I1204 00:30:09.121977 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 00:30:09.122824 master-0 kubenswrapper[4799]: I1204 00:30:09.122128 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:30:09.122824 master-0 kubenswrapper[4799]: I1204 00:30:09.122183 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 00:30:09.122824 master-0 kubenswrapper[4799]: I1204 00:30:09.122293 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.122824 master-0 kubenswrapper[4799]: I1204 00:30:09.122450 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 00:30:09.122945 master-0 kubenswrapper[4799]: I1204 00:30:09.122853 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h"] Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.123144 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.124267 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l"] Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.124547 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.126124 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.126142 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.126429 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.126641 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 00:30:09.126957 master-0 kubenswrapper[4799]: I1204 00:30:09.126833 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 00:30:09.127303 master-0 kubenswrapper[4799]: I1204 00:30:09.127101 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 00:30:09.127303 master-0 kubenswrapper[4799]: I1204 00:30:09.127287 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 00:30:09.127359 master-0 kubenswrapper[4799]: I1204 00:30:09.127201 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127156 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127641 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127711 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127778 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127805 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127871 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127933 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127965 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.128020 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.128045 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127253 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.128177 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.128207 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.127988 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 00:30:09.130945 master-0 kubenswrapper[4799]: I1204 00:30:09.128350 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128411 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128444 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128469 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128532 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128562 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128589 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128639 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128669 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128733 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128777 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128844 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.128952 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.129118 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.131389 master-0 kubenswrapper[4799]: I1204 00:30:09.129145 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129171 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129208 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129230 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129256 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129281 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.129315 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.131738 master-0 kubenswrapper[4799]: I1204 00:30:09.130269 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.135811 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn"] Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.135880 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5"] Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.135904 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx"] Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.140778 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf"] Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.140825 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p"] Dec 04 00:30:09.140949 master-0 kubenswrapper[4799]: I1204 00:30:09.140842 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.144997 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.145049 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.146149 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.146698 4799 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-zm8h9"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.147377 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.148322 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.148747 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.148897 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-85dbd94574-7clvx"] Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.149160 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.150280 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 00:30:09.151954 master-0 kubenswrapper[4799]: I1204 00:30:09.150591 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.153956 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.154342 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.156288 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf"] Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.158019 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz"] Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.159121 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6"] Dec 04 00:30:09.160133 master-0 kubenswrapper[4799]: I1204 00:30:09.160097 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj"] Dec 04 00:30:09.165949 master-0 kubenswrapper[4799]: I1204 00:30:09.162326 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 00:30:09.169943 master-0 kubenswrapper[4799]: I1204 00:30:09.167337 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 00:30:09.169943 master-0 kubenswrapper[4799]: I1204 00:30:09.167541 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.169943 master-0 kubenswrapper[4799]: I1204 00:30:09.168687 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.169943 master-0 kubenswrapper[4799]: I1204 00:30:09.168900 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.170361 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.171403 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.172117 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.172627 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.173113 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.173588 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 00:30:09.177962 master-0 kubenswrapper[4799]: I1204 00:30:09.173983 4799 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 00:30:09.183716 master-0 kubenswrapper[4799]: I1204 00:30:09.182469 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 00:30:09.183985 master-0 kubenswrapper[4799]: I1204 00:30:09.183830 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:30:09.184136 master-0 kubenswrapper[4799]: I1204 00:30:09.184074 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 00:30:09.185801 master-0 kubenswrapper[4799]: I1204 00:30:09.185705 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r"] Dec 04 00:30:09.187652 master-0 kubenswrapper[4799]: I1204 00:30:09.187611 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2"] Dec 04 00:30:09.188164 master-0 kubenswrapper[4799]: I1204 00:30:09.188106 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h"] Dec 04 00:30:09.188917 master-0 kubenswrapper[4799]: I1204 00:30:09.188866 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l"] Dec 04 00:30:09.189593 master-0 kubenswrapper[4799]: I1204 00:30:09.189567 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g"] Dec 04 00:30:09.190326 master-0 kubenswrapper[4799]: I1204 00:30:09.190276 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr"] Dec 04 00:30:09.197947 master-0 kubenswrapper[4799]: I1204 00:30:09.197882 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 00:30:09.198646 master-0 kubenswrapper[4799]: I1204 00:30:09.198617 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 00:30:09.198805 master-0 kubenswrapper[4799]: I1204 00:30:09.198760 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs"] Dec 04 00:30:09.201321 master-0 kubenswrapper[4799]: I1204 00:30:09.201283 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 00:30:09.201617 master-0 kubenswrapper[4799]: I1204 00:30:09.201585 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 00:30:09.203944 master-0 kubenswrapper[4799]: I1204 00:30:09.203911 4799 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229706 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229744 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229769 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229792 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229826 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229844 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229862 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229878 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229897 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229913 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229954 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.229979 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.230003 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.230214 master-0 kubenswrapper[4799]: I1204 00:30:09.230027 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230052 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230084 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230109 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230135 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230158 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230183 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230204 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230224 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230247 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230272 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230289 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230306 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230323 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230339 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.231165 master-0 kubenswrapper[4799]: I1204 00:30:09.230360 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230388 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230407 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230432 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230457 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230479 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230511 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230531 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230547 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230564 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230583 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230604 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230622 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230639 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230670 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.237523 master-0 kubenswrapper[4799]: I1204 00:30:09.230698 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230737 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230760 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230784 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230821 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230846 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230867 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230897 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230921 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230969 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.230996 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.231020 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.231046 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.231075 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.231107 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.238188 master-0 kubenswrapper[4799]: I1204 00:30:09.231194 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231264 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231306 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231309 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231499 4799 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231521 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.731496756 +0000 UTC m=+150.548117274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231556 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.731537757 +0000 UTC m=+150.548158255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231556 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231609 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231612 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231640 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.73163192 +0000 UTC m=+150.548252548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231663 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231691 4799 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231700 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: I1204 00:30:09.231733 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.238779 master-0 kubenswrapper[4799]: E1204 00:30:09.231742 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.731724333 +0000 UTC m=+150.548344901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231760 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231791 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231815 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231834 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231841 4799 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: E1204 00:30:09.231855 4799 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: E1204 00:30:09.231898 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.731884777 +0000 UTC m=+150.548505495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.231942 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.232044 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.232250 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: E1204 00:30:09.232433 4799 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: E1204 00:30:09.232476 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.732464763 +0000 UTC m=+150.549085471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.232749 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.232776 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.239362 master-0 kubenswrapper[4799]: I1204 00:30:09.232840 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.232983 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.233209 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.234126 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.236129 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.236450 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.237059 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.237203 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.250537 master-0 kubenswrapper[4799]: I1204 00:30:09.237995 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.252980 master-0 kubenswrapper[4799]: I1204 00:30:09.252940 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.255785 master-0 kubenswrapper[4799]: I1204 00:30:09.255753 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.257455 master-0 kubenswrapper[4799]: I1204 00:30:09.257281 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.267352 master-0 kubenswrapper[4799]: I1204 00:30:09.267305 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.267858 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.268604 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.269753 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.269655 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.269908 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.270231 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.271975 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.272503 master-0 kubenswrapper[4799]: I1204 00:30:09.272264 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.275333 master-0 kubenswrapper[4799]: I1204 00:30:09.275311 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.276505 master-0 kubenswrapper[4799]: I1204 00:30:09.276460 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.309385 master-0 kubenswrapper[4799]: I1204 00:30:09.309347 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:09.332839 master-0 kubenswrapper[4799]: I1204 00:30:09.332792 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.332962 master-0 kubenswrapper[4799]: I1204 00:30:09.332837 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.332962 master-0 kubenswrapper[4799]: I1204 00:30:09.332878 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.333062 master-0 kubenswrapper[4799]: I1204 00:30:09.332963 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.333062 master-0 kubenswrapper[4799]: I1204 00:30:09.333050 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.333837 master-0 kubenswrapper[4799]: E1204 00:30:09.333795 4799 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:09.333893 master-0 kubenswrapper[4799]: E1204 00:30:09.333840 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:09.333893 master-0 kubenswrapper[4799]: E1204 00:30:09.333870 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.833849877 +0000 UTC m=+150.650470385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:09.333893 master-0 kubenswrapper[4799]: E1204 00:30:09.333885 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.833878878 +0000 UTC m=+150.650499386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:09.334061 master-0 kubenswrapper[4799]: I1204 00:30:09.334021 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.334654 master-0 kubenswrapper[4799]: I1204 00:30:09.334616 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.335079 master-0 kubenswrapper[4799]: I1204 00:30:09.335038 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.335159 master-0 kubenswrapper[4799]: E1204 00:30:09.335139 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:09.335218 master-0 kubenswrapper[4799]: E1204 00:30:09.335205 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.835191375 +0000 UTC m=+150.651811903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:09.336001 master-0 kubenswrapper[4799]: I1204 00:30:09.335892 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.336647 master-0 kubenswrapper[4799]: I1204 00:30:09.336608 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.337434 master-0 kubenswrapper[4799]: I1204 00:30:09.337381 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.337516 master-0 kubenswrapper[4799]: I1204 00:30:09.337444 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.337516 master-0 kubenswrapper[4799]: I1204 00:30:09.337475 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.337592 master-0 kubenswrapper[4799]: I1204 00:30:09.337528 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.337592 master-0 kubenswrapper[4799]: I1204 00:30:09.337565 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.337592 master-0 kubenswrapper[4799]: I1204 00:30:09.337571 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337615 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337651 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337694 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337728 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337770 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337800 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337832 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.337878 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.338286 master-0 kubenswrapper[4799]: I1204 00:30:09.338248 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.339010 master-0 kubenswrapper[4799]: I1204 00:30:09.338968 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.339109 master-0 kubenswrapper[4799]: I1204 00:30:09.339062 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.339607 master-0 kubenswrapper[4799]: I1204 00:30:09.339491 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.339607 master-0 kubenswrapper[4799]: I1204 00:30:09.339559 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339643 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339735 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339809 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339838 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339861 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339909 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339949 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.339976 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340023 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340048 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340076 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340103 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340135 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: E1204 00:30:09.340162 4799 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340495 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.340664 master-0 kubenswrapper[4799]: I1204 00:30:09.340173 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: E1204 00:30:09.340662 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: E1204 00:30:09.340673 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.840458423 +0000 UTC m=+150.657079171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: E1204 00:30:09.340707 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:09.84069147 +0000 UTC m=+150.657311978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.340747 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.340799 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.340836 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.340953 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.341729 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.342234 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.342528 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.342588 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.342643 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.343025 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.343424 master-0 kubenswrapper[4799]: I1204 00:30:09.343167 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.344060 master-0 kubenswrapper[4799]: I1204 00:30:09.343761 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.344549 master-0 kubenswrapper[4799]: I1204 00:30:09.344493 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.344710 master-0 kubenswrapper[4799]: I1204 00:30:09.344661 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.344866 master-0 kubenswrapper[4799]: I1204 00:30:09.344822 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.345340 master-0 kubenswrapper[4799]: I1204 00:30:09.345300 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.348228 master-0 kubenswrapper[4799]: I1204 00:30:09.348173 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.350163 master-0 kubenswrapper[4799]: I1204 00:30:09.350124 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.364136 master-0 kubenswrapper[4799]: I1204 00:30:09.364099 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.364449 master-0 kubenswrapper[4799]: I1204 00:30:09.364394 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.368236 master-0 kubenswrapper[4799]: I1204 00:30:09.368198 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.372064 master-0 kubenswrapper[4799]: I1204 00:30:09.371993 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:09.375627 master-0 kubenswrapper[4799]: I1204 00:30:09.375577 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.394233 master-0 kubenswrapper[4799]: I1204 00:30:09.393639 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.402562 master-0 kubenswrapper[4799]: I1204 00:30:09.402516 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:09.414853 master-0 kubenswrapper[4799]: I1204 00:30:09.414806 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.436099 master-0 kubenswrapper[4799]: I1204 00:30:09.436030 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.454301 master-0 kubenswrapper[4799]: I1204 00:30:09.454222 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.463576 master-0 kubenswrapper[4799]: I1204 00:30:09.463426 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:09.473723 master-0 kubenswrapper[4799]: I1204 00:30:09.473667 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.491465 master-0 kubenswrapper[4799]: I1204 00:30:09.491418 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm"] Dec 04 00:30:09.515457 master-0 kubenswrapper[4799]: I1204 00:30:09.515401 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.516976 master-0 kubenswrapper[4799]: I1204 00:30:09.516953 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:09.520553 master-0 kubenswrapper[4799]: I1204 00:30:09.518184 4799 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.528460 master-0 kubenswrapper[4799]: I1204 00:30:09.526558 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:09.583876 master-0 kubenswrapper[4799]: I1204 00:30:09.583827 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p"] Dec 04 00:30:09.605002 master-0 kubenswrapper[4799]: I1204 00:30:09.604651 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2"] Dec 04 00:30:09.628225 master-0 kubenswrapper[4799]: I1204 00:30:09.618992 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:09.635194 master-0 kubenswrapper[4799]: I1204 00:30:09.635027 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:09.672350 master-0 kubenswrapper[4799]: I1204 00:30:09.663307 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:09.672350 master-0 kubenswrapper[4799]: I1204 00:30:09.668802 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:09.693633 master-0 kubenswrapper[4799]: I1204 00:30:09.691811 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:09.698629 master-0 kubenswrapper[4799]: I1204 00:30:09.698585 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:09.700434 master-0 kubenswrapper[4799]: I1204 00:30:09.700397 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx"] Dec 04 00:30:09.708467 master-0 kubenswrapper[4799]: I1204 00:30:09.708423 4799 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:09.719752 master-0 kubenswrapper[4799]: I1204 00:30:09.719702 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7"] Dec 04 00:30:09.727915 master-0 kubenswrapper[4799]: W1204 00:30:09.725501 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26273240_2261_4564_bb64_1aaf774a921f.slice/crio-f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05 WatchSource:0}: Error finding container f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05: Status 404 returned error can't find the container with id f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05 Dec 04 00:30:09.732744 master-0 kubenswrapper[4799]: W1204 00:30:09.728977 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd7cfb0_df67_4978_adca_9b917d3b5708.slice/crio-947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a WatchSource:0}: Error finding container 947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a: Status 404 returned error can't find the container with id 947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a Dec 04 00:30:09.746269 master-0 kubenswrapper[4799]: I1204 00:30:09.746207 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g"] Dec 04 00:30:09.746465 master-0 kubenswrapper[4799]: I1204 00:30:09.746422 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:09.746508 master-0 kubenswrapper[4799]: I1204 00:30:09.746471 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: I1204 00:30:09.746536 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: I1204 00:30:09.746618 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: I1204 00:30:09.746645 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: E1204 00:30:09.746684 4799 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: E1204 00:30:09.746701 4799 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: I1204 00:30:09.746713 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: E1204 00:30:09.746748 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.746729299 +0000 UTC m=+151.563349807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: E1204 00:30:09.746764 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.74675766 +0000 UTC m=+151.563378168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:09.746792 master-0 kubenswrapper[4799]: E1204 00:30:09.746784 4799 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746851 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746847 4799 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746937 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746960 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.746919374 +0000 UTC m=+151.563539892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746981 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.746972426 +0000 UTC m=+151.563592954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:09.747149 master-0 kubenswrapper[4799]: E1204 00:30:09.746995 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.746988536 +0000 UTC m=+151.563609054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:09.750901 master-0 kubenswrapper[4799]: E1204 00:30:09.750640 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.750614528 +0000 UTC m=+151.567235186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:09.762201 master-0 kubenswrapper[4799]: W1204 00:30:09.758844 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5721ad_a077_439a_9ec0_57d90dfb5c14.slice/crio-6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9 WatchSource:0}: Error finding container 6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9: Status 404 returned error can't find the container with id 6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9 Dec 04 00:30:09.821513 master-0 kubenswrapper[4799]: I1204 00:30:09.820900 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf"] Dec 04 00:30:09.839274 master-0 kubenswrapper[4799]: I1204 00:30:09.838987 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr"] Dec 04 00:30:09.847244 master-0 kubenswrapper[4799]: I1204 00:30:09.847195 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.847364 master-0 kubenswrapper[4799]: I1204 00:30:09.847278 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:09.847364 master-0 kubenswrapper[4799]: I1204 00:30:09.847308 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:09.847364 master-0 kubenswrapper[4799]: I1204 00:30:09.847344 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:09.847512 master-0 kubenswrapper[4799]: I1204 00:30:09.847437 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:09.847589 master-0 kubenswrapper[4799]: E1204 00:30:09.847564 4799 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:09.847634 master-0 kubenswrapper[4799]: E1204 00:30:09.847626 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.847605928 +0000 UTC m=+151.664226436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:09.847690 master-0 kubenswrapper[4799]: E1204 00:30:09.847682 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:09.847728 master-0 kubenswrapper[4799]: E1204 00:30:09.847709 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.847700541 +0000 UTC m=+151.664321049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:09.847801 master-0 kubenswrapper[4799]: E1204 00:30:09.847753 4799 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:09.847895 master-0 kubenswrapper[4799]: E1204 00:30:09.847810 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.847800774 +0000 UTC m=+151.664421282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:09.847895 master-0 kubenswrapper[4799]: E1204 00:30:09.847862 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:09.847895 master-0 kubenswrapper[4799]: E1204 00:30:09.847891 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.847882826 +0000 UTC m=+151.664503334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:09.848064 master-0 kubenswrapper[4799]: E1204 00:30:09.847957 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:09.848064 master-0 kubenswrapper[4799]: E1204 00:30:09.847987 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:10.847979519 +0000 UTC m=+151.664600027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:09.896815 master-0 kubenswrapper[4799]: I1204 00:30:09.894599 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj"] Dec 04 00:30:09.936797 master-0 kubenswrapper[4799]: I1204 00:30:09.936738 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6"] Dec 04 00:30:09.945979 master-0 kubenswrapper[4799]: E1204 00:30:09.944579 4799 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd621016_f4f2_4839_aae0_a804e6023423.slice/crio-360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b\": RecentStats: unable to find data in memory cache]" Dec 04 00:30:09.954875 master-0 kubenswrapper[4799]: I1204 00:30:09.954834 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l"] Dec 04 00:30:09.979350 master-0 kubenswrapper[4799]: I1204 00:30:09.979304 4799 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h"] Dec 04 00:30:09.989726 master-0 kubenswrapper[4799]: W1204 00:30:09.989668 4799 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e901355_2d0f_46f9_9d64_c4bc900b1839.slice/crio-5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab WatchSource:0}: Error finding container 5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab: Status 404 returned error can't find the container with id 5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab Dec 04 00:30:10.237149 master-0 kubenswrapper[4799]: I1204 00:30:10.237088 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerStarted","Data":"76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049"} Dec 04 00:30:10.239017 master-0 kubenswrapper[4799]: I1204 00:30:10.238912 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" event={"ID":"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a","Type":"ContainerStarted","Data":"fd3589300b36ad6c047594904bec153361e0713f63741a4acf7e0ce1f226f895"} Dec 04 00:30:10.239017 master-0 kubenswrapper[4799]: I1204 00:30:10.238994 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" event={"ID":"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a","Type":"ContainerStarted","Data":"257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e"} Dec 04 00:30:10.240379 master-0 kubenswrapper[4799]: I1204 00:30:10.240342 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" event={"ID":"285a1e74-1d8e-452e-a5a4-484afc10e10f","Type":"ContainerStarted","Data":"3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a"} Dec 04 00:30:10.241146 master-0 kubenswrapper[4799]: I1204 00:30:10.241067 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" event={"ID":"ca8eddb5-4600-4058-94d2-5d0308c32613","Type":"ContainerStarted","Data":"dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee"} Dec 04 00:30:10.242056 master-0 kubenswrapper[4799]: I1204 00:30:10.242011 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm8h9" event={"ID":"edd7cfb0-df67-4978-adca-9b917d3b5708","Type":"ContainerStarted","Data":"947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a"} Dec 04 00:30:10.243231 master-0 kubenswrapper[4799]: I1204 00:30:10.243198 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerStarted","Data":"3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad"} Dec 04 00:30:10.244304 master-0 kubenswrapper[4799]: I1204 00:30:10.244264 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerStarted","Data":"b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951"} Dec 04 00:30:10.245592 master-0 kubenswrapper[4799]: I1204 00:30:10.245552 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" event={"ID":"04f4782e-b152-41c0-870a-08936498d1af","Type":"ContainerStarted","Data":"6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a"} Dec 04 00:30:10.246571 master-0 kubenswrapper[4799]: I1204 00:30:10.246525 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerStarted","Data":"6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9"} Dec 04 00:30:10.247595 master-0 kubenswrapper[4799]: I1204 00:30:10.247556 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerStarted","Data":"4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203"} Dec 04 00:30:10.250142 master-0 kubenswrapper[4799]: I1204 00:30:10.250097 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerStarted","Data":"5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab"} Dec 04 00:30:10.251449 master-0 kubenswrapper[4799]: I1204 00:30:10.251421 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerStarted","Data":"360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b"} Dec 04 00:30:10.252530 master-0 kubenswrapper[4799]: I1204 00:30:10.252487 4799 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" event={"ID":"26273240-2261-4564-bb64-1aaf774a921f","Type":"ContainerStarted","Data":"f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05"} Dec 04 00:30:10.489000 master-0 kubenswrapper[4799]: I1204 00:30:10.488567 4799 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" podStartSLOduration=106.48854551 podStartE2EDuration="1m46.48854551s" podCreationTimestamp="2025-12-04 00:28:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:10.487574983 +0000 UTC m=+151.304195491" watchObservedRunningTime="2025-12-04 00:30:10.48854551 +0000 UTC m=+151.305166018" Dec 04 00:30:10.758855 master-0 kubenswrapper[4799]: I1204 00:30:10.758724 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:10.758855 master-0 kubenswrapper[4799]: I1204 00:30:10.758812 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: I1204 00:30:10.758895 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: I1204 00:30:10.758984 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: I1204 00:30:10.759014 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: E1204 00:30:10.759026 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: I1204 00:30:10.759064 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: E1204 00:30:10.759139 4799 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: E1204 00:30:10.759169 4799 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:10.759220 master-0 kubenswrapper[4799]: E1204 00:30:10.759179 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.759143048 +0000 UTC m=+153.575763556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:10.759456 master-0 kubenswrapper[4799]: E1204 00:30:10.759224 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:10.759456 master-0 kubenswrapper[4799]: E1204 00:30:10.759318 4799 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:10.759456 master-0 kubenswrapper[4799]: E1204 00:30:10.759230 4799 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:10.759554 master-0 kubenswrapper[4799]: E1204 00:30:10.759243 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.7592214 +0000 UTC m=+153.575841908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:10.759554 master-0 kubenswrapper[4799]: E1204 00:30:10.759517 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.759507628 +0000 UTC m=+153.576128136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:10.759554 master-0 kubenswrapper[4799]: E1204 00:30:10.759533 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.759525938 +0000 UTC m=+153.576146446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:10.759554 master-0 kubenswrapper[4799]: E1204 00:30:10.759547 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.759540549 +0000 UTC m=+153.576161057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:10.759693 master-0 kubenswrapper[4799]: E1204 00:30:10.759559 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.759554089 +0000 UTC m=+153.576174597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:10.860071 master-0 kubenswrapper[4799]: I1204 00:30:10.860006 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:10.860071 master-0 kubenswrapper[4799]: I1204 00:30:10.860076 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:10.860339 master-0 kubenswrapper[4799]: I1204 00:30:10.860141 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:10.860339 master-0 kubenswrapper[4799]: I1204 00:30:10.860168 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:10.860339 master-0 kubenswrapper[4799]: I1204 00:30:10.860203 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:10.860339 master-0 kubenswrapper[4799]: E1204 00:30:10.860247 4799 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860349 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.860321016 +0000 UTC m=+153.676941524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860384 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860387 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860447 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.860429109 +0000 UTC m=+153.677049817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860453 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860491 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.86046623 +0000 UTC m=+153.677086938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860466 4799 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:10.860549 master-0 kubenswrapper[4799]: E1204 00:30:10.860544 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.860533432 +0000 UTC m=+153.677154160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:10.860778 master-0 kubenswrapper[4799]: E1204 00:30:10.860579 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:12.860550692 +0000 UTC m=+153.677171190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783296 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783395 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783452 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783483 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783507 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: I1204 00:30:12.783551 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783547 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783620 4799 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783654 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.783628676 +0000 UTC m=+157.600249184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783703 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.783678337 +0000 UTC m=+157.600298835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783749 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783766 4799 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783773 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.78376629 +0000 UTC m=+157.600386798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783837 4799 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783562 4799 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:12.783959 master-0 kubenswrapper[4799]: E1204 00:30:12.783874 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.783845982 +0000 UTC m=+157.600466670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:12.785270 master-0 kubenswrapper[4799]: E1204 00:30:12.783894 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.783884403 +0000 UTC m=+157.600505171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:12.785270 master-0 kubenswrapper[4799]: E1204 00:30:12.783912 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.783905394 +0000 UTC m=+157.600526162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:12.884981 master-0 kubenswrapper[4799]: I1204 00:30:12.884895 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:12.884981 master-0 kubenswrapper[4799]: I1204 00:30:12.884967 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: I1204 00:30:12.885008 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: I1204 00:30:12.885033 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: I1204 00:30:12.885059 4799 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: E1204 00:30:12.885168 4799 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: E1204 00:30:12.885218 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: E1204 00:30:12.885254 4799 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:12.885277 master-0 kubenswrapper[4799]: E1204 00:30:12.885268 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.885243536 +0000 UTC m=+157.701864054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885218 4799 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885306 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.885286327 +0000 UTC m=+157.701906835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885351 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.885339839 +0000 UTC m=+157.701960347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885352 4799 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885361 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.885355899 +0000 UTC m=+157.701976407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:12.885661 master-0 kubenswrapper[4799]: E1204 00:30:12.885376 4799 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:16.88536879 +0000 UTC m=+157.701989298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:16.563208 master-0 systemd[1]: Stopping Kubernetes Kubelet... Dec 04 00:30:16.587141 master-0 systemd[1]: kubelet.service: Deactivated successfully. Dec 04 00:30:16.587733 master-0 systemd[1]: Stopped Kubernetes Kubelet. Dec 04 00:30:16.593109 master-0 systemd[1]: kubelet.service: Consumed 11.171s CPU time. Dec 04 00:30:16.613910 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 00:30:16.709703 master-0 kubenswrapper[8678]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:30:16.711186 master-0 kubenswrapper[8678]: I1204 00:30:16.709796 8678 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.717984 8678 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718013 8678 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718018 8678 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718021 8678 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718026 8678 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718030 8678 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718034 8678 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:30:16.718026 master-0 kubenswrapper[8678]: W1204 00:30:16.718038 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718043 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718047 8678 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718052 8678 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718100 8678 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718106 8678 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718111 8678 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718116 8678 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718120 8678 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718127 8678 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718135 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718141 8678 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718146 8678 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718150 8678 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718155 8678 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718159 8678 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718163 8678 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718168 8678 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718173 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:30:16.718313 master-0 kubenswrapper[8678]: W1204 00:30:16.718223 8678 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718229 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718234 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718238 8678 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718243 8678 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718249 8678 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718254 8678 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718271 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718276 8678 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718280 8678 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718285 8678 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718290 8678 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718294 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718300 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718304 8678 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718309 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718317 8678 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718323 8678 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718330 8678 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718336 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:30:16.719049 master-0 kubenswrapper[8678]: W1204 00:30:16.718344 8678 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718350 8678 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718356 8678 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718360 8678 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718366 8678 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718428 8678 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718433 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718438 8678 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718442 8678 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718446 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718450 8678 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718453 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718457 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718460 8678 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718464 8678 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718468 8678 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718471 8678 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718475 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718480 8678 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718483 8678 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:30:16.719672 master-0 kubenswrapper[8678]: W1204 00:30:16.718487 8678 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: W1204 00:30:16.718491 8678 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: W1204 00:30:16.718494 8678 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: W1204 00:30:16.718539 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: W1204 00:30:16.718544 8678 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: W1204 00:30:16.718549 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718674 8678 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718732 8678 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718748 8678 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718756 8678 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718763 8678 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718769 8678 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718778 8678 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718786 8678 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718792 8678 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718797 8678 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718804 8678 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718809 8678 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718815 8678 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718820 8678 flags.go:64] FLAG: --cgroup-root="" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718825 8678 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718831 8678 flags.go:64] FLAG: --client-ca-file="" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718836 8678 flags.go:64] FLAG: --cloud-config="" Dec 04 00:30:16.720314 master-0 kubenswrapper[8678]: I1204 00:30:16.718885 8678 flags.go:64] FLAG: --cloud-provider="" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718892 8678 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718899 8678 flags.go:64] FLAG: --cluster-domain="" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718904 8678 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718910 8678 flags.go:64] FLAG: --config-dir="" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718916 8678 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718934 8678 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718943 8678 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718949 8678 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718955 8678 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718961 8678 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718969 8678 flags.go:64] FLAG: --contention-profiling="false" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718974 8678 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.718994 8678 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719002 8678 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719008 8678 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719059 8678 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719066 8678 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719072 8678 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719077 8678 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719083 8678 flags.go:64] FLAG: --enable-server="true" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719089 8678 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719098 8678 flags.go:64] FLAG: --event-burst="100" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719105 8678 flags.go:64] FLAG: --event-qps="50" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719110 8678 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 00:30:16.721035 master-0 kubenswrapper[8678]: I1204 00:30:16.719115 8678 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719121 8678 flags.go:64] FLAG: --eviction-hard="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719128 8678 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719133 8678 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719179 8678 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719184 8678 flags.go:64] FLAG: --eviction-soft="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719190 8678 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719232 8678 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719238 8678 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719243 8678 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719249 8678 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719254 8678 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719260 8678 flags.go:64] FLAG: --feature-gates="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719267 8678 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719273 8678 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719278 8678 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719284 8678 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719290 8678 flags.go:64] FLAG: --healthz-port="10248" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719295 8678 flags.go:64] FLAG: --help="false" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719300 8678 flags.go:64] FLAG: --hostname-override="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719306 8678 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719313 8678 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719318 8678 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719323 8678 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719328 8678 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 00:30:16.721753 master-0 kubenswrapper[8678]: I1204 00:30:16.719334 8678 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719338 8678 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719342 8678 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719387 8678 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719392 8678 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719398 8678 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719403 8678 flags.go:64] FLAG: --kube-reserved="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719408 8678 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719413 8678 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719418 8678 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719423 8678 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719428 8678 flags.go:64] FLAG: --lock-file="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719433 8678 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719439 8678 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719444 8678 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719456 8678 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719461 8678 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719467 8678 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719472 8678 flags.go:64] FLAG: --logging-format="text" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719477 8678 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719483 8678 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719488 8678 flags.go:64] FLAG: --manifest-url="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719493 8678 flags.go:64] FLAG: --manifest-url-header="" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719500 8678 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719506 8678 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 00:30:16.722590 master-0 kubenswrapper[8678]: I1204 00:30:16.719513 8678 flags.go:64] FLAG: --max-pods="110" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719518 8678 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719523 8678 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719529 8678 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719534 8678 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719540 8678 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719545 8678 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719551 8678 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719614 8678 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719620 8678 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719626 8678 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719631 8678 flags.go:64] FLAG: --pod-cidr="" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719637 8678 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fff930cf757e23d388d86d05942b76e44d3bda5e387b299c239e4d12545d26dd" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719645 8678 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719650 8678 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719656 8678 flags.go:64] FLAG: --pods-per-core="0" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719661 8678 flags.go:64] FLAG: --port="10250" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719667 8678 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719672 8678 flags.go:64] FLAG: --provider-id="" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719679 8678 flags.go:64] FLAG: --qos-reserved="" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719684 8678 flags.go:64] FLAG: --read-only-port="10255" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719691 8678 flags.go:64] FLAG: --register-node="true" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719697 8678 flags.go:64] FLAG: --register-schedulable="true" Dec 04 00:30:16.723295 master-0 kubenswrapper[8678]: I1204 00:30:16.719703 8678 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719716 8678 flags.go:64] FLAG: --registry-burst="10" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719722 8678 flags.go:64] FLAG: --registry-qps="5" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719728 8678 flags.go:64] FLAG: --reserved-cpus="" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719778 8678 flags.go:64] FLAG: --reserved-memory="" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719786 8678 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719792 8678 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719798 8678 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719804 8678 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719809 8678 flags.go:64] FLAG: --runonce="false" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719814 8678 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719821 8678 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719827 8678 flags.go:64] FLAG: --seccomp-default="false" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719833 8678 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719838 8678 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719844 8678 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719850 8678 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719856 8678 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719861 8678 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719867 8678 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719916 8678 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719934 8678 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719941 8678 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719947 8678 flags.go:64] FLAG: --system-cgroups="" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719953 8678 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 00:30:16.724004 master-0 kubenswrapper[8678]: I1204 00:30:16.719962 8678 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719968 8678 flags.go:64] FLAG: --tls-cert-file="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719974 8678 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719981 8678 flags.go:64] FLAG: --tls-min-version="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719986 8678 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719992 8678 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.719998 8678 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720004 8678 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720009 8678 flags.go:64] FLAG: --v="2" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720017 8678 flags.go:64] FLAG: --version="false" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720024 8678 flags.go:64] FLAG: --vmodule="" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720031 8678 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: I1204 00:30:16.720037 8678 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720256 8678 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720266 8678 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720272 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720277 8678 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720282 8678 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720287 8678 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720293 8678 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720298 8678 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720303 8678 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:30:16.724781 master-0 kubenswrapper[8678]: W1204 00:30:16.720308 8678 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720312 8678 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720317 8678 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720322 8678 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720327 8678 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720332 8678 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720345 8678 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720350 8678 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720355 8678 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720359 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720364 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720368 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720373 8678 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720377 8678 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720382 8678 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720387 8678 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720391 8678 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720395 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720400 8678 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720404 8678 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:30:16.725520 master-0 kubenswrapper[8678]: W1204 00:30:16.720408 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720456 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720461 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720465 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720471 8678 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720476 8678 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720480 8678 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720485 8678 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720504 8678 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720508 8678 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720512 8678 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720516 8678 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720521 8678 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720525 8678 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720573 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720580 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720584 8678 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720589 8678 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720597 8678 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720601 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:30:16.726144 master-0 kubenswrapper[8678]: W1204 00:30:16.720606 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720610 8678 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720615 8678 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720619 8678 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720624 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720628 8678 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720632 8678 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720637 8678 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720642 8678 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720648 8678 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720653 8678 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720658 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720662 8678 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720667 8678 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720671 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720716 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720729 8678 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720733 8678 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720737 8678 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:30:16.726755 master-0 kubenswrapper[8678]: W1204 00:30:16.720743 8678 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:30:16.727258 master-0 kubenswrapper[8678]: W1204 00:30:16.720749 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:30:16.727258 master-0 kubenswrapper[8678]: W1204 00:30:16.720754 8678 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:30:16.727258 master-0 kubenswrapper[8678]: W1204 00:30:16.720759 8678 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:30:16.727258 master-0 kubenswrapper[8678]: I1204 00:30:16.720777 8678 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:30:16.728587 master-0 kubenswrapper[8678]: I1204 00:30:16.728544 8678 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 00:30:16.728587 master-0 kubenswrapper[8678]: I1204 00:30:16.728573 8678 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 00:30:16.728662 master-0 kubenswrapper[8678]: W1204 00:30:16.728651 8678 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:30:16.728662 master-0 kubenswrapper[8678]: W1204 00:30:16.728659 8678 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728665 8678 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728670 8678 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728674 8678 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728679 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728683 8678 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728687 8678 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728691 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728695 8678 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728699 8678 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728703 8678 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728707 8678 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728711 8678 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728714 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728718 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728722 8678 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728726 8678 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728730 8678 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728735 8678 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:30:16.728716 master-0 kubenswrapper[8678]: W1204 00:30:16.728739 8678 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728743 8678 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728748 8678 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728752 8678 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728757 8678 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728762 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728766 8678 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728770 8678 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728774 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728779 8678 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728783 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728787 8678 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728792 8678 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728796 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728801 8678 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728807 8678 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728811 8678 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728816 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728822 8678 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728827 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:30:16.729280 master-0 kubenswrapper[8678]: W1204 00:30:16.728833 8678 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728839 8678 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728845 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728850 8678 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728856 8678 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728861 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728865 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728869 8678 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728873 8678 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728877 8678 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728880 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728884 8678 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728890 8678 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728894 8678 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728897 8678 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728901 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728905 8678 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728908 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728912 8678 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728915 8678 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:30:16.729791 master-0 kubenswrapper[8678]: W1204 00:30:16.728919 8678 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728940 8678 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728944 8678 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728949 8678 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728953 8678 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728961 8678 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728966 8678 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728970 8678 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728975 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728980 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728985 8678 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.728990 8678 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: I1204 00:30:16.728997 8678 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.729127 8678 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.729135 8678 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:30:16.730416 master-0 kubenswrapper[8678]: W1204 00:30:16.729140 8678 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729146 8678 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729151 8678 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729156 8678 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729161 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729165 8678 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729171 8678 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729177 8678 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729184 8678 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729190 8678 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729196 8678 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729201 8678 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729206 8678 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729211 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729216 8678 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729221 8678 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729227 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729231 8678 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729236 8678 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:30:16.730786 master-0 kubenswrapper[8678]: W1204 00:30:16.729240 8678 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729246 8678 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729251 8678 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729255 8678 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729259 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729263 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729267 8678 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729272 8678 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729276 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729280 8678 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729284 8678 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729288 8678 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729292 8678 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729297 8678 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729301 8678 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729306 8678 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729311 8678 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729315 8678 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729321 8678 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:30:16.731402 master-0 kubenswrapper[8678]: W1204 00:30:16.729327 8678 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729332 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729337 8678 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729344 8678 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729350 8678 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729356 8678 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729362 8678 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729367 8678 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729373 8678 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729378 8678 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729383 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729388 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729392 8678 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729398 8678 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729402 8678 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729407 8678 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729412 8678 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729416 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729421 8678 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729426 8678 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:30:16.731947 master-0 kubenswrapper[8678]: W1204 00:30:16.729431 8678 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729436 8678 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729441 8678 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729446 8678 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729457 8678 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729462 8678 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729467 8678 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729472 8678 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729477 8678 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729482 8678 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729488 8678 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: W1204 00:30:16.729496 8678 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: I1204 00:30:16.729504 8678 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: I1204 00:30:16.729706 8678 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 00:30:16.732510 master-0 kubenswrapper[8678]: I1204 00:30:16.732110 8678 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Dec 04 00:30:16.732848 master-0 kubenswrapper[8678]: I1204 00:30:16.732263 8678 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Dec 04 00:30:16.732848 master-0 kubenswrapper[8678]: I1204 00:30:16.732552 8678 server.go:997] "Starting client certificate rotation" Dec 04 00:30:16.732848 master-0 kubenswrapper[8678]: I1204 00:30:16.732563 8678 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 00:30:16.733048 master-0 kubenswrapper[8678]: I1204 00:30:16.732793 8678 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 18:09:00.883597857 +0000 UTC Dec 04 00:30:16.733085 master-0 kubenswrapper[8678]: I1204 00:30:16.733071 8678 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 17h38m44.150533449s for next certificate rotation Dec 04 00:30:16.735242 master-0 kubenswrapper[8678]: I1204 00:30:16.735211 8678 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:30:16.736968 master-0 kubenswrapper[8678]: I1204 00:30:16.736892 8678 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:30:16.746159 master-0 kubenswrapper[8678]: I1204 00:30:16.746107 8678 log.go:25] "Validated CRI v1 runtime API" Dec 04 00:30:16.759000 master-0 kubenswrapper[8678]: I1204 00:30:16.758955 8678 log.go:25] "Validated CRI v1 image API" Dec 04 00:30:16.760464 master-0 kubenswrapper[8678]: I1204 00:30:16.760385 8678 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 00:30:16.764504 master-0 kubenswrapper[8678]: I1204 00:30:16.764470 8678 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4 b7c19a61-c15a-446d-937b-5d5c941bb8bc:/dev/vda3] Dec 04 00:30:16.764992 master-0 kubenswrapper[8678]: I1204 00:30:16.764501 8678 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm major:0 minor:305 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm major:0 minor:351 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm major:0 minor:337 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/635bc81a309df7832d537de83efd770b2125edb6f2daccb7afe434b4d90fe5b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/635bc81a309df7832d537de83efd770b2125edb6f2daccb7afe434b4d90fe5b6/userdata/shm major:0 minor:58 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51/userdata/shm major:0 minor:41 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm major:0 minor:160 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm major:0 minor:128 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm major:0 minor:345 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm major:0 minor:143 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm major:0 minor:179 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe/userdata/shm major:0 minor:46 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84/userdata/shm major:0 minor:50 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm major:0 minor:176 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm major:0 minor:132 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md:{mountpoint:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9:{mountpoint:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9 major:0 minor:175 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert major:0 minor:174 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq:{mountpoint:/var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c:{mountpoint:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c major:0 minor:157 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert major:0 minor:156 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf:{mountpoint:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf:{mountpoint:/var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf major:0 minor:142 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk:{mountpoint:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps:{mountpoint:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2:{mountpoint:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2 major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:24 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr major:0 minor:178 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:168 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/89be8775-ded0-4680-ae6f-3c60575ad4b8/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/89be8775-ded0-4680-ae6f-3c60575ad4b8/volumes/kubernetes.io~projected/kube-api-access major:0 minor:127 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2:{mountpoint:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd:{mountpoint:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd major:0 minor:153 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq:{mountpoint:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc:{mountpoint:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc major:0 minor:126 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls major:0 minor:124 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn:{mountpoint:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b57073bf-c556-4ac2-a0a5-522e4360d493/volumes/kubernetes.io~projected/kube-api-access-69lk7:{mountpoint:/var/lib/kubelet/pods/b57073bf-c556-4ac2-a0a5-522e4360d493/volumes/kubernetes.io~projected/kube-api-access-69lk7 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl:{mountpoint:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg:{mountpoint:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr:{mountpoint:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq:{mountpoint:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp:{mountpoint:/var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp major:0 minor:125 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm:{mountpoint:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p:{mountpoint:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m:{mountpoint:/var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m:{mountpoint:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq:{mountpoint:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:289 fsType:tmpfs blockSize:0} overlay_0-112:{mountpoint:/var/lib/containers/storage/overlay/d7fa22ddfdc1b790bfcf782c36d5f8bff428d00bb5e1ac3cc13cb622471824e6/merged major:0 minor:112 fsType:overlay blockSize:0} overlay_0-120:{mountpoint:/var/lib/containers/storage/overlay/38ca7b7ac6db2dfb5d5c9fd1efee25ea9c89870a8d40b05c2a59733d92a3b494/merged major:0 minor:120 fsType:overlay blockSize:0} overlay_0-130:{mountpoint:/var/lib/containers/storage/overlay/b92bfb81a8d279c699176863d47600946534a2cfd6a5a0f94c1cfb9d5bb8bfdf/merged major:0 minor:130 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2494831df530bd6d51346448ef08bfa7a1e735b9c5556c4f5d784c16c5c3af08/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/1a7a1848bc7f5a9b01ccbf4a4b958d0bea769711af3956ab6d1c5e42771a0202/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/496cf9c2d8a222bda00cb47b6f2a24a5b4bad2cc3fe01ac85cadb0ba5c8474a0/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/0f52c34a648612bcf49fb7c7a2891bee82cc8280a022ac3c1102df56762b2650/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-145:{mountpoint:/var/lib/containers/storage/overlay/7cae7dd4c9cedda4929bc8bd9564536adc2343bbe4f54a6848552323b79ad451/merged major:0 minor:145 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/98115827c0c5aa59d8ce3941f59b79ffdcfb7b2f7ecff3e7b7b5a227d3cba149/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-158:{mountpoint:/var/lib/containers/storage/overlay/34cf6f7471a9d703712b7fdf7f12ed7feb153e9806f4386fb79fad6fdd1dc57f/merged major:0 minor:158 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8b2f7e32212b2d0edec9387c7c5eb460875498c99614397b7e4a39c68e9423b7/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/97b58d2040f141a6504dfec0a41719a34bba4ca5012db019fcbac655cb32f253/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/4e0258771668381317191545a0d7adaf55468fb34ccbd54120405736527f8839/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/b863dffb08a620601c0a96a84ab122c3e0c415002328b17b16ccb0455b885478/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-181:{mountpoint:/var/lib/containers/storage/overlay/c480ad07b14accba0b24af36c37b0c165c6b8ead33a7377d6abd43ff0d7fa705/merged major:0 minor:181 fsType:overlay blockSize:0} overlay_0-189:{mountpoint:/var/lib/containers/storage/overlay/8aaf9aae64ebd576adde6844b10559999f3c99671fdfb8eb278b8be5f8c8f372/merged major:0 minor:189 fsType:overlay blockSize:0} overlay_0-191:{mountpoint:/var/lib/containers/storage/overlay/7bde766ed52b565191b425051cb40825e0ebdc685b96d99c9329b155b9dd054c/merged major:0 minor:191 fsType:overlay blockSize:0} overlay_0-193:{mountpoint:/var/lib/containers/storage/overlay/a1d12eb1450248806fc6d2226f1d95339f42785d8c9759b9f7997067841eac58/merged major:0 minor:193 fsType:overlay blockSize:0} overlay_0-195:{mountpoint:/var/lib/containers/storage/overlay/ff8fc2b62453e95199dc5897af1b70b3c546394282b2c547ec38ac977122097d/merged major:0 minor:195 fsType:overlay blockSize:0} overlay_0-199:{mountpoint:/var/lib/containers/storage/overlay/ef26eafd57a4553efa9ca26ef1513cad8b48a8ff172ef073f83d58dc303914b4/merged major:0 minor:199 fsType:overlay blockSize:0} overlay_0-210:{mountpoint:/var/lib/containers/storage/overlay/cee4ffb6f8e01a5ebd8969539977cadf07a066443703ce82e8e01da0a64e1709/merged major:0 minor:210 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/814db187119cdbc58b74ca7737f03c663d1ea2f264fbd07a655808a1dfc620a1/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/db8f318ac49b5c86f97709939fed045e446ed03c902b1df9d1fca89a348891f7/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/ca41322bc95b1ea83116da75ab31bbad7b80796b633b3581ac5ef63c255c725a/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/f9614dbf45fce1fbd3be52a2fafa2aff587601e437f3aa66c078f5226a0394af/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/96aa2c9e3e2073d12befeb4f0cc4f5d36c30dec85b65fde54ae804d09ee72383/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/58ca04b53d95cf4432b59b7417fa3ba0edc92084674af0c19c5a4224dc1bb5d1/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/d24efa17d1560497383e7580a08cb890a376e46c630794c78e228f2b1508a7b2/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/1bde17dc99822b363880a528667d7e58e5bdfc1b0f7dcf14e769f84604c82568/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/7f49045c5c1696bacb7dcea03e543dfd0148db156bd4194e8680c768e6e7489b/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/b6902602c58635345afa001000cfebc0161b90cef6d693032232500101a6e291/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/c95cf22a88650facd96bd1c821db13e71042fad6f07b1458481a1535d640284f/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/8b397ff5f10175fcff7a8014f574e1817fed53a9b1049ddbafaf1f8fa254d17c/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/0f685ed7fe8c5137d7b32391574902cc7889da45bffd9c525ee9ed7496d5afce/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/7594a4be2d14ee40680ec7cd367d89771b3ada3ebc521b547d8aafd73b84aa9b/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/68f9549c7ff0dd7a4431f95da1b923520470cc3d646bda455f9ccccd5d50164e/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/533000ce873b0c1e0c9611075dcfa494f70ff70f7a371516814ebff16083a53d/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/4be00e8db3a77d279c2caa717dd179fe892db075691fba620d6e4cdf3c632747/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/39fe76330c8a13f143bd2346727047afaa5efd33fbd8e41ccdd5198d4b755d28/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/1c48168ff9211069d7f572a7fab385c12934e01b71c00263fbd82687cf7d7251/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/6af428c2e90a829e89e31626152fe1c0b3aaad977370b5d50e9d21049e5c2119/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/db4a89a7275f9cd41e88e8c87ff5ee8802f1a79e12427827afd807f5fcdd738c/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/4ede2c1ea538b3ad28a20b9348c5381d37821a543df2603e3c6a3b932884c3b7/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/98f1a4ff0d6fdfc65faf1c72af86179b1ce114f535e046bddd0940f2c5dc47ad/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/12fbfb88ffc403e4f83f767dd391ac7c753b8bfce2cfaf8e5fd842643edb2840/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/e0a05c1c97798162275b8b1f0a1bc6d3c1a9720a390a3f7d7ff29484c51cb84e/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-43:{mountpoint:/var/lib/containers/storage/overlay/6b49fc329de76e0656a5a714c3a662c4491606c7ee609b7779e4cea51125b1be/merged major:0 minor:43 fsType:overlay blockSize:0} overlay_0-44:{mountpoint:/var/lib/containers/storage/overlay/cdc22c2aedcf9f6719fe8850b911db580ad0d46a9123c8ca22ea00b037c8534a/merged major:0 minor:44 fsType:overlay blockSize:0} overlay_0-48:{mountpoint:/var/lib/containers/storage/overlay/6461247636ecef79dab9dd2c94d03a8c8c99cab35d5600cfcf72e525e4908106/merged major:0 minor:48 fsType:overlay blockSize:0} overlay_0-52:{mountpoint:/var/lib/containers/storage/overlay/c72c06839aede132e3afe522efb674728ef993232659f350a37575157bebc63f/merged major:0 minor:52 fsType:overlay blockSize:0} overlay_0-56:{mountpoint:/var/lib/containers/storage/overlay/93b34f59825d75595956998f2d790df9d8d898d3e77d0fa9733199fcfe01931c/merged major:0 minor:56 fsType:overlay blockSize:0} overlay_0-60:{mountpoint:/var/lib/containers/storage/overlay/37dea99e35f39e7127a8962fb7bfa8d1ee561d5aafbe67402ac62a4656d5f50e/merged major:0 minor:60 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/8d9558359199db42355e7aab9b153f00bd49650ecd4f6484e110c73d5956c60e/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/f78ac87df47f7550f8f374dbd8aa5370e8efb0f7a47e6d4d2ee3c9372be47532/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/b16eb65ba6a1f5800e2853d9473600f131189206421859cae0f49259abbedcdd/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/54f89a95fba06f4de294a6e61a76e14a56a704ca3270defd7de0936b644143f0/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/e0f1d077e251f24b438978be9848c8950792ca39c0050cf3c56cc626c2b2069e/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-73:{mountpoint:/var/lib/containers/storage/overlay/a1e1e6b3f7d7bbaa1b46f1ff327487d2a29660f464000a9e2b5bd0c56c1faa84/merged major:0 minor:73 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/c69b068a84c8c4c1d7b18cdc3ce9d054501ff3974f36931c7e7e7e99a1e7f4eb/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/da93d28082b668c56719487b1080a4de2243289e438103d5abc6802cc23c4e4e/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/d0504d42dc0045beb73fe28bd6b7326fa41d0b2c38a51292b5c3de4ab301adcf/merged major:0 minor:92 fsType:overlay blockSize:0}] Dec 04 00:30:16.789725 master-0 kubenswrapper[8678]: I1204 00:30:16.788977 8678 manager.go:217] Machine: {Timestamp:2025-12-04 00:30:16.78748626 +0000 UTC m=+0.114218836 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:eb95431843ee4cf58882520b84731300 SystemUUID:eb954318-43ee-4cf5-8882-520b84731300 BootID:b925b56b-e641-48cc-9935-878f5ab258fa Filesystems:[{Device:/var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp DeviceMajor:0 DeviceMinor:125 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf DeviceMajor:0 DeviceMinor:142 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m DeviceMajor:0 DeviceMinor:329 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84/userdata/shm DeviceMajor:0 DeviceMinor:50 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd DeviceMajor:0 DeviceMinor:153 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51/userdata/shm DeviceMajor:0 DeviceMinor:41 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:124 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:289 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:310 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-48 DeviceMajor:0 DeviceMinor:48 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-52 DeviceMajor:0 DeviceMinor:52 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc DeviceMajor:0 DeviceMinor:126 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert DeviceMajor:0 DeviceMinor:156 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m DeviceMajor:0 DeviceMinor:299 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq DeviceMajor:0 DeviceMinor:292 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf DeviceMajor:0 DeviceMinor:302 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm DeviceMajor:0 DeviceMinor:128 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-210 DeviceMajor:0 DeviceMinor:210 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:308 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-60 DeviceMajor:0 DeviceMinor:60 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-195 DeviceMajor:0 DeviceMinor:195 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p DeviceMajor:0 DeviceMinor:297 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm DeviceMajor:0 DeviceMinor:305 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/89be8775-ded0-4680-ae6f-3c60575ad4b8/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:127 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm DeviceMajor:0 DeviceMinor:179 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert DeviceMajor:0 DeviceMinor:286 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:318 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c DeviceMajor:0 DeviceMinor:157 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-189 DeviceMajor:0 DeviceMinor:189 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:313 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:314 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn DeviceMajor:0 DeviceMinor:334 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-199 DeviceMajor:0 DeviceMinor:199 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm DeviceMajor:0 DeviceMinor:345 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr DeviceMajor:0 DeviceMinor:178 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm DeviceMajor:0 DeviceMinor:337 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm DeviceMajor:0 DeviceMinor:351 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2 DeviceMajor:0 DeviceMinor:298 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9 DeviceMajor:0 DeviceMinor:175 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-193 DeviceMajor:0 DeviceMinor:193 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:290 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq DeviceMajor:0 DeviceMinor:294 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md DeviceMajor:0 DeviceMinor:296 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-130 DeviceMajor:0 DeviceMinor:130 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:309 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:174 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-181 DeviceMajor:0 DeviceMinor:181 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:287 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:303 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:311 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-112 DeviceMajor:0 DeviceMinor:112 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg DeviceMajor:0 DeviceMinor:300 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-158 DeviceMajor:0 DeviceMinor:158 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq DeviceMajor:0 DeviceMinor:317 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm DeviceMajor:0 DeviceMinor:327 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:291 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq DeviceMajor:0 DeviceMinor:293 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:319 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-44 DeviceMajor:0 DeviceMinor:44 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/635bc81a309df7832d537de83efd770b2125edb6f2daccb7afe434b4d90fe5b6/userdata/shm DeviceMajor:0 DeviceMinor:58 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-73 DeviceMajor:0 DeviceMinor:73 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm DeviceMajor:0 DeviceMinor:132 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-145 DeviceMajor:0 DeviceMinor:145 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:307 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2 DeviceMajor:0 DeviceMinor:301 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-56 DeviceMajor:0 DeviceMinor:56 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-120 DeviceMajor:0 DeviceMinor:120 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:168 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:288 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl DeviceMajor:0 DeviceMinor:295 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm DeviceMajor:0 DeviceMinor:143 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk DeviceMajor:0 DeviceMinor:316 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr DeviceMajor:0 DeviceMinor:322 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/b57073bf-c556-4ac2-a0a5-522e4360d493/volumes/kubernetes.io~projected/kube-api-access-69lk7 DeviceMajor:0 DeviceMinor:323 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm DeviceMajor:0 DeviceMinor:176 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm DeviceMajor:0 DeviceMinor:160 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-191 DeviceMajor:0 DeviceMinor:191 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps DeviceMajor:0 DeviceMinor:333 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe/userdata/shm DeviceMajor:0 DeviceMinor:46 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:312 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-43 DeviceMajor:0 DeviceMinor:43 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:304 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:315 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr DeviceMajor:0 DeviceMinor:326 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:257bffb545b929a MacAddress:be:9e:f8:ef:0f:ed Speed:10000 Mtu:8900} {Name:360486ee1b53ba8 MacAddress:ea:de:f4:9b:19:49 Speed:10000 Mtu:8900} {Name:3d77cf9cad06155 MacAddress:fa:61:b2:7d:e1:df Speed:10000 Mtu:8900} {Name:3d933d3b1b2933d MacAddress:5e:36:0c:4f:97:83 Speed:10000 Mtu:8900} {Name:4951cde7e962973 MacAddress:9e:ec:d6:20:f9:5e Speed:10000 Mtu:8900} {Name:5e3ddcc79665351 MacAddress:f2:5d:b7:47:4f:49 Speed:10000 Mtu:8900} {Name:6217f2bc0698da1 MacAddress:82:3c:32:9c:a5:9a Speed:10000 Mtu:8900} {Name:6879ac09aaa2d73 MacAddress:c6:94:99:19:1d:2c Speed:10000 Mtu:8900} {Name:76afcc1baac7909 MacAddress:a2:be:65:95:22:01 Speed:10000 Mtu:8900} {Name:b7e6ab5b506ae2c MacAddress:3a:e3:57:55:c8:81 Speed:10000 Mtu:8900} {Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:br-int MacAddress:46:89:3b:cd:ed:be Speed:0 Mtu:8900} {Name:dbe3f91011af71e MacAddress:26:42:36:60:b9:e0 Speed:10000 Mtu:8900} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:ea:1e:17 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d2:13:f5 Speed:-1 Mtu:9000} {Name:f690bc5389ec9e3 MacAddress:c6:6c:ce:c0:f8:17 Speed:10000 Mtu:8900} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:80:00:02 Speed:0 Mtu:8900} {Name:ovs-system MacAddress:b2:0a:5f:ad:6c:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 00:30:16.789725 master-0 kubenswrapper[8678]: I1204 00:30:16.789687 8678 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 00:30:16.790739 master-0 kubenswrapper[8678]: I1204 00:30:16.789976 8678 manager.go:233] Version: {KernelVersion:5.14.0-427.97.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511041748-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 00:30:16.790739 master-0 kubenswrapper[8678]: I1204 00:30:16.790334 8678 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 00:30:16.790739 master-0 kubenswrapper[8678]: I1204 00:30:16.790493 8678 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 00:30:16.790873 master-0 kubenswrapper[8678]: I1204 00:30:16.790532 8678 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 00:30:16.790873 master-0 kubenswrapper[8678]: I1204 00:30:16.790795 8678 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 00:30:16.790873 master-0 kubenswrapper[8678]: I1204 00:30:16.790808 8678 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 00:30:16.790873 master-0 kubenswrapper[8678]: I1204 00:30:16.790818 8678 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:30:16.790873 master-0 kubenswrapper[8678]: I1204 00:30:16.790850 8678 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:30:16.791176 master-0 kubenswrapper[8678]: I1204 00:30:16.791098 8678 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:30:16.791221 master-0 kubenswrapper[8678]: I1204 00:30:16.791196 8678 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 00:30:16.791271 master-0 kubenswrapper[8678]: I1204 00:30:16.791261 8678 kubelet.go:418] "Attempting to sync node with API server" Dec 04 00:30:16.791310 master-0 kubenswrapper[8678]: I1204 00:30:16.791280 8678 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 00:30:16.791310 master-0 kubenswrapper[8678]: I1204 00:30:16.791301 8678 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 00:30:16.791398 master-0 kubenswrapper[8678]: I1204 00:30:16.791315 8678 kubelet.go:324] "Adding apiserver pod source" Dec 04 00:30:16.791398 master-0 kubenswrapper[8678]: I1204 00:30:16.791338 8678 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.793850 8678 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794105 8678 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-server-current.pem". Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794504 8678 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794672 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794697 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794717 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794736 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794748 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794762 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794775 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794784 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794795 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794805 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794820 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794838 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.794873 8678 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 00:30:16.796072 master-0 kubenswrapper[8678]: I1204 00:30:16.795499 8678 server.go:1280] "Started kubelet" Dec 04 00:30:16.798879 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 00:30:16.800996 master-0 kubenswrapper[8678]: I1204 00:30:16.800754 8678 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 00:30:16.800996 master-0 kubenswrapper[8678]: I1204 00:30:16.800845 8678 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 00:30:16.801788 master-0 kubenswrapper[8678]: I1204 00:30:16.801727 8678 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 00:30:16.801915 master-0 kubenswrapper[8678]: I1204 00:30:16.801585 8678 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 00:30:16.806380 master-0 kubenswrapper[8678]: I1204 00:30:16.806305 8678 server.go:449] "Adding debug handlers to kubelet server" Dec 04 00:30:16.807142 master-0 kubenswrapper[8678]: I1204 00:30:16.807079 8678 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 00:30:16.807221 master-0 kubenswrapper[8678]: I1204 00:30:16.807170 8678 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 00:30:16.807270 master-0 kubenswrapper[8678]: I1204 00:30:16.807233 8678 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 21:36:31.948805229 +0000 UTC Dec 04 00:30:16.807270 master-0 kubenswrapper[8678]: I1204 00:30:16.807268 8678 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 21h6m15.141539742s for next certificate rotation Dec 04 00:30:16.807357 master-0 kubenswrapper[8678]: I1204 00:30:16.807302 8678 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 00:30:16.807357 master-0 kubenswrapper[8678]: I1204 00:30:16.807311 8678 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 00:30:16.808518 master-0 kubenswrapper[8678]: E1204 00:30:16.807451 8678 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 00:30:16.808518 master-0 kubenswrapper[8678]: I1204 00:30:16.807474 8678 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 00:30:16.808518 master-0 kubenswrapper[8678]: I1204 00:30:16.808491 8678 factory.go:55] Registering systemd factory Dec 04 00:30:16.808518 master-0 kubenswrapper[8678]: I1204 00:30:16.808524 8678 factory.go:221] Registration of the systemd container factory successfully Dec 04 00:30:16.808852 master-0 kubenswrapper[8678]: I1204 00:30:16.808814 8678 factory.go:153] Registering CRI-O factory Dec 04 00:30:16.808918 master-0 kubenswrapper[8678]: I1204 00:30:16.808856 8678 factory.go:221] Registration of the crio container factory successfully Dec 04 00:30:16.808987 master-0 kubenswrapper[8678]: I1204 00:30:16.808974 8678 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 00:30:16.809031 master-0 kubenswrapper[8678]: I1204 00:30:16.809005 8678 factory.go:103] Registering Raw factory Dec 04 00:30:16.809031 master-0 kubenswrapper[8678]: I1204 00:30:16.809026 8678 manager.go:1196] Started watching for new ooms in manager Dec 04 00:30:16.809716 master-0 kubenswrapper[8678]: I1204 00:30:16.809689 8678 manager.go:319] Starting recovery of all containers Dec 04 00:30:16.811020 master-0 kubenswrapper[8678]: I1204 00:30:16.810967 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="89be8775-ded0-4680-ae6f-3c60575ad4b8" volumeName="kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access" seLinuxMountContext="" Dec 04 00:30:16.811020 master-0 kubenswrapper[8678]: I1204 00:30:16.811017 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa2eaba9-479e-4420-a24f-63530e4da783" volumeName="kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811031 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811042 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811052 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811064 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811074 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811084 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811094 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811104 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811115 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811124 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811134 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8" volumeName="kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811146 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b57073bf-c556-4ac2-a0a5-522e4360d493" volumeName="kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811156 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf" seLinuxMountContext="" Dec 04 00:30:16.811149 master-0 kubenswrapper[8678]: I1204 00:30:16.811167 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811179 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811190 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811221 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811232 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2f01d68-92ae-45b8-8501-645e439b5295" volumeName="kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811242 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c79edcd7-4399-4ded-9b03-9084ad9e14b4" volumeName="kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811253 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811264 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811275 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811296 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa2eaba9-479e-4420-a24f-63530e4da783" volumeName="kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811316 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8" volumeName="kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811329 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811343 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811354 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811368 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811379 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811390 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811400 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811410 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811422 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811434 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811443 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811453 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811464 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811473 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811484 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811495 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811504 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811513 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811524 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811534 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811546 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811556 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="edd7cfb0-df67-4978-adca-9b917d3b5708" volumeName="kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811565 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="285a1e74-1d8e-452e-a5a4-484afc10e10f" volumeName="kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811575 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811587 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" volumeName="kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811595 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811611 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811620 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811630 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811642 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811652 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811661 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" volumeName="kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811669 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="edd7cfb0-df67-4978-adca-9b917d3b5708" volumeName="kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811677 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="89be8775-ded0-4680-ae6f-3c60575ad4b8" volumeName="kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811686 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a83a76c-050e-4378-ac3a-1213d6d53773" volumeName="kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811696 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8375dfa-3a83-415b-bce5-0819a73255c1" volumeName="kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811706 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811716 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811726 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811737 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffe9d26b-34e2-4506-9c38-69b85ab210a1" volumeName="kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811747 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert" seLinuxMountContext="" Dec 04 00:30:16.811665 master-0 kubenswrapper[8678]: I1204 00:30:16.811757 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811767 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811778 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811787 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811795 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811804 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811813 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811822 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811832 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811841 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffe9d26b-34e2-4506-9c38-69b85ab210a1" volumeName="kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811851 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811860 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811869 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811879 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811889 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2f01d68-92ae-45b8-8501-645e439b5295" volumeName="kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811900 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811909 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811922 8678 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2" seLinuxMountContext="" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811949 8678 reconstruct.go:97] "Volume reconstruction finished" Dec 04 00:30:16.813756 master-0 kubenswrapper[8678]: I1204 00:30:16.811957 8678 reconciler.go:26] "Reconciler: start to sync state" Dec 04 00:30:16.816576 master-0 kubenswrapper[8678]: I1204 00:30:16.816534 8678 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 00:30:16.817233 master-0 kubenswrapper[8678]: I1204 00:30:16.817210 8678 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Dec 04 00:30:16.817355 master-0 kubenswrapper[8678]: I1204 00:30:16.817344 8678 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 00:30:16.819197 master-0 kubenswrapper[8678]: I1204 00:30:16.819151 8678 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 00:30:16.846869 master-0 kubenswrapper[8678]: I1204 00:30:16.846771 8678 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 00:30:16.848393 master-0 kubenswrapper[8678]: I1204 00:30:16.848354 8678 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 00:30:16.848476 master-0 kubenswrapper[8678]: I1204 00:30:16.848415 8678 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 00:30:16.848476 master-0 kubenswrapper[8678]: I1204 00:30:16.848444 8678 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 00:30:16.848794 master-0 kubenswrapper[8678]: E1204 00:30:16.848708 8678 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Dec 04 00:30:16.850896 master-0 kubenswrapper[8678]: I1204 00:30:16.850846 8678 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 00:30:16.860360 master-0 kubenswrapper[8678]: I1204 00:30:16.860284 8678 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742" exitCode=1 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.877974 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="5310369388b9d57f1136135213aab2547b7606ff55df76063a2bfab7824144bd" exitCode=0 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.878018 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="42a43c5406cc22adb9b3ba42d732fa8cb77848a82bb7e49ec7284642472baad4" exitCode=0 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.878026 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="8ff5104678eaba3eecd736a278e1661792ddc36a8b68f4b69f7019b814f16993" exitCode=0 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.878036 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="d5609818cd8c2efbda7153e648a8259ae917c74f4ff0c93048f634b456d737d1" exitCode=0 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.878046 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="6f0ebba6a9c03ec96d055a8afe226473e6d6b3f268074fd934a991ed33ca39ec" exitCode=0 Dec 04 00:30:16.878042 master-0 kubenswrapper[8678]: I1204 00:30:16.878055 8678 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="f2410f4e6fc6ca15d32c345499d7fa49d4ebf0368ee0349e5f7ab0bbf2ca3cf1" exitCode=0 Dec 04 00:30:16.890324 master-0 kubenswrapper[8678]: I1204 00:30:16.890237 8678 generic.go:334] "Generic (PLEG): container finished" podID="68cb9838-2d09-46ab-8e2d-08d5868056fc" containerID="c9521e4b338a729f24968935eb69431972eafc3079f28819c337f948d3e9346b" exitCode=0 Dec 04 00:30:16.894521 master-0 kubenswrapper[8678]: I1204 00:30:16.894474 8678 generic.go:334] "Generic (PLEG): container finished" podID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerID="fedd774b5398f0119e888631e667565bbef54e542a0cb27a2bea0c11c45d161f" exitCode=0 Dec 04 00:30:16.897200 master-0 kubenswrapper[8678]: I1204 00:30:16.897166 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/2.log" Dec 04 00:30:16.897556 master-0 kubenswrapper[8678]: I1204 00:30:16.897530 8678 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" exitCode=1 Dec 04 00:30:16.897556 master-0 kubenswrapper[8678]: I1204 00:30:16.897551 8678 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532" exitCode=0 Dec 04 00:30:16.905463 master-0 kubenswrapper[8678]: I1204 00:30:16.905410 8678 generic.go:334] "Generic (PLEG): container finished" podID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerID="80b056ca713cc669a16b4ed101f0051a28fedc8060007822265803cbfc4e3a86" exitCode=0 Dec 04 00:30:16.917332 master-0 kubenswrapper[8678]: I1204 00:30:16.917253 8678 generic.go:334] "Generic (PLEG): container finished" podID="13238af3704fe583f617f61e755cf4c2" containerID="87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899" exitCode=0 Dec 04 00:30:16.947504 master-0 kubenswrapper[8678]: I1204 00:30:16.947464 8678 manager.go:324] Recovery completed Dec 04 00:30:16.949918 master-0 kubenswrapper[8678]: E1204 00:30:16.949875 8678 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 00:30:16.988030 master-0 kubenswrapper[8678]: I1204 00:30:16.987959 8678 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 00:30:16.988030 master-0 kubenswrapper[8678]: I1204 00:30:16.987996 8678 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 00:30:16.988030 master-0 kubenswrapper[8678]: I1204 00:30:16.988023 8678 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:30:16.988440 master-0 kubenswrapper[8678]: I1204 00:30:16.988278 8678 state_mem.go:88] "Updated default CPUSet" cpuSet="" Dec 04 00:30:16.988440 master-0 kubenswrapper[8678]: I1204 00:30:16.988299 8678 state_mem.go:96] "Updated CPUSet assignments" assignments={} Dec 04 00:30:16.988440 master-0 kubenswrapper[8678]: I1204 00:30:16.988334 8678 state_checkpoint.go:136] "State checkpoint: restored state from checkpoint" Dec 04 00:30:16.988440 master-0 kubenswrapper[8678]: I1204 00:30:16.988344 8678 state_checkpoint.go:137] "State checkpoint: defaultCPUSet" defaultCpuSet="" Dec 04 00:30:16.988440 master-0 kubenswrapper[8678]: I1204 00:30:16.988355 8678 policy_none.go:49] "None policy: Start" Dec 04 00:30:16.989754 master-0 kubenswrapper[8678]: I1204 00:30:16.989720 8678 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 00:30:16.989754 master-0 kubenswrapper[8678]: I1204 00:30:16.989755 8678 state_mem.go:35] "Initializing new in-memory state store" Dec 04 00:30:16.990039 master-0 kubenswrapper[8678]: I1204 00:30:16.990007 8678 state_mem.go:75] "Updated machine memory state" Dec 04 00:30:16.990039 master-0 kubenswrapper[8678]: I1204 00:30:16.990031 8678 state_checkpoint.go:82] "State checkpoint: restored state from checkpoint" Dec 04 00:30:17.001242 master-0 kubenswrapper[8678]: I1204 00:30:17.001201 8678 manager.go:334] "Starting Device Plugin manager" Dec 04 00:30:17.001321 master-0 kubenswrapper[8678]: I1204 00:30:17.001252 8678 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 00:30:17.001321 master-0 kubenswrapper[8678]: I1204 00:30:17.001269 8678 server.go:79] "Starting device plugin registration server" Dec 04 00:30:17.001829 master-0 kubenswrapper[8678]: I1204 00:30:17.001765 8678 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 00:30:17.001829 master-0 kubenswrapper[8678]: I1204 00:30:17.001792 8678 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 00:30:17.002138 master-0 kubenswrapper[8678]: I1204 00:30:17.001967 8678 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 00:30:17.002138 master-0 kubenswrapper[8678]: I1204 00:30:17.002073 8678 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 00:30:17.002138 master-0 kubenswrapper[8678]: I1204 00:30:17.002084 8678 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 00:30:17.102460 master-0 kubenswrapper[8678]: I1204 00:30:17.102422 8678 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:30:17.104053 master-0 kubenswrapper[8678]: I1204 00:30:17.103993 8678 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:30:17.104053 master-0 kubenswrapper[8678]: I1204 00:30:17.104066 8678 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:30:17.104053 master-0 kubenswrapper[8678]: I1204 00:30:17.104081 8678 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:30:17.104460 master-0 kubenswrapper[8678]: I1204 00:30:17.104162 8678 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:30:17.115431 master-0 kubenswrapper[8678]: I1204 00:30:17.115353 8678 kubelet_node_status.go:115] "Node was previously registered" node="master-0" Dec 04 00:30:17.115818 master-0 kubenswrapper[8678]: I1204 00:30:17.115505 8678 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 00:30:17.150958 master-0 kubenswrapper[8678]: I1204 00:30:17.150786 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-etcd/etcd-master-0-master-0","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","kube-system/bootstrap-kube-controller-manager-master-0","kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:30:17.151404 master-0 kubenswrapper[8678]: I1204 00:30:17.151327 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792"} Dec 04 00:30:17.151520 master-0 kubenswrapper[8678]: I1204 00:30:17.151405 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"dc41179c1a580bee9c34b2c3240d03c90cf58b6d028827131798a90b8fc42f51"} Dec 04 00:30:17.151520 master-0 kubenswrapper[8678]: I1204 00:30:17.151422 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerDied","Data":"7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742"} Dec 04 00:30:17.151520 master-0 kubenswrapper[8678]: I1204 00:30:17.151441 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"e10821f8073eeaea438ecbd1cf8915de18203b33a8d1c5d97ff43deb4f41a6fe"} Dec 04 00:30:17.151649 master-0 kubenswrapper[8678]: I1204 00:30:17.151629 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerStarted","Data":"c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48"} Dec 04 00:30:17.151699 master-0 kubenswrapper[8678]: I1204 00:30:17.151652 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerStarted","Data":"635bc81a309df7832d537de83efd770b2125edb6f2daccb7afe434b4d90fe5b6"} Dec 04 00:30:17.151699 master-0 kubenswrapper[8678]: I1204 00:30:17.151675 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081" Dec 04 00:30:17.151699 master-0 kubenswrapper[8678]: I1204 00:30:17.151689 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"d3bf5f95f064d6d4c06a0006d3f20c777a30163e26ecd49576d8d891cf10c17b"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151703 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151721 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151735 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151749 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"c9637097b486453df64c71018abb37b06dfffe6f736dcd239764c377bfc5b3ec"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151763 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"e06a5b4e4be58273879a0e221f9819c741e49f33730780a29935b023d52dc5fc"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151777 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"41b95a38663dd6fe34e183818a475977","Type":"ContainerStarted","Data":"f269736502d4eec054dd7b0f21282248338a99bf1d32b6b0f6b930a6c8d77b84"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151800 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db0db604ada6ca0ebd65f916dd1acfacc498eefd32e11329a956f850104b75e4" Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151816 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6395f83d60e8dda1e97300d0de08202e36bc0bc814ebe497eccc796a176d518e" Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151826 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be"} Dec 04 00:30:17.151830 master-0 kubenswrapper[8678]: I1204 00:30:17.151844 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b"} Dec 04 00:30:17.152281 master-0 kubenswrapper[8678]: I1204 00:30:17.151859 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerDied","Data":"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899"} Dec 04 00:30:17.152281 master-0 kubenswrapper[8678]: I1204 00:30:17.151874 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"13238af3704fe583f617f61e755cf4c2","Type":"ContainerStarted","Data":"65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51"} Dec 04 00:30:17.166713 master-0 kubenswrapper[8678]: E1204 00:30:17.166647 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-rbac-proxy-crio-master-0\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.167145 master-0 kubenswrapper[8678]: W1204 00:30:17.167108 8678 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 00:30:17.167230 master-0 kubenswrapper[8678]: E1204 00:30:17.167158 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-controller-manager-master-0\" already exists" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.167230 master-0 kubenswrapper[8678]: E1204 00:30:17.167220 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0-master-0\" already exists" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.167299 master-0 kubenswrapper[8678]: E1204 00:30:17.167156 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-apiserver-master-0\" already exists" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.167369 master-0 kubenswrapper[8678]: E1204 00:30:17.167104 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-scheduler-master-0\" already exists" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.220551 master-0 kubenswrapper[8678]: I1204 00:30:17.220470 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.221042 master-0 kubenswrapper[8678]: I1204 00:30:17.221024 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.221255 master-0 kubenswrapper[8678]: I1204 00:30:17.221235 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.221357 master-0 kubenswrapper[8678]: I1204 00:30:17.221343 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.221458 master-0 kubenswrapper[8678]: I1204 00:30:17.221437 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.221546 master-0 kubenswrapper[8678]: I1204 00:30:17.221533 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.221653 master-0 kubenswrapper[8678]: I1204 00:30:17.221639 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.221748 master-0 kubenswrapper[8678]: I1204 00:30:17.221735 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.221835 master-0 kubenswrapper[8678]: I1204 00:30:17.221824 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.221953 master-0 kubenswrapper[8678]: I1204 00:30:17.221917 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.222046 master-0 kubenswrapper[8678]: I1204 00:30:17.222034 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.222234 master-0 kubenswrapper[8678]: I1204 00:30:17.222220 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.222333 master-0 kubenswrapper[8678]: I1204 00:30:17.222319 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.222422 master-0 kubenswrapper[8678]: I1204 00:30:17.222410 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.222522 master-0 kubenswrapper[8678]: I1204 00:30:17.222509 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.222616 master-0 kubenswrapper[8678]: I1204 00:30:17.222604 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.222711 master-0 kubenswrapper[8678]: I1204 00:30:17.222699 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.323204 master-0 kubenswrapper[8678]: I1204 00:30:17.323136 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.323553 master-0 kubenswrapper[8678]: I1204 00:30:17.323374 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.323624 master-0 kubenswrapper[8678]: I1204 00:30:17.323508 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.323719 master-0 kubenswrapper[8678]: I1204 00:30:17.323657 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.323719 master-0 kubenswrapper[8678]: I1204 00:30:17.323689 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.323719 master-0 kubenswrapper[8678]: I1204 00:30:17.323709 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.323719 master-0 kubenswrapper[8678]: I1204 00:30:17.323729 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.323719 master-0 kubenswrapper[8678]: I1204 00:30:17.323747 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323765 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323783 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323801 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323819 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323834 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323837 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323876 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323851 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323886 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323837 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323891 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323916 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323945 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323964 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323849 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.323907 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324038 master-0 kubenswrapper[8678]: I1204 00:30:17.324028 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324097 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324047 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324078 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324155 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324185 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324195 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324220 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:17.324610 master-0 kubenswrapper[8678]: I1204 00:30:17.324277 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:17.324902 master-0 kubenswrapper[8678]: I1204 00:30:17.324883 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"41b95a38663dd6fe34e183818a475977\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:17.793378 master-0 kubenswrapper[8678]: I1204 00:30:17.793197 8678 apiserver.go:52] "Watching apiserver" Dec 04 00:30:17.803260 master-0 kubenswrapper[8678]: I1204 00:30:17.803165 8678 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 00:30:17.804878 master-0 kubenswrapper[8678]: I1204 00:30:17.804788 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf","openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn","openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5","openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2","openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m","openshift-ingress-operator/ingress-operator-85dbd94574-7clvx","openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r","openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc","openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj","openshift-network-diagnostics/network-check-target-w5f2j","assisted-installer/assisted-installer-controller-6cf87","openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr","openshift-multus/multus-admission-controller-78ddcf56f9-x5jff","openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p","openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h","openshift-etcd/etcd-master-0-master-0","openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6","openshift-multus/multus-additional-cni-plugins-jglkq","kube-system/bootstrap-kube-scheduler-master-0","openshift-cluster-version/cluster-version-operator-869c786959-rg92r","openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l","openshift-multus/network-metrics-daemon-t85qp","openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz","openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-network-operator/network-operator-6cbf58c977-vjwnj","openshift-ovn-kubernetes/ovnkube-node-kgflj","kube-system/bootstrap-kube-controller-manager-master-0","openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm","openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g","openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs","openshift-multus/multus-w7796","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p","openshift-network-node-identity/network-node-identity-lxpmq","openshift-network-operator/iptables-alerter-zm8h9","openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7"] Dec 04 00:30:17.805211 master-0 kubenswrapper[8678]: I1204 00:30:17.805159 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:30:17.805388 master-0 kubenswrapper[8678]: I1204 00:30:17.805329 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.805478 master-0 kubenswrapper[8678]: I1204 00:30:17.805339 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.810109 master-0 kubenswrapper[8678]: I1204 00:30:17.808484 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.810109 master-0 kubenswrapper[8678]: I1204 00:30:17.808915 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.810109 master-0 kubenswrapper[8678]: I1204 00:30:17.809093 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:17.810815 master-0 kubenswrapper[8678]: I1204 00:30:17.810750 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.810872 master-0 kubenswrapper[8678]: I1204 00:30:17.810816 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:17.811892 master-0 kubenswrapper[8678]: I1204 00:30:17.811840 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:17.817088 master-0 kubenswrapper[8678]: I1204 00:30:17.816602 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.817088 master-0 kubenswrapper[8678]: I1204 00:30:17.816618 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 00:30:17.817313 master-0 kubenswrapper[8678]: I1204 00:30:17.817251 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.818738 master-0 kubenswrapper[8678]: I1204 00:30:17.818699 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:17.818868 master-0 kubenswrapper[8678]: I1204 00:30:17.818823 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:17.819083 master-0 kubenswrapper[8678]: I1204 00:30:17.819036 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:17.819166 master-0 kubenswrapper[8678]: I1204 00:30:17.819147 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 00:30:17.819231 master-0 kubenswrapper[8678]: I1204 00:30:17.819209 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 00:30:17.819362 master-0 kubenswrapper[8678]: I1204 00:30:17.819336 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 00:30:17.819362 master-0 kubenswrapper[8678]: I1204 00:30:17.819354 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 00:30:17.819529 master-0 kubenswrapper[8678]: I1204 00:30:17.819492 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 00:30:17.819529 master-0 kubenswrapper[8678]: I1204 00:30:17.819515 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 00:30:17.821168 master-0 kubenswrapper[8678]: I1204 00:30:17.821133 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 00:30:17.821168 master-0 kubenswrapper[8678]: I1204 00:30:17.821133 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 00:30:17.821297 master-0 kubenswrapper[8678]: I1204 00:30:17.821178 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 00:30:17.821297 master-0 kubenswrapper[8678]: I1204 00:30:17.821215 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 00:30:17.821297 master-0 kubenswrapper[8678]: I1204 00:30:17.821244 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 00:30:17.823431 master-0 kubenswrapper[8678]: I1204 00:30:17.823332 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 00:30:17.830169 master-0 kubenswrapper[8678]: I1204 00:30:17.829969 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.830169 master-0 kubenswrapper[8678]: I1204 00:30:17.830055 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.830085 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.830288 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.830334 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.831014 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.831782 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.831891 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:17.832739 master-0 kubenswrapper[8678]: I1204 00:30:17.831947 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.834876 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.835263 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.835713 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.835968 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.835989 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836601 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836662 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836704 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836732 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836758 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836783 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836807 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836940 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836971 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.836995 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.837019 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.837750 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.837965 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.838312 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.838430 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.840230 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.840569 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.840757 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.841203 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 00:30:17.843122 master-0 kubenswrapper[8678]: I1204 00:30:17.841998 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.843566 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.843614 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.844235 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845333 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845342 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845343 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845404 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845560 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845749 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845753 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845844 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 00:30:17.847839 master-0 kubenswrapper[8678]: I1204 00:30:17.845849 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 00:30:17.848325 master-0 kubenswrapper[8678]: I1204 00:30:17.848155 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:30:17.848389 master-0 kubenswrapper[8678]: I1204 00:30:17.848350 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.848630 master-0 kubenswrapper[8678]: I1204 00:30:17.848586 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 00:30:17.848685 master-0 kubenswrapper[8678]: I1204 00:30:17.848657 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.849025 master-0 kubenswrapper[8678]: I1204 00:30:17.848980 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 00:30:17.849197 master-0 kubenswrapper[8678]: I1204 00:30:17.849165 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 00:30:17.850972 master-0 kubenswrapper[8678]: I1204 00:30:17.850891 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 00:30:17.850972 master-0 kubenswrapper[8678]: I1204 00:30:17.849205 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:30:17.852060 master-0 kubenswrapper[8678]: I1204 00:30:17.851833 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 00:30:17.852283 master-0 kubenswrapper[8678]: I1204 00:30:17.852244 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.852540 master-0 kubenswrapper[8678]: I1204 00:30:17.852513 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.852815 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.852953 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.853804 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.853897 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854207 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854405 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854422 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854681 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854701 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854733 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.854966 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.855018 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.855097 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 00:30:17.855093 master-0 kubenswrapper[8678]: I1204 00:30:17.855111 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855130 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855220 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855218 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855269 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855325 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855348 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855378 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855424 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855423 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855387 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855509 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855462 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855546 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855552 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855563 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855228 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855681 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855705 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855708 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855847 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.855969 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856069 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856224 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856239 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856303 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856336 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856401 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856569 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856353 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.856071 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 00:30:17.857113 master-0 kubenswrapper[8678]: I1204 00:30:17.857139 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 00:30:17.859731 master-0 kubenswrapper[8678]: I1204 00:30:17.857527 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:30:17.859731 master-0 kubenswrapper[8678]: I1204 00:30:17.857532 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 00:30:17.866559 master-0 kubenswrapper[8678]: I1204 00:30:17.866507 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 00:30:17.867514 master-0 kubenswrapper[8678]: I1204 00:30:17.867483 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 00:30:17.867993 master-0 kubenswrapper[8678]: I1204 00:30:17.867951 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 00:30:17.875040 master-0 kubenswrapper[8678]: I1204 00:30:17.875002 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 00:30:17.895989 master-0 kubenswrapper[8678]: I1204 00:30:17.895906 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 00:30:17.910666 master-0 kubenswrapper[8678]: I1204 00:30:17.910610 8678 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 00:30:17.916039 master-0 kubenswrapper[8678]: I1204 00:30:17.915985 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 00:30:17.936127 master-0 kubenswrapper[8678]: I1204 00:30:17.936055 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 00:30:17.937773 master-0 kubenswrapper[8678]: I1204 00:30:17.937727 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:17.937836 master-0 kubenswrapper[8678]: I1204 00:30:17.937772 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:17.937836 master-0 kubenswrapper[8678]: I1204 00:30:17.937801 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.937836 master-0 kubenswrapper[8678]: I1204 00:30:17.937827 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: I1204 00:30:17.937854 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: I1204 00:30:17.937880 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: I1204 00:30:17.937904 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: I1204 00:30:17.937935 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: I1204 00:30:17.937961 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:17.938006 master-0 kubenswrapper[8678]: E1204 00:30:17.937956 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:17.938215 master-0 kubenswrapper[8678]: I1204 00:30:17.938146 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:17.938215 master-0 kubenswrapper[8678]: I1204 00:30:17.938154 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:17.938297 master-0 kubenswrapper[8678]: E1204 00:30:17.938191 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.438157751 +0000 UTC m=+1.764890477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:17.938348 master-0 kubenswrapper[8678]: I1204 00:30:17.938291 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:17.938348 master-0 kubenswrapper[8678]: I1204 00:30:17.938300 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.938514 master-0 kubenswrapper[8678]: I1204 00:30:17.938416 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.938514 master-0 kubenswrapper[8678]: I1204 00:30:17.938433 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:17.938514 master-0 kubenswrapper[8678]: I1204 00:30:17.938463 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:17.938514 master-0 kubenswrapper[8678]: I1204 00:30:17.938486 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:17.938674 master-0 kubenswrapper[8678]: I1204 00:30:17.938521 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:17.938674 master-0 kubenswrapper[8678]: I1204 00:30:17.938628 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.938791 master-0 kubenswrapper[8678]: I1204 00:30:17.938761 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.938835 master-0 kubenswrapper[8678]: I1204 00:30:17.938797 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:17.938835 master-0 kubenswrapper[8678]: I1204 00:30:17.938829 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.938915 master-0 kubenswrapper[8678]: I1204 00:30:17.938832 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:17.938915 master-0 kubenswrapper[8678]: I1204 00:30:17.938856 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.938915 master-0 kubenswrapper[8678]: I1204 00:30:17.938895 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:17.939045 master-0 kubenswrapper[8678]: I1204 00:30:17.938973 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939045 master-0 kubenswrapper[8678]: I1204 00:30:17.939008 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.939045 master-0 kubenswrapper[8678]: I1204 00:30:17.939037 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.939147 master-0 kubenswrapper[8678]: I1204 00:30:17.939076 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939147 master-0 kubenswrapper[8678]: I1204 00:30:17.939102 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.939147 master-0 kubenswrapper[8678]: I1204 00:30:17.939111 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:17.939147 master-0 kubenswrapper[8678]: I1204 00:30:17.939132 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.939147 master-0 kubenswrapper[8678]: I1204 00:30:17.939141 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939322 master-0 kubenswrapper[8678]: I1204 00:30:17.939184 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.939322 master-0 kubenswrapper[8678]: I1204 00:30:17.939262 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.939397 master-0 kubenswrapper[8678]: I1204 00:30:17.939320 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.939437 master-0 kubenswrapper[8678]: I1204 00:30:17.939314 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.939537 master-0 kubenswrapper[8678]: I1204 00:30:17.939466 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.939537 master-0 kubenswrapper[8678]: I1204 00:30:17.939458 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:17.939537 master-0 kubenswrapper[8678]: I1204 00:30:17.939536 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939569 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939635 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939735 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939769 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939792 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939823 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939856 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939865 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939880 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:17.939977 master-0 kubenswrapper[8678]: I1204 00:30:17.939980 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940013 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940043 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940062 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940086 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940106 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940154 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940179 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940201 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940227 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: I1204 00:30:17.940259 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.940319 master-0 kubenswrapper[8678]: E1204 00:30:17.940284 8678 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940323 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: E1204 00:30:17.940379 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.440360063 +0000 UTC m=+1.767092609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940413 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940460 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940467 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940511 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940547 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940576 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940601 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940627 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.940670 master-0 kubenswrapper[8678]: I1204 00:30:17.940650 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: E1204 00:30:17.940682 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940709 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: E1204 00:30:17.940749 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.440730524 +0000 UTC m=+1.767463120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: E1204 00:30:17.940792 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940795 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: E1204 00:30:17.940859 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.440835457 +0000 UTC m=+1.767568223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940943 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940852 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940975 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.941007 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.941016 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.941036 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:17.941067 master-0 kubenswrapper[8678]: I1204 00:30:17.940974 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941094 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941156 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941189 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941193 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941266 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941283 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941301 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941393 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941413 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941476 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:17.941602 master-0 kubenswrapper[8678]: I1204 00:30:17.941574 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.942025 master-0 kubenswrapper[8678]: I1204 00:30:17.941683 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.942063 master-0 kubenswrapper[8678]: I1204 00:30:17.942036 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.942106 master-0 kubenswrapper[8678]: I1204 00:30:17.941775 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.942385 master-0 kubenswrapper[8678]: I1204 00:30:17.942285 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:17.942385 master-0 kubenswrapper[8678]: I1204 00:30:17.942335 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942450 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942477 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942511 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942523 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942571 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942611 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942636 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942658 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942667 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942705 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942726 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942757 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942819 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942844 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942869 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.942870 master-0 kubenswrapper[8678]: I1204 00:30:17.942894 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.942938 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.942978 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943015 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943042 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943072 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943101 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943130 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943159 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943189 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943217 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943259 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943267 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943293 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943327 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943348 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943375 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943518 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943572 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943749 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943773 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943799 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943840 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943875 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943903 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943945 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943965 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943987 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.943995 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.944017 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.944053 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.944075 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.944093 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.944061 master-0 kubenswrapper[8678]: I1204 00:30:17.944113 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944153 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944172 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944179 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944191 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944232 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944263 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944292 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944320 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944341 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944345 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944385 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944404 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944423 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944441 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944550 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944713 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.944908 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.945216 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.945406 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:17.945975 master-0 kubenswrapper[8678]: I1204 00:30:17.945578 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:17.947253 master-0 kubenswrapper[8678]: I1204 00:30:17.946192 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.947253 master-0 kubenswrapper[8678]: I1204 00:30:17.946489 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:17.947253 master-0 kubenswrapper[8678]: I1204 00:30:17.946596 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:17.955709 master-0 kubenswrapper[8678]: I1204 00:30:17.955636 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 00:30:17.965287 master-0 kubenswrapper[8678]: I1204 00:30:17.965234 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:17.993544 master-0 kubenswrapper[8678]: I1204 00:30:17.993485 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:18.010473 master-0 kubenswrapper[8678]: I1204 00:30:18.010400 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:18.031775 master-0 kubenswrapper[8678]: I1204 00:30:18.031709 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:18.045840 master-0 kubenswrapper[8678]: I1204 00:30:18.045747 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:18.045840 master-0 kubenswrapper[8678]: I1204 00:30:18.045794 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:18.045840 master-0 kubenswrapper[8678]: I1204 00:30:18.045834 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.045863 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.045896 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.045949 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.045976 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.046011 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046043 master-0 kubenswrapper[8678]: I1204 00:30:18.046041 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046068 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046095 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046079 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: E1204 00:30:18.046002 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046189 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046195 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: E1204 00:30:18.046250 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.546216833 +0000 UTC m=+1.872949399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046138 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046299 master-0 kubenswrapper[8678]: I1204 00:30:18.046290 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: E1204 00:30:18.046304 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046330 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046350 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: E1204 00:30:18.046392 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.546362807 +0000 UTC m=+1.873095393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046404 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046142 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046414 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046438 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: E1204 00:30:18.046084 8678 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046482 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: E1204 00:30:18.046508 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.546486991 +0000 UTC m=+1.873219767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046542 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046551 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046563 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046604 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046396 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046629 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046673 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046710 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046727 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.046726 master-0 kubenswrapper[8678]: I1204 00:30:18.046738 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046768 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: E1204 00:30:18.046788 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: E1204 00:30:18.046817 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046827 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: E1204 00:30:18.046841 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.54682534 +0000 UTC m=+1.873558096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046796 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046871 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: E1204 00:30:18.046891 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.546864811 +0000 UTC m=+1.873597567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046946 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046955 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.046977 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047019 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047053 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047142 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047191 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047191 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047149 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047260 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047289 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047332 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047372 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047405 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047446 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047482 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047558 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047602 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047635 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047670 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047697 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047745 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047807 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.047821 master-0 kubenswrapper[8678]: I1204 00:30:18.047837 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.047871 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.047903 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.047965 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048014 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048095 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048127 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048286 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048329 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048405 8678 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048446 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.548432925 +0000 UTC m=+1.875165491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048451 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048473 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048487 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048526 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048587 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048604 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048632 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048652 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.548636931 +0000 UTC m=+1.875369717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048676 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048697 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048710 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048772 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048823 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048879 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048889 8678 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.048955 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048984 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.049002 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.048985 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.54896408 +0000 UTC m=+1.875696896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: E1204 00:30:18.049042 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:18.549028772 +0000 UTC m=+1.875761588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:18.049176 master-0 kubenswrapper[8678]: I1204 00:30:18.049153 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.052478 master-0 kubenswrapper[8678]: I1204 00:30:18.052439 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:18.081443 master-0 kubenswrapper[8678]: I1204 00:30:18.081400 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:18.090024 master-0 kubenswrapper[8678]: I1204 00:30:18.089991 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:30:18.108775 master-0 kubenswrapper[8678]: I1204 00:30:18.108728 8678 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:30:18.122371 master-0 kubenswrapper[8678]: E1204 00:30:18.122299 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-rbac-proxy-crio-master-0\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:30:18.142192 master-0 kubenswrapper[8678]: E1204 00:30:18.142139 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-scheduler-master-0\" already exists" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:30:18.162915 master-0 kubenswrapper[8678]: W1204 00:30:18.162845 8678 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 00:30:18.163119 master-0 kubenswrapper[8678]: E1204 00:30:18.162946 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0-master-0\" already exists" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:30:18.185705 master-0 kubenswrapper[8678]: E1204 00:30:18.185667 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-apiserver-master-0\" already exists" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:18.204354 master-0 kubenswrapper[8678]: E1204 00:30:18.204321 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-controller-manager-master-0\" already exists" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:18.228793 master-0 kubenswrapper[8678]: I1204 00:30:18.228740 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:30:18.250338 master-0 kubenswrapper[8678]: I1204 00:30:18.250280 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:30:18.273206 master-0 kubenswrapper[8678]: I1204 00:30:18.273154 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:30:18.288289 master-0 kubenswrapper[8678]: I1204 00:30:18.288248 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:18.311576 master-0 kubenswrapper[8678]: I1204 00:30:18.311464 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:18.327581 master-0 kubenswrapper[8678]: I1204 00:30:18.327546 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.347379 master-0 kubenswrapper[8678]: I1204 00:30:18.347313 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:18.366952 master-0 kubenswrapper[8678]: I1204 00:30:18.366894 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:18.386413 master-0 kubenswrapper[8678]: I1204 00:30:18.386359 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:30:18.411789 master-0 kubenswrapper[8678]: I1204 00:30:18.411740 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:30:18.428064 master-0 kubenswrapper[8678]: I1204 00:30:18.428027 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:18.449007 master-0 kubenswrapper[8678]: I1204 00:30:18.448913 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:18.453802 master-0 kubenswrapper[8678]: I1204 00:30:18.453707 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:18.453952 master-0 kubenswrapper[8678]: I1204 00:30:18.453894 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:18.453993 master-0 kubenswrapper[8678]: I1204 00:30:18.453978 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:18.454053 master-0 kubenswrapper[8678]: I1204 00:30:18.454024 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:18.454393 master-0 kubenswrapper[8678]: E1204 00:30:18.454365 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:18.454467 master-0 kubenswrapper[8678]: E1204 00:30:18.454434 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.454416133 +0000 UTC m=+2.781148899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:18.454467 master-0 kubenswrapper[8678]: E1204 00:30:18.454446 8678 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:18.454553 master-0 kubenswrapper[8678]: E1204 00:30:18.454530 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.454504246 +0000 UTC m=+2.781237012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:18.454632 master-0 kubenswrapper[8678]: E1204 00:30:18.454609 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:18.454674 master-0 kubenswrapper[8678]: E1204 00:30:18.454654 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.45463962 +0000 UTC m=+2.781372406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:18.454754 master-0 kubenswrapper[8678]: E1204 00:30:18.454733 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:18.454792 master-0 kubenswrapper[8678]: E1204 00:30:18.454773 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.454762553 +0000 UTC m=+2.781495379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:18.481045 master-0 kubenswrapper[8678]: I1204 00:30:18.480995 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:30:18.488644 master-0 kubenswrapper[8678]: I1204 00:30:18.488605 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:30:18.508215 master-0 kubenswrapper[8678]: I1204 00:30:18.508175 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:18.529946 master-0 kubenswrapper[8678]: I1204 00:30:18.529829 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.554994 master-0 kubenswrapper[8678]: I1204 00:30:18.554937 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:18.555228 master-0 kubenswrapper[8678]: I1204 00:30:18.555024 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:18.555228 master-0 kubenswrapper[8678]: I1204 00:30:18.555113 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:18.555228 master-0 kubenswrapper[8678]: I1204 00:30:18.555174 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:18.555228 master-0 kubenswrapper[8678]: I1204 00:30:18.555220 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:18.555351 master-0 kubenswrapper[8678]: E1204 00:30:18.555242 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:18.555351 master-0 kubenswrapper[8678]: I1204 00:30:18.555285 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:18.555351 master-0 kubenswrapper[8678]: E1204 00:30:18.555317 8678 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:18.555435 master-0 kubenswrapper[8678]: E1204 00:30:18.555385 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555356845 +0000 UTC m=+2.882089411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:18.555473 master-0 kubenswrapper[8678]: E1204 00:30:18.555421 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:18.555502 master-0 kubenswrapper[8678]: E1204 00:30:18.555485 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:18.555570 master-0 kubenswrapper[8678]: I1204 00:30:18.555344 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:18.555570 master-0 kubenswrapper[8678]: E1204 00:30:18.555523 8678 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:18.555570 master-0 kubenswrapper[8678]: E1204 00:30:18.555541 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:18.555570 master-0 kubenswrapper[8678]: E1204 00:30:18.555432 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555406106 +0000 UTC m=+2.882138662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:18.555735 master-0 kubenswrapper[8678]: E1204 00:30:18.555580 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555568231 +0000 UTC m=+2.882300997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:18.555735 master-0 kubenswrapper[8678]: E1204 00:30:18.555605 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:18.555735 master-0 kubenswrapper[8678]: E1204 00:30:18.555606 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555591822 +0000 UTC m=+2.882324618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:18.555735 master-0 kubenswrapper[8678]: E1204 00:30:18.555633 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555627113 +0000 UTC m=+2.882359669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:18.555735 master-0 kubenswrapper[8678]: E1204 00:30:18.555649 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555643993 +0000 UTC m=+2.882376549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:18.555894 master-0 kubenswrapper[8678]: I1204 00:30:18.555832 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:18.555894 master-0 kubenswrapper[8678]: E1204 00:30:18.555874 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555834548 +0000 UTC m=+2.882567214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:18.555894 master-0 kubenswrapper[8678]: E1204 00:30:18.555889 8678 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:18.556010 master-0 kubenswrapper[8678]: E1204 00:30:18.555940 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.555918111 +0000 UTC m=+2.882650907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:18.556113 master-0 kubenswrapper[8678]: I1204 00:30:18.556073 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:18.556443 master-0 kubenswrapper[8678]: E1204 00:30:18.556413 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:18.556518 master-0 kubenswrapper[8678]: E1204 00:30:18.556495 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:19.556474246 +0000 UTC m=+2.883207002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:18.558310 master-0 kubenswrapper[8678]: I1204 00:30:18.558271 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:18.574734 master-0 kubenswrapper[8678]: I1204 00:30:18.574649 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:30:18.595523 master-0 kubenswrapper[8678]: I1204 00:30:18.595451 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:30:18.608315 master-0 kubenswrapper[8678]: I1204 00:30:18.608277 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:30:18.638336 master-0 kubenswrapper[8678]: I1204 00:30:18.638286 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:30:18.649527 master-0 kubenswrapper[8678]: I1204 00:30:18.649479 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:18.676910 master-0 kubenswrapper[8678]: I1204 00:30:18.676862 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:30:18.688859 master-0 kubenswrapper[8678]: I1204 00:30:18.688828 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:18.707542 master-0 kubenswrapper[8678]: I1204 00:30:18.707495 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:30:18.735161 master-0 kubenswrapper[8678]: I1204 00:30:18.735106 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:18.766877 master-0 kubenswrapper[8678]: I1204 00:30:18.766845 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:30:18.780305 master-0 kubenswrapper[8678]: I1204 00:30:18.777998 8678 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 00:30:18.784657 master-0 kubenswrapper[8678]: I1204 00:30:18.784586 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:18.857602 master-0 kubenswrapper[8678]: I1204 00:30:18.854826 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 00:30:18.857602 master-0 kubenswrapper[8678]: I1204 00:30:18.855569 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 00:30:18.867355 master-0 kubenswrapper[8678]: I1204 00:30:18.860303 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:30:18.867355 master-0 kubenswrapper[8678]: I1204 00:30:18.864903 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:30:19.020158 master-0 kubenswrapper[8678]: I1204 00:30:19.020127 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:19.229063 master-0 kubenswrapper[8678]: I1204 00:30:19.228496 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5f2j"] Dec 04 00:30:19.472870 master-0 kubenswrapper[8678]: I1204 00:30:19.472390 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:19.472870 master-0 kubenswrapper[8678]: I1204 00:30:19.472868 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:19.473207 master-0 kubenswrapper[8678]: I1204 00:30:19.472891 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:19.473207 master-0 kubenswrapper[8678]: I1204 00:30:19.472968 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:19.473207 master-0 kubenswrapper[8678]: E1204 00:30:19.472674 8678 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:19.473207 master-0 kubenswrapper[8678]: E1204 00:30:19.473086 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.473071918 +0000 UTC m=+4.799804474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:19.473501 master-0 kubenswrapper[8678]: E1204 00:30:19.473477 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:19.473548 master-0 kubenswrapper[8678]: E1204 00:30:19.473509 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.47349969 +0000 UTC m=+4.800232246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:19.473548 master-0 kubenswrapper[8678]: E1204 00:30:19.473545 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:19.474241 master-0 kubenswrapper[8678]: E1204 00:30:19.473563 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.473556782 +0000 UTC m=+4.800289338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:19.474241 master-0 kubenswrapper[8678]: E1204 00:30:19.473035 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:19.474241 master-0 kubenswrapper[8678]: E1204 00:30:19.473589 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.473581603 +0000 UTC m=+4.800314169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:19.574206 master-0 kubenswrapper[8678]: I1204 00:30:19.574137 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:19.574206 master-0 kubenswrapper[8678]: I1204 00:30:19.574201 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574228 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574266 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574297 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574315 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574350 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574371 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:19.574467 master-0 kubenswrapper[8678]: I1204 00:30:19.574395 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:19.574686 master-0 kubenswrapper[8678]: E1204 00:30:19.574553 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:19.574686 master-0 kubenswrapper[8678]: E1204 00:30:19.574617 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.574602976 +0000 UTC m=+4.901335532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:19.574954 master-0 kubenswrapper[8678]: E1204 00:30:19.574903 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:19.575527 master-0 kubenswrapper[8678]: E1204 00:30:19.575399 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:19.575595 master-0 kubenswrapper[8678]: E1204 00:30:19.575135 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:19.575595 master-0 kubenswrapper[8678]: E1204 00:30:19.575146 8678 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:19.575595 master-0 kubenswrapper[8678]: E1204 00:30:19.575186 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:19.575595 master-0 kubenswrapper[8678]: E1204 00:30:19.575187 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575263 8678 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575259 8678 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575503 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575476951 +0000 UTC m=+4.902209727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575734 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575684207 +0000 UTC m=+4.902416763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575748 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575741388 +0000 UTC m=+4.902473944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575759 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575754389 +0000 UTC m=+4.902486945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575772 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575764209 +0000 UTC m=+4.902496765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.575999 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.575991705 +0000 UTC m=+4.902724261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.576010 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.576004696 +0000 UTC m=+4.902737242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:19.576558 master-0 kubenswrapper[8678]: E1204 00:30:19.576022 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.576014976 +0000 UTC m=+4.902747532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:19.943179 master-0 kubenswrapper[8678]: I1204 00:30:19.943109 8678 generic.go:334] "Generic (PLEG): container finished" podID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerID="3837531baa035e525c30201df8f109e15bad727f44468701060777db28ba8679" exitCode=0 Dec 04 00:30:19.944383 master-0 kubenswrapper[8678]: I1204 00:30:19.943237 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerDied","Data":"3837531baa035e525c30201df8f109e15bad727f44468701060777db28ba8679"} Dec 04 00:30:19.950614 master-0 kubenswrapper[8678]: I1204 00:30:19.950564 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" event={"ID":"285a1e74-1d8e-452e-a5a4-484afc10e10f","Type":"ContainerStarted","Data":"413a2471e1907fc22f6dd6be4e4024d9156701127dfe71a19a5672b890e28f94"} Dec 04 00:30:19.952426 master-0 kubenswrapper[8678]: I1204 00:30:19.952390 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerStarted","Data":"7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9"} Dec 04 00:30:19.957469 master-0 kubenswrapper[8678]: I1204 00:30:19.957431 8678 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="5b79511f6f6f5a15957be431642dc8264cb31a43f89320f65a7fcad2554571c5" exitCode=0 Dec 04 00:30:19.957555 master-0 kubenswrapper[8678]: I1204 00:30:19.957504 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerDied","Data":"5b79511f6f6f5a15957be431642dc8264cb31a43f89320f65a7fcad2554571c5"} Dec 04 00:30:19.962162 master-0 kubenswrapper[8678]: I1204 00:30:19.962040 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" event={"ID":"ca8eddb5-4600-4058-94d2-5d0308c32613","Type":"ContainerStarted","Data":"53f3ad5a02fe61d14e3118f30603f785f895999675e16d3f4049dea7bd628227"} Dec 04 00:30:19.963073 master-0 kubenswrapper[8678]: I1204 00:30:19.962953 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" event={"ID":"26273240-2261-4564-bb64-1aaf774a921f","Type":"ContainerStarted","Data":"f675877019df3cdc18b7aefe49174ba92d0287bca845b45bc2f441207b0fb5fa"} Dec 04 00:30:19.964124 master-0 kubenswrapper[8678]: I1204 00:30:19.964082 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5f2j" event={"ID":"060f2a39-e40c-495b-885d-5acd967e6c25","Type":"ContainerStarted","Data":"acb414b3c9b1c63e30343e9af518edb3ce52368a177c3b46b2c21183a4bf8daa"} Dec 04 00:30:19.964177 master-0 kubenswrapper[8678]: I1204 00:30:19.964139 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5f2j" event={"ID":"060f2a39-e40c-495b-885d-5acd967e6c25","Type":"ContainerStarted","Data":"278f4b6d18c3dff2a31d66fba4e29fab6ef18d7c261452df63497a5c531805a2"} Dec 04 00:30:19.968019 master-0 kubenswrapper[8678]: I1204 00:30:19.967986 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerStarted","Data":"1f0462fd5b484033d78467a0da74f979aa85d8b25d9599d8df1e60ead439fb2e"} Dec 04 00:30:19.969644 master-0 kubenswrapper[8678]: I1204 00:30:19.969615 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerStarted","Data":"df73f6fd7772f71c1dc73cb2e3646ba79fbf327a83f244a8d49e3d13bf7bcc50"} Dec 04 00:30:19.976646 master-0 kubenswrapper[8678]: I1204 00:30:19.976598 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerStarted","Data":"72ef57cbc2ab2d91c22b8824c0c1162b62192c4d47fd678a0547242b1b0822b4"} Dec 04 00:30:19.986491 master-0 kubenswrapper[8678]: I1204 00:30:19.986068 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" event={"ID":"04f4782e-b152-41c0-870a-08936498d1af","Type":"ContainerStarted","Data":"ef0a1dd8b3b02b9ccc27c7f5e6c342a96866c392b4b7777a54fb8bb661414577"} Dec 04 00:30:19.990952 master-0 kubenswrapper[8678]: I1204 00:30:19.988511 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerStarted","Data":"0db991bc2c684e18f0fe34aa8f75dfa9ac756868127a83baa31a7ad2463083aa"} Dec 04 00:30:20.467423 master-0 kubenswrapper[8678]: I1204 00:30:20.467356 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:20.475938 master-0 kubenswrapper[8678]: I1204 00:30:20.475782 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm"] Dec 04 00:30:20.476175 master-0 kubenswrapper[8678]: E1204 00:30:20.475994 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:30:20.476175 master-0 kubenswrapper[8678]: I1204 00:30:20.476010 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:30:20.476175 master-0 kubenswrapper[8678]: E1204 00:30:20.476062 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:30:20.476175 master-0 kubenswrapper[8678]: I1204 00:30:20.476069 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:30:20.476398 master-0 kubenswrapper[8678]: I1204 00:30:20.476366 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:30:20.476398 master-0 kubenswrapper[8678]: I1204 00:30:20.476386 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="034a82b3-4202-433a-8718-c9f9a33ce2e0" containerName="prober" Dec 04 00:30:20.478163 master-0 kubenswrapper[8678]: I1204 00:30:20.478036 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:30:20.484975 master-0 kubenswrapper[8678]: I1204 00:30:20.484900 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc2xd\" (UniqueName: \"kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd\") pod \"csi-snapshot-controller-86897dd478-8zdrm\" (UID: \"dc7bfc47-972c-4493-8372-f211c6645ff5\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:30:20.493147 master-0 kubenswrapper[8678]: I1204 00:30:20.492797 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm"] Dec 04 00:30:20.520233 master-0 kubenswrapper[8678]: I1204 00:30:20.520143 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:20.588083 master-0 kubenswrapper[8678]: I1204 00:30:20.587886 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pc2xd\" (UniqueName: \"kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd\") pod \"csi-snapshot-controller-86897dd478-8zdrm\" (UID: \"dc7bfc47-972c-4493-8372-f211c6645ff5\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:30:20.616888 master-0 kubenswrapper[8678]: I1204 00:30:20.616814 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc2xd\" (UniqueName: \"kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd\") pod \"csi-snapshot-controller-86897dd478-8zdrm\" (UID: \"dc7bfc47-972c-4493-8372-f211c6645ff5\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:30:20.811188 master-0 kubenswrapper[8678]: I1204 00:30:20.811131 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:30:20.905007 master-0 kubenswrapper[8678]: I1204 00:30:20.903287 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2"] Dec 04 00:30:20.905007 master-0 kubenswrapper[8678]: I1204 00:30:20.904003 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:30:20.905705 master-0 kubenswrapper[8678]: I1204 00:30:20.905658 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 00:30:20.907448 master-0 kubenswrapper[8678]: I1204 00:30:20.907406 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 00:30:20.918915 master-0 kubenswrapper[8678]: I1204 00:30:20.918818 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2"] Dec 04 00:30:20.983720 master-0 kubenswrapper[8678]: I1204 00:30:20.983666 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd"] Dec 04 00:30:20.984724 master-0 kubenswrapper[8678]: I1204 00:30:20.984226 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:20.993400 master-0 kubenswrapper[8678]: I1204 00:30:20.993347 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:30:20.993584 master-0 kubenswrapper[8678]: I1204 00:30:20.993559 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:30:20.993785 master-0 kubenswrapper[8678]: I1204 00:30:20.993759 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:30:20.993921 master-0 kubenswrapper[8678]: I1204 00:30:20.993895 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:30:20.994036 master-0 kubenswrapper[8678]: I1204 00:30:20.994020 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:30:20.995141 master-0 kubenswrapper[8678]: I1204 00:30:20.994129 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:30:21.034097 master-0 kubenswrapper[8678]: I1204 00:30:21.034032 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd"] Dec 04 00:30:21.066788 master-0 kubenswrapper[8678]: I1204 00:30:21.066746 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:21.066788 master-0 kubenswrapper[8678]: I1204 00:30:21.066780 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:21.067640 master-0 kubenswrapper[8678]: I1204 00:30:21.067613 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:21.087818 master-0 kubenswrapper[8678]: I1204 00:30:21.085020 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm"] Dec 04 00:30:21.135947 master-0 kubenswrapper[8678]: I1204 00:30:21.135822 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.136140 master-0 kubenswrapper[8678]: I1204 00:30:21.136009 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwvj6\" (UniqueName: \"kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6\") pod \"migrator-5bcf58cf9c-x5fz2\" (UID: \"7d3c9170-b36d-4052-8ae9-9e549611dbd8\") " pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:30:21.136332 master-0 kubenswrapper[8678]: I1204 00:30:21.136291 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.136459 master-0 kubenswrapper[8678]: I1204 00:30:21.136427 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.136524 master-0 kubenswrapper[8678]: I1204 00:30:21.136474 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz5qf\" (UniqueName: \"kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.136674 master-0 kubenswrapper[8678]: I1204 00:30:21.136584 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.231936 master-0 kubenswrapper[8678]: I1204 00:30:21.231724 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:21.237523 master-0 kubenswrapper[8678]: I1204 00:30:21.237468 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.237659 master-0 kubenswrapper[8678]: I1204 00:30:21.237616 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.237759 master-0 kubenswrapper[8678]: I1204 00:30:21.237695 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvj6\" (UniqueName: \"kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6\") pod \"migrator-5bcf58cf9c-x5fz2\" (UID: \"7d3c9170-b36d-4052-8ae9-9e549611dbd8\") " pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:30:21.237812 master-0 kubenswrapper[8678]: I1204 00:30:21.237772 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.238160 master-0 kubenswrapper[8678]: I1204 00:30:21.237896 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.238206 master-0 kubenswrapper[8678]: I1204 00:30:21.238171 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bz5qf\" (UniqueName: \"kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.238440 master-0 kubenswrapper[8678]: E1204 00:30:21.238406 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: configmap "config" not found Dec 04 00:30:21.238601 master-0 kubenswrapper[8678]: E1204 00:30:21.238585 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.738557795 +0000 UTC m=+5.065290571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "config" not found Dec 04 00:30:21.238704 master-0 kubenswrapper[8678]: E1204 00:30:21.238667 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:21.238781 master-0 kubenswrapper[8678]: E1204 00:30:21.238754 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.738728209 +0000 UTC m=+5.065460805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "client-ca" not found Dec 04 00:30:21.238835 master-0 kubenswrapper[8678]: E1204 00:30:21.238793 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/openshift-global-ca: configmap "openshift-global-ca" not found Dec 04 00:30:21.238970 master-0 kubenswrapper[8678]: E1204 00:30:21.238863 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:21.238970 master-0 kubenswrapper[8678]: E1204 00:30:21.238874 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.738851963 +0000 UTC m=+5.065584769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-ca-bundles" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "openshift-global-ca" not found Dec 04 00:30:21.238970 master-0 kubenswrapper[8678]: E1204 00:30:21.238908 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:21.738893524 +0000 UTC m=+5.065626380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : secret "serving-cert" not found Dec 04 00:30:21.239373 master-0 kubenswrapper[8678]: I1204 00:30:21.239327 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:21.381554 master-0 kubenswrapper[8678]: I1204 00:30:21.381479 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvj6\" (UniqueName: \"kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6\") pod \"migrator-5bcf58cf9c-x5fz2\" (UID: \"7d3c9170-b36d-4052-8ae9-9e549611dbd8\") " pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:30:21.382283 master-0 kubenswrapper[8678]: I1204 00:30:21.382238 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz5qf\" (UniqueName: \"kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.541026 master-0 kubenswrapper[8678]: I1204 00:30:21.540861 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:21.541026 master-0 kubenswrapper[8678]: I1204 00:30:21.540971 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:21.541273 master-0 kubenswrapper[8678]: E1204 00:30:21.541188 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:21.541273 master-0 kubenswrapper[8678]: I1204 00:30:21.541221 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:21.541418 master-0 kubenswrapper[8678]: E1204 00:30:21.541293 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.541271976 +0000 UTC m=+8.868004552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:21.541489 master-0 kubenswrapper[8678]: I1204 00:30:21.541455 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:30:21.541890 master-0 kubenswrapper[8678]: E1204 00:30:21.541835 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:21.543297 master-0 kubenswrapper[8678]: E1204 00:30:21.543236 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.543139738 +0000 UTC m=+8.869872294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:21.543825 master-0 kubenswrapper[8678]: I1204 00:30:21.543791 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:21.544025 master-0 kubenswrapper[8678]: E1204 00:30:21.543994 8678 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:21.544091 master-0 kubenswrapper[8678]: E1204 00:30:21.544074 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.544050244 +0000 UTC m=+8.870782840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:21.544261 master-0 kubenswrapper[8678]: E1204 00:30:21.544206 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:21.544386 master-0 kubenswrapper[8678]: E1204 00:30:21.544352 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.544316162 +0000 UTC m=+8.871048748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:21.644569 master-0 kubenswrapper[8678]: I1204 00:30:21.644512 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:21.644569 master-0 kubenswrapper[8678]: I1204 00:30:21.644584 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644614 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644665 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644694 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644730 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644766 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644790 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:21.644913 master-0 kubenswrapper[8678]: I1204 00:30:21.644851 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.644726 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.644792 8678 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.645228 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645184851 +0000 UTC m=+8.971917407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.644836 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.644878 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.645348 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645304404 +0000 UTC m=+8.972037120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.645383 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645371656 +0000 UTC m=+8.972104472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.645401 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645393267 +0000 UTC m=+8.972125823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:21.645399 master-0 kubenswrapper[8678]: E1204 00:30:21.644918 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645442 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645437068 +0000 UTC m=+8.972169614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "node-tuning-operator-tls" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645007 8678 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645010 8678 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645047 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645058 8678 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645502 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645490739 +0000 UTC m=+8.972223535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645619 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645597362 +0000 UTC m=+8.972329908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645631 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645626073 +0000 UTC m=+8.972358629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:21.646059 master-0 kubenswrapper[8678]: E1204 00:30:21.645642 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert podName:cb121145-3e1a-49da-aac5-822cf65eefcf nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.645636664 +0000 UTC m=+8.972369220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert") pod "cluster-node-tuning-operator-bbd9b9dff-lqlgs" (UID: "cb121145-3e1a-49da-aac5-822cf65eefcf") : secret "performance-addon-operator-webhook-cert" not found Dec 04 00:30:21.678235 master-0 kubenswrapper[8678]: I1204 00:30:21.678176 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:21.726739 master-0 kubenswrapper[8678]: I1204 00:30:21.726657 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2"] Dec 04 00:30:21.736681 master-0 kubenswrapper[8678]: W1204 00:30:21.736598 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3c9170_b36d_4052_8ae9_9e549611dbd8.slice/crio-d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c WatchSource:0}: Error finding container d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c: Status 404 returned error can't find the container with id d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c Dec 04 00:30:21.746548 master-0 kubenswrapper[8678]: I1204 00:30:21.746515 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.746664 master-0 kubenswrapper[8678]: I1204 00:30:21.746643 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.746759 master-0 kubenswrapper[8678]: I1204 00:30:21.746743 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.746828 master-0 kubenswrapper[8678]: I1204 00:30:21.746814 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:21.746972 master-0 kubenswrapper[8678]: E1204 00:30:21.746957 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:21.747131 master-0 kubenswrapper[8678]: E1204 00:30:21.747027 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.747003227 +0000 UTC m=+6.073735783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "client-ca" not found Dec 04 00:30:21.747131 master-0 kubenswrapper[8678]: E1204 00:30:21.747084 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/openshift-global-ca: configmap "openshift-global-ca" not found Dec 04 00:30:21.747131 master-0 kubenswrapper[8678]: E1204 00:30:21.747112 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.74710363 +0000 UTC m=+6.073836196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-ca-bundles" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "openshift-global-ca" not found Dec 04 00:30:21.747234 master-0 kubenswrapper[8678]: E1204 00:30:21.747205 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:21.747266 master-0 kubenswrapper[8678]: E1204 00:30:21.747236 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.747228243 +0000 UTC m=+6.073960809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : secret "serving-cert" not found Dec 04 00:30:21.747295 master-0 kubenswrapper[8678]: E1204 00:30:21.747275 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: configmap "config" not found Dec 04 00:30:21.747323 master-0 kubenswrapper[8678]: E1204 00:30:21.747301 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.747293405 +0000 UTC m=+6.074025961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "config" not found Dec 04 00:30:22.074039 master-0 kubenswrapper[8678]: I1204 00:30:22.073983 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" event={"ID":"7d3c9170-b36d-4052-8ae9-9e549611dbd8","Type":"ContainerStarted","Data":"d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c"} Dec 04 00:30:22.075384 master-0 kubenswrapper[8678]: I1204 00:30:22.075298 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"5e0b72e52dac150f1ad995043cf07f60db4f72faeed42d70d8fc4c8e258d6073"} Dec 04 00:30:22.165657 master-0 kubenswrapper[8678]: I1204 00:30:22.165577 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd"] Dec 04 00:30:22.166227 master-0 kubenswrapper[8678]: E1204 00:30:22.166173 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca config proxy-ca-bundles serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" podUID="c43a3d41-997e-4344-a1ae-7c5711c5e705" Dec 04 00:30:22.174620 master-0 kubenswrapper[8678]: I1204 00:30:22.174575 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l"] Dec 04 00:30:22.176067 master-0 kubenswrapper[8678]: I1204 00:30:22.175263 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.181211 master-0 kubenswrapper[8678]: I1204 00:30:22.181129 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:30:22.181481 master-0 kubenswrapper[8678]: I1204 00:30:22.181268 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:30:22.181627 master-0 kubenswrapper[8678]: I1204 00:30:22.181567 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:30:22.181627 master-0 kubenswrapper[8678]: I1204 00:30:22.181612 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:30:22.181849 master-0 kubenswrapper[8678]: I1204 00:30:22.181812 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:30:22.189278 master-0 kubenswrapper[8678]: I1204 00:30:22.189230 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l"] Dec 04 00:30:22.222613 master-0 kubenswrapper[8678]: I1204 00:30:22.222488 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:22.257347 master-0 kubenswrapper[8678]: I1204 00:30:22.257291 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.257565 master-0 kubenswrapper[8678]: I1204 00:30:22.257459 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8btr\" (UniqueName: \"kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.257666 master-0 kubenswrapper[8678]: I1204 00:30:22.257628 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.257753 master-0 kubenswrapper[8678]: I1204 00:30:22.257677 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.284341 master-0 kubenswrapper[8678]: I1204 00:30:22.284255 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:22.289743 master-0 kubenswrapper[8678]: I1204 00:30:22.289712 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:22.358290 master-0 kubenswrapper[8678]: I1204 00:30:22.358238 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v8btr\" (UniqueName: \"kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.358556 master-0 kubenswrapper[8678]: I1204 00:30:22.358332 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.358556 master-0 kubenswrapper[8678]: I1204 00:30:22.358362 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.358556 master-0 kubenswrapper[8678]: I1204 00:30:22.358484 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.358687 master-0 kubenswrapper[8678]: E1204 00:30:22.358665 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:22.358745 master-0 kubenswrapper[8678]: E1204 00:30:22.358723 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.858707406 +0000 UTC m=+6.185439962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:22.359060 master-0 kubenswrapper[8678]: E1204 00:30:22.358994 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:22.359151 master-0 kubenswrapper[8678]: E1204 00:30:22.359118 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:22.859084257 +0000 UTC m=+6.185816973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:22.361569 master-0 kubenswrapper[8678]: I1204 00:30:22.361521 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.393442 master-0 kubenswrapper[8678]: I1204 00:30:22.393384 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8btr\" (UniqueName: \"kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.544589 master-0 kubenswrapper[8678]: I1204 00:30:22.543175 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-6b8bb995f7-rwmbh"] Dec 04 00:30:22.544589 master-0 kubenswrapper[8678]: I1204 00:30:22.543693 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.550733 master-0 kubenswrapper[8678]: I1204 00:30:22.550684 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 00:30:22.551808 master-0 kubenswrapper[8678]: I1204 00:30:22.551757 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 00:30:22.555786 master-0 kubenswrapper[8678]: I1204 00:30:22.555734 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 00:30:22.558079 master-0 kubenswrapper[8678]: I1204 00:30:22.558031 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-6b8bb995f7-rwmbh"] Dec 04 00:30:22.560601 master-0 kubenswrapper[8678]: I1204 00:30:22.560568 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxjm\" (UniqueName: \"kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.560709 master-0 kubenswrapper[8678]: I1204 00:30:22.560678 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.561049 master-0 kubenswrapper[8678]: I1204 00:30:22.561017 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.578507 master-0 kubenswrapper[8678]: I1204 00:30:22.578412 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 00:30:22.661959 master-0 kubenswrapper[8678]: I1204 00:30:22.661777 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-khxjm\" (UniqueName: \"kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.662216 master-0 kubenswrapper[8678]: I1204 00:30:22.661959 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.662288 master-0 kubenswrapper[8678]: I1204 00:30:22.662247 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.664166 master-0 kubenswrapper[8678]: I1204 00:30:22.662787 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.666976 master-0 kubenswrapper[8678]: I1204 00:30:22.666020 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.682491 master-0 kubenswrapper[8678]: I1204 00:30:22.682446 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxjm\" (UniqueName: \"kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:22.763664 master-0 kubenswrapper[8678]: I1204 00:30:22.763592 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.763865 master-0 kubenswrapper[8678]: I1204 00:30:22.763730 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.763865 master-0 kubenswrapper[8678]: E1204 00:30:22.763776 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:22.763865 master-0 kubenswrapper[8678]: I1204 00:30:22.763833 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.763865 master-0 kubenswrapper[8678]: E1204 00:30:22.763840 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:24.76382242 +0000 UTC m=+8.090554976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : secret "serving-cert" not found Dec 04 00:30:22.764016 master-0 kubenswrapper[8678]: I1204 00:30:22.763980 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.764053 master-0 kubenswrapper[8678]: E1204 00:30:22.764014 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:22.764206 master-0 kubenswrapper[8678]: E1204 00:30:22.764128 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca podName:c43a3d41-997e-4344-a1ae-7c5711c5e705 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:24.764097588 +0000 UTC m=+8.090830334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca") pod "controller-manager-56fb5cd58b-mqhzd" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705") : configmap "client-ca" not found Dec 04 00:30:22.764598 master-0 kubenswrapper[8678]: I1204 00:30:22.764560 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.765809 master-0 kubenswrapper[8678]: I1204 00:30:22.765747 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"controller-manager-56fb5cd58b-mqhzd\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:22.865814 master-0 kubenswrapper[8678]: I1204 00:30:22.865762 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.866040 master-0 kubenswrapper[8678]: I1204 00:30:22.865948 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:22.866040 master-0 kubenswrapper[8678]: E1204 00:30:22.865956 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:22.866148 master-0 kubenswrapper[8678]: E1204 00:30:22.866051 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:23.866025887 +0000 UTC m=+7.192758453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:22.866148 master-0 kubenswrapper[8678]: E1204 00:30:22.866099 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:22.866230 master-0 kubenswrapper[8678]: E1204 00:30:22.866178 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:23.866155231 +0000 UTC m=+7.192888007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:22.888849 master-0 kubenswrapper[8678]: I1204 00:30:22.888802 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:30:23.079320 master-0 kubenswrapper[8678]: I1204 00:30:23.079232 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:23.079748 master-0 kubenswrapper[8678]: I1204 00:30:23.079585 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm8h9" event={"ID":"edd7cfb0-df67-4978-adca-9b917d3b5708","Type":"ContainerStarted","Data":"d25754acce0becb7f7e5bc7233e8404aec4d774030e59de5fa07c8b5c433a763"} Dec 04 00:30:23.085938 master-0 kubenswrapper[8678]: I1204 00:30:23.085015 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:30:23.086431 master-0 kubenswrapper[8678]: I1204 00:30:23.086399 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:23.169468 master-0 kubenswrapper[8678]: I1204 00:30:23.169418 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") pod \"c43a3d41-997e-4344-a1ae-7c5711c5e705\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " Dec 04 00:30:23.169658 master-0 kubenswrapper[8678]: I1204 00:30:23.169496 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") pod \"c43a3d41-997e-4344-a1ae-7c5711c5e705\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " Dec 04 00:30:23.169658 master-0 kubenswrapper[8678]: I1204 00:30:23.169550 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz5qf\" (UniqueName: \"kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf\") pod \"c43a3d41-997e-4344-a1ae-7c5711c5e705\" (UID: \"c43a3d41-997e-4344-a1ae-7c5711c5e705\") " Dec 04 00:30:23.171011 master-0 kubenswrapper[8678]: I1204 00:30:23.170966 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config" (OuterVolumeSpecName: "config") pod "c43a3d41-997e-4344-a1ae-7c5711c5e705" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:23.171379 master-0 kubenswrapper[8678]: I1204 00:30:23.171338 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "c43a3d41-997e-4344-a1ae-7c5711c5e705" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:23.173676 master-0 kubenswrapper[8678]: I1204 00:30:23.173347 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf" (OuterVolumeSpecName: "kube-api-access-bz5qf") pod "c43a3d41-997e-4344-a1ae-7c5711c5e705" (UID: "c43a3d41-997e-4344-a1ae-7c5711c5e705"). InnerVolumeSpecName "kube-api-access-bz5qf". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:30:23.271359 master-0 kubenswrapper[8678]: I1204 00:30:23.271308 8678 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:23.271359 master-0 kubenswrapper[8678]: I1204 00:30:23.271353 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:23.271359 master-0 kubenswrapper[8678]: I1204 00:30:23.271370 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bz5qf\" (UniqueName: \"kubernetes.io/projected/c43a3d41-997e-4344-a1ae-7c5711c5e705-kube-api-access-bz5qf\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:23.487954 master-0 kubenswrapper[8678]: I1204 00:30:23.486651 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:23.487954 master-0 kubenswrapper[8678]: I1204 00:30:23.487263 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:23.487954 master-0 kubenswrapper[8678]: I1204 00:30:23.487278 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:23.505946 master-0 kubenswrapper[8678]: I1204 00:30:23.505632 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:23.608801 master-0 kubenswrapper[8678]: I1204 00:30:23.608733 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:23.610894 master-0 kubenswrapper[8678]: I1204 00:30:23.608898 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:23.881141 master-0 kubenswrapper[8678]: I1204 00:30:23.881085 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:23.881366 master-0 kubenswrapper[8678]: I1204 00:30:23.881247 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:23.881405 master-0 kubenswrapper[8678]: E1204 00:30:23.881397 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:23.881467 master-0 kubenswrapper[8678]: E1204 00:30:23.881448 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.881434109 +0000 UTC m=+9.208166665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:23.881719 master-0 kubenswrapper[8678]: E1204 00:30:23.881671 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:23.881901 master-0 kubenswrapper[8678]: E1204 00:30:23.881868 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.88183073 +0000 UTC m=+9.208563286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:24.080384 master-0 kubenswrapper[8678]: I1204 00:30:24.080320 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:24.083349 master-0 kubenswrapper[8678]: I1204 00:30:24.083315 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd" Dec 04 00:30:24.083415 master-0 kubenswrapper[8678]: I1204 00:30:24.083380 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:24.085550 master-0 kubenswrapper[8678]: I1204 00:30:24.085496 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:24.087182 master-0 kubenswrapper[8678]: I1204 00:30:24.087137 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:24.146167 master-0 kubenswrapper[8678]: I1204 00:30:24.145871 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd"] Dec 04 00:30:24.150019 master-0 kubenswrapper[8678]: I1204 00:30:24.149315 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-56fb5cd58b-mqhzd"] Dec 04 00:30:24.185666 master-0 kubenswrapper[8678]: I1204 00:30:24.185583 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c43a3d41-997e-4344-a1ae-7c5711c5e705-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:24.185666 master-0 kubenswrapper[8678]: I1204 00:30:24.185625 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c43a3d41-997e-4344-a1ae-7c5711c5e705-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:24.422909 master-0 kubenswrapper[8678]: I1204 00:30:24.422870 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-6b8bb995f7-rwmbh"] Dec 04 00:30:24.431681 master-0 kubenswrapper[8678]: W1204 00:30:24.431642 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29db06e4_26c0_45e4_ba90_509f51cad1a2.slice/crio-3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3 WatchSource:0}: Error finding container 3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3: Status 404 returned error can't find the container with id 3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3 Dec 04 00:30:24.867708 master-0 kubenswrapper[8678]: I1204 00:30:24.856521 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43a3d41-997e-4344-a1ae-7c5711c5e705" path="/var/lib/kubelet/pods/c43a3d41-997e-4344-a1ae-7c5711c5e705/volumes" Dec 04 00:30:25.036051 master-0 kubenswrapper[8678]: I1204 00:30:25.035975 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-7867f9586b-dg7tn"] Dec 04 00:30:25.037016 master-0 kubenswrapper[8678]: I1204 00:30:25.036977 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.042805 master-0 kubenswrapper[8678]: I1204 00:30:25.042736 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:30:25.043288 master-0 kubenswrapper[8678]: I1204 00:30:25.043201 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:30:25.043415 master-0 kubenswrapper[8678]: I1204 00:30:25.043372 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:30:25.044839 master-0 kubenswrapper[8678]: I1204 00:30:25.044798 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:30:25.045055 master-0 kubenswrapper[8678]: I1204 00:30:25.045022 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:30:25.054306 master-0 kubenswrapper[8678]: I1204 00:30:25.054233 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:30:25.059393 master-0 kubenswrapper[8678]: I1204 00:30:25.059343 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-7867f9586b-dg7tn"] Dec 04 00:30:25.094565 master-0 kubenswrapper[8678]: I1204 00:30:25.094459 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" event={"ID":"7d3c9170-b36d-4052-8ae9-9e549611dbd8","Type":"ContainerStarted","Data":"3e10c6be198b1c31010f89d6f44e4d7c72f16bb99bee9b55f8ccab72abc036bc"} Dec 04 00:30:25.094565 master-0 kubenswrapper[8678]: I1204 00:30:25.094562 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" event={"ID":"7d3c9170-b36d-4052-8ae9-9e549611dbd8","Type":"ContainerStarted","Data":"cfc983de801d13fa344be8ec22236f3250d3ac8aeb8e6fb7bdbc76c8a2a8d4d3"} Dec 04 00:30:25.097482 master-0 kubenswrapper[8678]: I1204 00:30:25.097163 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb"} Dec 04 00:30:25.101183 master-0 kubenswrapper[8678]: I1204 00:30:25.101141 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.101183 master-0 kubenswrapper[8678]: I1204 00:30:25.101178 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7d7\" (UniqueName: \"kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.101306 master-0 kubenswrapper[8678]: I1204 00:30:25.101264 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.101368 master-0 kubenswrapper[8678]: I1204 00:30:25.101334 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.101474 master-0 kubenswrapper[8678]: I1204 00:30:25.101440 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.101607 master-0 kubenswrapper[8678]: I1204 00:30:25.101576 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerStarted","Data":"b8185fde18a9eb9676dbfdd093ee8f19900d0fde6a1013953667e65a89842339"} Dec 04 00:30:25.101817 master-0 kubenswrapper[8678]: I1204 00:30:25.101773 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:25.104948 master-0 kubenswrapper[8678]: I1204 00:30:25.104860 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" event={"ID":"29db06e4-26c0-45e4-ba90-509f51cad1a2","Type":"ContainerStarted","Data":"424502a5227056c566845d24bfb829be46563652d57707e9bcb00b5cb331cfba"} Dec 04 00:30:25.104948 master-0 kubenswrapper[8678]: I1204 00:30:25.104901 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" event={"ID":"29db06e4-26c0-45e4-ba90-509f51cad1a2","Type":"ContainerStarted","Data":"3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3"} Dec 04 00:30:25.108200 master-0 kubenswrapper[8678]: I1204 00:30:25.108161 8678 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="017e9a364c8fd1a8d900be61811c2dd5a07ba68a7d515a2e3499b10d06214e39" exitCode=0 Dec 04 00:30:25.108298 master-0 kubenswrapper[8678]: I1204 00:30:25.108283 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:25.110275 master-0 kubenswrapper[8678]: I1204 00:30:25.110245 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerDied","Data":"017e9a364c8fd1a8d900be61811c2dd5a07ba68a7d515a2e3499b10d06214e39"} Dec 04 00:30:25.116131 master-0 kubenswrapper[8678]: I1204 00:30:25.116020 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" podStartSLOduration=2.536403868 podStartE2EDuration="5.115986861s" podCreationTimestamp="2025-12-04 00:30:20 +0000 UTC" firstStartedPulling="2025-12-04 00:30:21.740211976 +0000 UTC m=+5.066944552" lastFinishedPulling="2025-12-04 00:30:24.319794989 +0000 UTC m=+7.646527545" observedRunningTime="2025-12-04 00:30:25.115323002 +0000 UTC m=+8.442055558" watchObservedRunningTime="2025-12-04 00:30:25.115986861 +0000 UTC m=+8.442719437" Dec 04 00:30:25.121201 master-0 kubenswrapper[8678]: I1204 00:30:25.117671 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:25.157575 master-0 kubenswrapper[8678]: I1204 00:30:25.157454 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podStartSLOduration=2.027582495 podStartE2EDuration="5.157422758s" podCreationTimestamp="2025-12-04 00:30:20 +0000 UTC" firstStartedPulling="2025-12-04 00:30:21.119327738 +0000 UTC m=+4.446060294" lastFinishedPulling="2025-12-04 00:30:24.249168001 +0000 UTC m=+7.575900557" observedRunningTime="2025-12-04 00:30:25.155988057 +0000 UTC m=+8.482720623" watchObservedRunningTime="2025-12-04 00:30:25.157422758 +0000 UTC m=+8.484155324" Dec 04 00:30:25.204117 master-0 kubenswrapper[8678]: I1204 00:30:25.204040 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.204315 master-0 kubenswrapper[8678]: I1204 00:30:25.204137 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.204438 master-0 kubenswrapper[8678]: I1204 00:30:25.204409 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.204600 master-0 kubenswrapper[8678]: I1204 00:30:25.204567 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.204660 master-0 kubenswrapper[8678]: I1204 00:30:25.204623 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7d7\" (UniqueName: \"kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.204966 master-0 kubenswrapper[8678]: I1204 00:30:25.204876 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" podStartSLOduration=3.204847643 podStartE2EDuration="3.204847643s" podCreationTimestamp="2025-12-04 00:30:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:25.203439163 +0000 UTC m=+8.530171719" watchObservedRunningTime="2025-12-04 00:30:25.204847643 +0000 UTC m=+8.531580299" Dec 04 00:30:25.206555 master-0 kubenswrapper[8678]: E1204 00:30:25.206514 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:25.206608 master-0 kubenswrapper[8678]: E1204 00:30:25.206600 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.706573251 +0000 UTC m=+9.033305807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:25.206920 master-0 kubenswrapper[8678]: E1204 00:30:25.206518 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:25.206990 master-0 kubenswrapper[8678]: E1204 00:30:25.206961 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:25.706950272 +0000 UTC m=+9.033682828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : secret "serving-cert" not found Dec 04 00:30:25.208651 master-0 kubenswrapper[8678]: I1204 00:30:25.208621 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.209013 master-0 kubenswrapper[8678]: I1204 00:30:25.208981 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.259432 master-0 kubenswrapper[8678]: I1204 00:30:25.259178 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7d7\" (UniqueName: \"kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.608632 master-0 kubenswrapper[8678]: I1204 00:30:25.608569 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:25.608632 master-0 kubenswrapper[8678]: I1204 00:30:25.608636 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: I1204 00:30:25.608745 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.608788 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: I1204 00:30:25.608856 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.608873 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.608893 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.608876 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.608853455 +0000 UTC m=+16.935586011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.608957 8678 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.609001 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls podName:c0f3ded2-925e-4d86-9c91-55b5df9f28ab nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.608979759 +0000 UTC m=+16.935712535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls") pod "ingress-operator-85dbd94574-7clvx" (UID: "c0f3ded2-925e-4d86-9c91-55b5df9f28ab") : secret "metrics-tls" not found Dec 04 00:30:25.609021 master-0 kubenswrapper[8678]: E1204 00:30:25.609029 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.60902112 +0000 UTC m=+16.935753926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:25.609379 master-0 kubenswrapper[8678]: E1204 00:30:25.609050 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.60904296 +0000 UTC m=+16.935775756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:25.710257 master-0 kubenswrapper[8678]: I1204 00:30:25.709995 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:25.710257 master-0 kubenswrapper[8678]: I1204 00:30:25.710245 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710294 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710322 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710347 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710373 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710397 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710422 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710447 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710487 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:25.710625 master-0 kubenswrapper[8678]: I1204 00:30:25.710531 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.710688 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.710752 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.710732983 +0000 UTC m=+17.037465539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.711074 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.711100 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.711092563 +0000 UTC m=+17.037825119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.711139 8678 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 00:30:25.711194 master-0 kubenswrapper[8678]: E1204 00:30:25.711158 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls podName:46a9c1fd-6e78-4d87-85ef-f8fc195bb980 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.711151655 +0000 UTC m=+17.037884211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls") pod "cluster-image-registry-operator-65dc4bcb88-2m45m" (UID: "46a9c1fd-6e78-4d87-85ef-f8fc195bb980") : secret "image-registry-operator-tls" not found Dec 04 00:30:25.711629 master-0 kubenswrapper[8678]: E1204 00:30:25.711551 8678 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:25.711709 master-0 kubenswrapper[8678]: E1204 00:30:25.711667 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert podName:89be8775-ded0-4680-ae6f-3c60575ad4b8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.711635278 +0000 UTC m=+17.038368004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert") pod "cluster-version-operator-869c786959-rg92r" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8") : secret "cluster-version-operator-serving-cert" not found Dec 04 00:30:25.711811 master-0 kubenswrapper[8678]: E1204 00:30:25.711747 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:25.711881 master-0 kubenswrapper[8678]: E1204 00:30:25.711816 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:26.711805483 +0000 UTC m=+10.038538249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : secret "serving-cert" not found Dec 04 00:30:25.711973 master-0 kubenswrapper[8678]: E1204 00:30:25.711890 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:25.711973 master-0 kubenswrapper[8678]: E1204 00:30:25.711945 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:26.711915506 +0000 UTC m=+10.038648282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:25.712115 master-0 kubenswrapper[8678]: E1204 00:30:25.712026 8678 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 00:30:25.712115 master-0 kubenswrapper[8678]: E1204 00:30:25.712063 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls podName:e8375dfa-3a83-415b-bce5-0819a73255c1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.71205315 +0000 UTC m=+17.038785926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls") pod "dns-operator-6b7bcd6566-v5f4p" (UID: "e8375dfa-3a83-415b-bce5-0819a73255c1") : secret "metrics-tls" not found Dec 04 00:30:25.712244 master-0 kubenswrapper[8678]: E1204 00:30:25.712152 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:25.712244 master-0 kubenswrapper[8678]: E1204 00:30:25.712187 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.712176974 +0000 UTC m=+17.038909750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:25.712362 master-0 kubenswrapper[8678]: E1204 00:30:25.712254 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:25.712362 master-0 kubenswrapper[8678]: E1204 00:30:25.712285 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.712276026 +0000 UTC m=+17.039008812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:25.717021 master-0 kubenswrapper[8678]: I1204 00:30:25.716312 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:25.717021 master-0 kubenswrapper[8678]: I1204 00:30:25.716686 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:25.913968 master-0 kubenswrapper[8678]: I1204 00:30:25.913785 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:25.913968 master-0 kubenswrapper[8678]: I1204 00:30:25.913953 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:25.914308 master-0 kubenswrapper[8678]: E1204 00:30:25.914016 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:25.914308 master-0 kubenswrapper[8678]: E1204 00:30:25.914044 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:25.914308 master-0 kubenswrapper[8678]: E1204 00:30:25.914099 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:29.914076547 +0000 UTC m=+13.240809103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:25.914503 master-0 kubenswrapper[8678]: E1204 00:30:25.914491 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:29.914110988 +0000 UTC m=+13.240843544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:25.917595 master-0 kubenswrapper[8678]: I1204 00:30:25.917519 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:30:25.967941 master-0 kubenswrapper[8678]: I1204 00:30:25.967851 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:25.978817 master-0 kubenswrapper[8678]: I1204 00:30:25.978713 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:30:26.090990 master-0 kubenswrapper[8678]: I1204 00:30:26.090707 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:26.090990 master-0 kubenswrapper[8678]: I1204 00:30:26.090886 8678 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:30:26.125072 master-0 kubenswrapper[8678]: I1204 00:30:26.125018 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:30:26.178160 master-0 kubenswrapper[8678]: I1204 00:30:26.178007 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs"] Dec 04 00:30:26.185129 master-0 kubenswrapper[8678]: W1204 00:30:26.185077 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb121145_3e1a_49da_aac5_822cf65eefcf.slice/crio-36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd WatchSource:0}: Error finding container 36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd: Status 404 returned error can't find the container with id 36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd Dec 04 00:30:26.730321 master-0 kubenswrapper[8678]: I1204 00:30:26.730095 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:26.730321 master-0 kubenswrapper[8678]: I1204 00:30:26.730152 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:26.730615 master-0 kubenswrapper[8678]: E1204 00:30:26.730356 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:26.730615 master-0 kubenswrapper[8678]: E1204 00:30:26.730422 8678 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:26.730615 master-0 kubenswrapper[8678]: E1204 00:30:26.730460 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:28.730434187 +0000 UTC m=+12.057166743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:26.730747 master-0 kubenswrapper[8678]: E1204 00:30:26.730704 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:28.730644623 +0000 UTC m=+12.057377179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : secret "serving-cert" not found Dec 04 00:30:27.127657 master-0 kubenswrapper[8678]: I1204 00:30:27.127019 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" event={"ID":"cb121145-3e1a-49da-aac5-822cf65eefcf","Type":"ContainerStarted","Data":"36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd"} Dec 04 00:30:27.515433 master-0 kubenswrapper[8678]: I1204 00:30:27.515308 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:28.133420 master-0 kubenswrapper[8678]: I1204 00:30:28.133333 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerStarted","Data":"8e8f5449f755cdd9f6b1dc599c52378d1c1b713586f918b973c248f56af9f3b3"} Dec 04 00:30:28.760844 master-0 kubenswrapper[8678]: I1204 00:30:28.760391 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:28.761093 master-0 kubenswrapper[8678]: I1204 00:30:28.760865 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:28.761143 master-0 kubenswrapper[8678]: E1204 00:30:28.761094 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:28.761218 master-0 kubenswrapper[8678]: E1204 00:30:28.761199 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:32.76117417 +0000 UTC m=+16.087906736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:28.767825 master-0 kubenswrapper[8678]: I1204 00:30:28.767783 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:29.139548 master-0 kubenswrapper[8678]: I1204 00:30:29.139486 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-589f5cdc9d-vqmbm_2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/cluster-olm-operator/0.log" Dec 04 00:30:29.140608 master-0 kubenswrapper[8678]: I1204 00:30:29.140567 8678 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="8e8f5449f755cdd9f6b1dc599c52378d1c1b713586f918b973c248f56af9f3b3" exitCode=255 Dec 04 00:30:29.140708 master-0 kubenswrapper[8678]: I1204 00:30:29.140619 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerDied","Data":"8e8f5449f755cdd9f6b1dc599c52378d1c1b713586f918b973c248f56af9f3b3"} Dec 04 00:30:29.141117 master-0 kubenswrapper[8678]: I1204 00:30:29.141094 8678 scope.go:117] "RemoveContainer" containerID="8e8f5449f755cdd9f6b1dc599c52378d1c1b713586f918b973c248f56af9f3b3" Dec 04 00:30:29.979397 master-0 kubenswrapper[8678]: I1204 00:30:29.979321 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:29.979708 master-0 kubenswrapper[8678]: I1204 00:30:29.979429 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:29.979708 master-0 kubenswrapper[8678]: E1204 00:30:29.979553 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:29.979708 master-0 kubenswrapper[8678]: E1204 00:30:29.979609 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:37.979591458 +0000 UTC m=+21.306324024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:29.979973 master-0 kubenswrapper[8678]: E1204 00:30:29.979745 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:29.979973 master-0 kubenswrapper[8678]: E1204 00:30:29.979841 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:37.979820505 +0000 UTC m=+21.306553251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:30.154334 master-0 kubenswrapper[8678]: I1204 00:30:30.154195 8678 generic.go:334] "Generic (PLEG): container finished" podID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerID="b8185fde18a9eb9676dbfdd093ee8f19900d0fde6a1013953667e65a89842339" exitCode=0 Dec 04 00:30:30.154334 master-0 kubenswrapper[8678]: I1204 00:30:30.154265 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerDied","Data":"b8185fde18a9eb9676dbfdd093ee8f19900d0fde6a1013953667e65a89842339"} Dec 04 00:30:30.158155 master-0 kubenswrapper[8678]: I1204 00:30:30.154663 8678 scope.go:117] "RemoveContainer" containerID="b8185fde18a9eb9676dbfdd093ee8f19900d0fde6a1013953667e65a89842339" Dec 04 00:30:30.163351 master-0 kubenswrapper[8678]: I1204 00:30:30.163309 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-589f5cdc9d-vqmbm_2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/cluster-olm-operator/0.log" Dec 04 00:30:30.164339 master-0 kubenswrapper[8678]: I1204 00:30:30.164309 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerStarted","Data":"cf24040c300df106253834dddfb5503ac540d510ceeea8af9fdc130d4568b9b1"} Dec 04 00:30:30.390757 master-0 kubenswrapper[8678]: I1204 00:30:30.390671 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:30.509602 master-0 kubenswrapper[8678]: I1204 00:30:30.509473 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:31.723269 master-0 kubenswrapper[8678]: I1204 00:30:31.723206 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-7b5fd5f747-kz9ss"] Dec 04 00:30:31.724158 master-0 kubenswrapper[8678]: I1204 00:30:31.723959 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.725883 master-0 kubenswrapper[8678]: I1204 00:30:31.725853 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 00:30:31.726773 master-0 kubenswrapper[8678]: I1204 00:30:31.726733 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 00:30:31.727292 master-0 kubenswrapper[8678]: I1204 00:30:31.727246 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 00:30:31.729752 master-0 kubenswrapper[8678]: I1204 00:30:31.727858 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 00:30:31.729752 master-0 kubenswrapper[8678]: I1204 00:30:31.728131 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 00:30:31.729752 master-0 kubenswrapper[8678]: I1204 00:30:31.728185 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-0" Dec 04 00:30:31.729752 master-0 kubenswrapper[8678]: I1204 00:30:31.728736 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-0" Dec 04 00:30:31.729752 master-0 kubenswrapper[8678]: I1204 00:30:31.729093 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 00:30:31.731119 master-0 kubenswrapper[8678]: I1204 00:30:31.731078 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 00:30:31.735618 master-0 kubenswrapper[8678]: I1204 00:30:31.735573 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 00:30:31.742458 master-0 kubenswrapper[8678]: I1204 00:30:31.740441 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-7b5fd5f747-kz9ss"] Dec 04 00:30:31.809501 master-0 kubenswrapper[8678]: I1204 00:30:31.809426 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809501 master-0 kubenswrapper[8678]: I1204 00:30:31.809500 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809769 master-0 kubenswrapper[8678]: I1204 00:30:31.809620 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809769 master-0 kubenswrapper[8678]: I1204 00:30:31.809685 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809769 master-0 kubenswrapper[8678]: I1204 00:30:31.809747 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809887 master-0 kubenswrapper[8678]: I1204 00:30:31.809796 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.809887 master-0 kubenswrapper[8678]: I1204 00:30:31.809848 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kwmn\" (UniqueName: \"kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.810062 master-0 kubenswrapper[8678]: I1204 00:30:31.810030 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.810123 master-0 kubenswrapper[8678]: I1204 00:30:31.810067 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.810123 master-0 kubenswrapper[8678]: I1204 00:30:31.810102 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.810197 master-0 kubenswrapper[8678]: I1204 00:30:31.810163 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911582 master-0 kubenswrapper[8678]: I1204 00:30:31.911532 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911686 master-0 kubenswrapper[8678]: I1204 00:30:31.911596 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911686 master-0 kubenswrapper[8678]: I1204 00:30:31.911651 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911788 master-0 kubenswrapper[8678]: I1204 00:30:31.911741 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911788 master-0 kubenswrapper[8678]: I1204 00:30:31.911762 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911872 master-0 kubenswrapper[8678]: I1204 00:30:31.911799 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kwmn\" (UniqueName: \"kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911911 master-0 kubenswrapper[8678]: I1204 00:30:31.911892 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.911984 master-0 kubenswrapper[8678]: I1204 00:30:31.911948 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912028 master-0 kubenswrapper[8678]: I1204 00:30:31.911988 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912075 master-0 kubenswrapper[8678]: I1204 00:30:31.912052 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912119 master-0 kubenswrapper[8678]: I1204 00:30:31.912106 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912160 master-0 kubenswrapper[8678]: I1204 00:30:31.912135 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912373 master-0 kubenswrapper[8678]: I1204 00:30:31.912326 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.912774 master-0 kubenswrapper[8678]: E1204 00:30:31.912432 8678 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 00:30:31.912774 master-0 kubenswrapper[8678]: E1204 00:30:31.912490 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:32.412471117 +0000 UTC m=+15.739203673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : configmap "audit-0" not found Dec 04 00:30:31.913114 master-0 kubenswrapper[8678]: I1204 00:30:31.913081 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.913257 master-0 kubenswrapper[8678]: I1204 00:30:31.913233 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.913730 master-0 kubenswrapper[8678]: E1204 00:30:31.913420 8678 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 00:30:31.913801 master-0 kubenswrapper[8678]: E1204 00:30:31.913748 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:32.413739172 +0000 UTC m=+15.740471728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : secret "serving-cert" not found Dec 04 00:30:31.914041 master-0 kubenswrapper[8678]: I1204 00:30:31.914008 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.914681 master-0 kubenswrapper[8678]: I1204 00:30:31.914648 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.916083 master-0 kubenswrapper[8678]: I1204 00:30:31.916052 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.916537 master-0 kubenswrapper[8678]: I1204 00:30:31.916503 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:31.935824 master-0 kubenswrapper[8678]: I1204 00:30:31.935792 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kwmn\" (UniqueName: \"kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:32.174250 master-0 kubenswrapper[8678]: I1204 00:30:32.174172 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" event={"ID":"cb121145-3e1a-49da-aac5-822cf65eefcf","Type":"ContainerStarted","Data":"f20da8400c336d34fe4b807aa7ddfc6b03001cf06f4172fd2e33bddf36815af7"} Dec 04 00:30:32.177916 master-0 kubenswrapper[8678]: I1204 00:30:32.177860 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerStarted","Data":"381b0d861d6cea3e99674d5dcd82176cb0cef0ec90d4b9a314a1938f78d4a9f5"} Dec 04 00:30:32.178447 master-0 kubenswrapper[8678]: I1204 00:30:32.178411 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:32.366294 master-0 kubenswrapper[8678]: I1204 00:30:32.366229 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-df7ld"] Dec 04 00:30:32.371820 master-0 kubenswrapper[8678]: I1204 00:30:32.371748 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419030 master-0 kubenswrapper[8678]: I1204 00:30:32.418940 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419030 master-0 kubenswrapper[8678]: I1204 00:30:32.419004 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419078 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419104 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419128 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419160 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588cp\" (UniqueName: \"kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419181 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419237 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: E1204 00:30:32.419244 8678 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: I1204 00:30:32.419292 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419330 master-0 kubenswrapper[8678]: E1204 00:30:32.419320 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.419298444 +0000 UTC m=+16.746031010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : secret "serving-cert" not found Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419342 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419384 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419402 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419421 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419450 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419464 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: I1204 00:30:32.419509 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: E1204 00:30:32.419583 8678 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 00:30:32.419600 master-0 kubenswrapper[8678]: E1204 00:30:32.419606 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:33.419599522 +0000 UTC m=+16.746332078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : configmap "audit-0" not found Dec 04 00:30:32.520269 master-0 kubenswrapper[8678]: I1204 00:30:32.520205 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520269 master-0 kubenswrapper[8678]: I1204 00:30:32.520263 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520315 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520335 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520396 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520418 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520451 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520465 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520510 master-0 kubenswrapper[8678]: I1204 00:30:32.520499 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520529 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520589 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520601 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520667 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520683 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520725 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520729 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.520753 master-0 kubenswrapper[8678]: I1204 00:30:32.520579 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-588cp\" (UniqueName: \"kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520778 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520848 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520871 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520892 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520940 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520999 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521010 master-0 kubenswrapper[8678]: I1204 00:30:32.520537 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.521250 master-0 kubenswrapper[8678]: I1204 00:30:32.521216 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.524885 master-0 kubenswrapper[8678]: I1204 00:30:32.524818 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.526996 master-0 kubenswrapper[8678]: I1204 00:30:32.526649 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.540824 master-0 kubenswrapper[8678]: I1204 00:30:32.540780 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-588cp\" (UniqueName: \"kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.693832 master-0 kubenswrapper[8678]: I1204 00:30:32.693758 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:30:32.726118 master-0 kubenswrapper[8678]: W1204 00:30:32.725555 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e8bd47_93e6_4068_a6fb_ba34255103d2.slice/crio-3fd1b0de9a04ead02c05eb478ad2ee044aed1587c5e5fa47e85d4fd240f1e512 WatchSource:0}: Error finding container 3fd1b0de9a04ead02c05eb478ad2ee044aed1587c5e5fa47e85d4fd240f1e512: Status 404 returned error can't find the container with id 3fd1b0de9a04ead02c05eb478ad2ee044aed1587c5e5fa47e85d4fd240f1e512 Dec 04 00:30:32.828722 master-0 kubenswrapper[8678]: I1204 00:30:32.828638 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:32.828996 master-0 kubenswrapper[8678]: E1204 00:30:32.828873 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:32.828996 master-0 kubenswrapper[8678]: E1204 00:30:32.828989 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:40.828962686 +0000 UTC m=+24.155695292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:33.183771 master-0 kubenswrapper[8678]: I1204 00:30:33.183176 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-df7ld" event={"ID":"21e8bd47-93e6-4068-a6fb-ba34255103d2","Type":"ContainerStarted","Data":"50b37e45585b6dc8059f69203c9878d58197f26ef8cbf19557644a7ec2d02bfb"} Dec 04 00:30:33.184020 master-0 kubenswrapper[8678]: I1204 00:30:33.183797 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-df7ld" event={"ID":"21e8bd47-93e6-4068-a6fb-ba34255103d2","Type":"ContainerStarted","Data":"3fd1b0de9a04ead02c05eb478ad2ee044aed1587c5e5fa47e85d4fd240f1e512"} Dec 04 00:30:33.439510 master-0 kubenswrapper[8678]: I1204 00:30:33.439364 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:33.439693 master-0 kubenswrapper[8678]: E1204 00:30:33.439525 8678 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 00:30:33.439693 master-0 kubenswrapper[8678]: I1204 00:30:33.439580 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:33.439693 master-0 kubenswrapper[8678]: E1204 00:30:33.439610 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:35.439587645 +0000 UTC m=+18.766320201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : configmap "audit-0" not found Dec 04 00:30:33.439832 master-0 kubenswrapper[8678]: E1204 00:30:33.439754 8678 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 00:30:33.439869 master-0 kubenswrapper[8678]: E1204 00:30:33.439845 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:35.439818471 +0000 UTC m=+18.766551067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : secret "serving-cert" not found Dec 04 00:30:33.642645 master-0 kubenswrapper[8678]: I1204 00:30:33.642520 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:33.642645 master-0 kubenswrapper[8678]: I1204 00:30:33.642643 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:33.643028 master-0 kubenswrapper[8678]: I1204 00:30:33.642700 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:33.643028 master-0 kubenswrapper[8678]: I1204 00:30:33.642964 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:33.643366 master-0 kubenswrapper[8678]: E1204 00:30:33.643306 8678 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 00:30:33.643448 master-0 kubenswrapper[8678]: E1204 00:30:33.643418 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics podName:aa2eaba9-479e-4420-a24f-63530e4da783 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.643390301 +0000 UTC m=+32.970122887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics") pod "marketplace-operator-7d67745bb7-2qnbf" (UID: "aa2eaba9-479e-4420-a24f-63530e4da783") : secret "marketplace-operator-metrics" not found Dec 04 00:30:33.643878 master-0 kubenswrapper[8678]: E1204 00:30:33.643802 8678 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:33.644039 master-0 kubenswrapper[8678]: E1204 00:30:33.644019 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls podName:f2f01d68-92ae-45b8-8501-645e439b5295 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.643976268 +0000 UTC m=+32.970708944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69cc794c58-5cpjn" (UID: "f2f01d68-92ae-45b8-8501-645e439b5295") : secret "cluster-monitoring-operator-tls" not found Dec 04 00:30:33.644226 master-0 kubenswrapper[8678]: E1204 00:30:33.644146 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 00:30:33.644354 master-0 kubenswrapper[8678]: E1204 00:30:33.644254 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert podName:ffe9d26b-34e2-4506-9c38-69b85ab210a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.644232035 +0000 UTC m=+32.970964831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert") pod "olm-operator-76bd5d69c7-8xfwz" (UID: "ffe9d26b-34e2-4506-9c38-69b85ab210a1") : secret "olm-operator-serving-cert" not found Dec 04 00:30:33.655703 master-0 kubenswrapper[8678]: I1204 00:30:33.655616 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:33.710768 master-0 kubenswrapper[8678]: I1204 00:30:33.710532 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:30:33.744473 master-0 kubenswrapper[8678]: I1204 00:30:33.744419 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:33.745485 master-0 kubenswrapper[8678]: I1204 00:30:33.745162 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:33.745485 master-0 kubenswrapper[8678]: E1204 00:30:33.745328 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 00:30:33.745485 master-0 kubenswrapper[8678]: E1204 00:30:33.745464 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert podName:c79edcd7-4399-4ded-9b03-9084ad9e14b4 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.745446044 +0000 UTC m=+33.072178610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert") pod "package-server-manager-75b4d49d4c-7s5z5" (UID: "c79edcd7-4399-4ded-9b03-9084ad9e14b4") : secret "package-server-manager-serving-cert" not found Dec 04 00:30:33.745961 master-0 kubenswrapper[8678]: I1204 00:30:33.745856 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:33.746101 master-0 kubenswrapper[8678]: I1204 00:30:33.746022 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:33.746306 master-0 kubenswrapper[8678]: I1204 00:30:33.746137 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:33.746420 master-0 kubenswrapper[8678]: I1204 00:30:33.746375 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:33.746528 master-0 kubenswrapper[8678]: E1204 00:30:33.746150 8678 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 00:30:33.746528 master-0 kubenswrapper[8678]: E1204 00:30:33.746489 8678 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 00:30:33.746711 master-0 kubenswrapper[8678]: E1204 00:30:33.746260 8678 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 00:30:33.746711 master-0 kubenswrapper[8678]: I1204 00:30:33.746422 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:33.746711 master-0 kubenswrapper[8678]: E1204 00:30:33.746535 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs podName:b57073bf-c556-4ac2-a0a5-522e4360d493 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.746519614 +0000 UTC m=+33.073252180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs") pod "multus-admission-controller-78ddcf56f9-x5jff" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493") : secret "multus-admission-controller-secret" not found Dec 04 00:30:33.746986 master-0 kubenswrapper[8678]: E1204 00:30:33.746729 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert podName:ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.746685189 +0000 UTC m=+33.073417955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert") pod "catalog-operator-7cf5cf757f-mmb2r" (UID: "ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8") : secret "catalog-operator-serving-cert" not found Dec 04 00:30:33.746986 master-0 kubenswrapper[8678]: E1204 00:30:33.746758 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs podName:9a83a76c-050e-4378-ac3a-1213d6d53773 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:49.746744301 +0000 UTC m=+33.073477107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs") pod "network-metrics-daemon-t85qp" (UID: "9a83a76c-050e-4378-ac3a-1213d6d53773") : secret "metrics-daemon-secret" not found Dec 04 00:30:33.749586 master-0 kubenswrapper[8678]: I1204 00:30:33.749495 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"cluster-version-operator-869c786959-rg92r\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:33.756487 master-0 kubenswrapper[8678]: I1204 00:30:33.756278 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:33.757779 master-0 kubenswrapper[8678]: I1204 00:30:33.757727 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:33.991240 master-0 kubenswrapper[8678]: I1204 00:30:33.990951 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-df7ld" podStartSLOduration=1.990901614 podStartE2EDuration="1.990901614s" podCreationTimestamp="2025-12-04 00:30:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:33.205572087 +0000 UTC m=+16.532304633" watchObservedRunningTime="2025-12-04 00:30:33.990901614 +0000 UTC m=+17.317634190" Dec 04 00:30:33.992356 master-0 kubenswrapper[8678]: I1204 00:30:33.992326 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-85dbd94574-7clvx"] Dec 04 00:30:34.012339 master-0 kubenswrapper[8678]: I1204 00:30:34.012211 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:30:34.012965 master-0 kubenswrapper[8678]: I1204 00:30:34.012907 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:30:34.018146 master-0 kubenswrapper[8678]: I1204 00:30:34.018080 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:30:34.044586 master-0 kubenswrapper[8678]: W1204 00:30:34.043808 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89be8775_ded0_4680_ae6f_3c60575ad4b8.slice/crio-49c276e5e76341df0b5e942bcde97bef23aceeb2719085ccee2f7772e1c03109 WatchSource:0}: Error finding container 49c276e5e76341df0b5e942bcde97bef23aceeb2719085ccee2f7772e1c03109: Status 404 returned error can't find the container with id 49c276e5e76341df0b5e942bcde97bef23aceeb2719085ccee2f7772e1c03109 Dec 04 00:30:34.190921 master-0 kubenswrapper[8678]: I1204 00:30:34.190836 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"2d5b8039b2e09b8e957343170e87c62b622821dee52fef43a91e443c213a1a25"} Dec 04 00:30:34.191916 master-0 kubenswrapper[8678]: I1204 00:30:34.191874 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" event={"ID":"89be8775-ded0-4680-ae6f-3c60575ad4b8","Type":"ContainerStarted","Data":"49c276e5e76341df0b5e942bcde97bef23aceeb2719085ccee2f7772e1c03109"} Dec 04 00:30:34.232230 master-0 kubenswrapper[8678]: I1204 00:30:34.232171 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p"] Dec 04 00:30:34.242333 master-0 kubenswrapper[8678]: W1204 00:30:34.242211 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8375dfa_3a83_415b_bce5_0819a73255c1.slice/crio-1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4 WatchSource:0}: Error finding container 1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4: Status 404 returned error can't find the container with id 1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4 Dec 04 00:30:34.262489 master-0 kubenswrapper[8678]: I1204 00:30:34.262433 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m"] Dec 04 00:30:34.270309 master-0 kubenswrapper[8678]: W1204 00:30:34.270258 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a9c1fd_6e78_4d87_85ef_f8fc195bb980.slice/crio-d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938 WatchSource:0}: Error finding container d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938: Status 404 returned error can't find the container with id d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938 Dec 04 00:30:35.120493 master-0 kubenswrapper[8678]: I1204 00:30:35.120133 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-7b5fd5f747-kz9ss"] Dec 04 00:30:35.120493 master-0 kubenswrapper[8678]: E1204 00:30:35.120355 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[audit serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" podUID="48b06281-202e-49e7-9c91-df59b9633efc" Dec 04 00:30:35.196750 master-0 kubenswrapper[8678]: I1204 00:30:35.196701 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" event={"ID":"e8375dfa-3a83-415b-bce5-0819a73255c1","Type":"ContainerStarted","Data":"1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4"} Dec 04 00:30:35.198041 master-0 kubenswrapper[8678]: I1204 00:30:35.198017 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:35.200615 master-0 kubenswrapper[8678]: I1204 00:30:35.198486 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" event={"ID":"46a9c1fd-6e78-4d87-85ef-f8fc195bb980","Type":"ContainerStarted","Data":"d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938"} Dec 04 00:30:35.208120 master-0 kubenswrapper[8678]: I1204 00:30:35.208092 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:35.277247 master-0 kubenswrapper[8678]: I1204 00:30:35.277195 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277261 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277319 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277349 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kwmn\" (UniqueName: \"kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277386 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277449 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277478 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277505 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277556 master-0 kubenswrapper[8678]: I1204 00:30:35.277529 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets\") pod \"48b06281-202e-49e7-9c91-df59b9633efc\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " Dec 04 00:30:35.277979 master-0 kubenswrapper[8678]: I1204 00:30:35.277953 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets" (OuterVolumeSpecName: "node-pullsecrets") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "node-pullsecrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:30:35.278130 master-0 kubenswrapper[8678]: I1204 00:30:35.278070 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:35.278490 master-0 kubenswrapper[8678]: I1204 00:30:35.278444 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:35.278689 master-0 kubenswrapper[8678]: I1204 00:30:35.278652 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:30:35.278909 master-0 kubenswrapper[8678]: I1204 00:30:35.278877 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config" (OuterVolumeSpecName: "config") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:35.279120 master-0 kubenswrapper[8678]: I1204 00:30:35.279052 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:35.285483 master-0 kubenswrapper[8678]: I1204 00:30:35.284646 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:30:35.285483 master-0 kubenswrapper[8678]: I1204 00:30:35.284796 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn" (OuterVolumeSpecName: "kube-api-access-5kwmn") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "kube-api-access-5kwmn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:30:35.285483 master-0 kubenswrapper[8678]: I1204 00:30:35.284976 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "48b06281-202e-49e7-9c91-df59b9633efc" (UID: "48b06281-202e-49e7-9c91-df59b9633efc"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378793 8678 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378828 8678 reconciler_common.go:293] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-image-import-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378838 8678 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-encryption-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378848 8678 reconciler_common.go:293] "Volume detached for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/48b06281-202e-49e7-9c91-df59b9633efc-node-pullsecrets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378858 8678 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378866 8678 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-etcd-serving-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378875 8678 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-etcd-client\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378887 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kwmn\" (UniqueName: \"kubernetes.io/projected/48b06281-202e-49e7-9c91-df59b9633efc-kube-api-access-5kwmn\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.378994 master-0 kubenswrapper[8678]: I1204 00:30:35.378895 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:35.479852 master-0 kubenswrapper[8678]: I1204 00:30:35.479787 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:35.480091 master-0 kubenswrapper[8678]: I1204 00:30:35.479938 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:35.480091 master-0 kubenswrapper[8678]: E1204 00:30:35.479993 8678 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 00:30:35.480091 master-0 kubenswrapper[8678]: E1204 00:30:35.480087 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:39.480063832 +0000 UTC m=+22.806796568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : configmap "audit-0" not found Dec 04 00:30:35.480254 master-0 kubenswrapper[8678]: E1204 00:30:35.480183 8678 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 00:30:35.480322 master-0 kubenswrapper[8678]: E1204 00:30:35.480305 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:39.480282578 +0000 UTC m=+22.807015144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : secret "serving-cert" not found Dec 04 00:30:36.207955 master-0 kubenswrapper[8678]: I1204 00:30:36.207452 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:36.515995 master-0 kubenswrapper[8678]: I1204 00:30:36.515805 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:30:38.013094 master-0 kubenswrapper[8678]: I1204 00:30:38.012981 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:38.013845 master-0 kubenswrapper[8678]: I1204 00:30:38.013163 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") pod \"route-controller-manager-5d97c6dd4-x4c5l\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:38.013845 master-0 kubenswrapper[8678]: E1204 00:30:38.013349 8678 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:38.013845 master-0 kubenswrapper[8678]: E1204 00:30:38.013382 8678 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 00:30:38.013845 master-0 kubenswrapper[8678]: E1204 00:30:38.013444 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:54.013417086 +0000 UTC m=+37.340149672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : configmap "client-ca" not found Dec 04 00:30:38.013845 master-0 kubenswrapper[8678]: E1204 00:30:38.013526 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert podName:b3a0246c-d8df-47c8-8703-39c8d82b0e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:30:54.013491678 +0000 UTC m=+37.340224224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert") pod "route-controller-manager-5d97c6dd4-x4c5l" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a") : secret "serving-cert" not found Dec 04 00:30:39.544358 master-0 kubenswrapper[8678]: I1204 00:30:39.544207 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:39.544358 master-0 kubenswrapper[8678]: I1204 00:30:39.544359 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") pod \"apiserver-7b5fd5f747-kz9ss\" (UID: \"48b06281-202e-49e7-9c91-df59b9633efc\") " pod="openshift-apiserver/apiserver-7b5fd5f747-kz9ss" Dec 04 00:30:39.545449 master-0 kubenswrapper[8678]: E1204 00:30:39.544456 8678 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: object "openshift-apiserver"/"audit-0" not registered Dec 04 00:30:39.545449 master-0 kubenswrapper[8678]: E1204 00:30:39.544582 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:47.544557206 +0000 UTC m=+30.871289972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : object "openshift-apiserver"/"audit-0" not registered Dec 04 00:30:39.545449 master-0 kubenswrapper[8678]: E1204 00:30:39.544597 8678 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: object "openshift-apiserver"/"serving-cert" not registered Dec 04 00:30:39.545449 master-0 kubenswrapper[8678]: E1204 00:30:39.544752 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert podName:48b06281-202e-49e7-9c91-df59b9633efc nodeName:}" failed. No retries permitted until 2025-12-04 00:30:47.54471747 +0000 UTC m=+30.871450056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert") pod "apiserver-7b5fd5f747-kz9ss" (UID: "48b06281-202e-49e7-9c91-df59b9633efc") : object "openshift-apiserver"/"serving-cert" not registered Dec 04 00:30:40.863869 master-0 kubenswrapper[8678]: I1204 00:30:40.863804 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") pod \"controller-manager-7867f9586b-dg7tn\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:40.864545 master-0 kubenswrapper[8678]: E1204 00:30:40.863995 8678 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 00:30:40.864545 master-0 kubenswrapper[8678]: E1204 00:30:40.864110 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca podName:c11c2e6c-39f7-4784-a0e9-9351068e7104 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:56.864080489 +0000 UTC m=+40.190813085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca") pod "controller-manager-7867f9586b-dg7tn" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104") : configmap "client-ca" not found Dec 04 00:30:43.027957 master-0 kubenswrapper[8678]: I1204 00:30:43.024472 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-56f6ccc758-vsg29"] Dec 04 00:30:43.027957 master-0 kubenswrapper[8678]: I1204 00:30:43.025284 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.038949 master-0 kubenswrapper[8678]: I1204 00:30:43.034528 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 00:30:43.038949 master-0 kubenswrapper[8678]: I1204 00:30:43.034734 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 00:30:43.038949 master-0 kubenswrapper[8678]: I1204 00:30:43.034888 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 00:30:43.038949 master-0 kubenswrapper[8678]: I1204 00:30:43.035056 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 00:30:43.038949 master-0 kubenswrapper[8678]: I1204 00:30:43.035166 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 00:30:43.046359 master-0 kubenswrapper[8678]: I1204 00:30:43.046303 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 00:30:43.047081 master-0 kubenswrapper[8678]: I1204 00:30:43.046707 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 00:30:43.047081 master-0 kubenswrapper[8678]: I1204 00:30:43.046812 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 00:30:43.047081 master-0 kubenswrapper[8678]: I1204 00:30:43.046875 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 00:30:43.057948 master-0 kubenswrapper[8678]: I1204 00:30:43.047464 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-56f6ccc758-vsg29"] Dec 04 00:30:43.069955 master-0 kubenswrapper[8678]: I1204 00:30:43.062656 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-7b5fd5f747-kz9ss"] Dec 04 00:30:43.079531 master-0 kubenswrapper[8678]: I1204 00:30:43.078429 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 00:30:43.098607 master-0 kubenswrapper[8678]: I1204 00:30:43.098555 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-apiserver/apiserver-7b5fd5f747-kz9ss"] Dec 04 00:30:43.124963 master-0 kubenswrapper[8678]: I1204 00:30:43.124864 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdnml\" (UniqueName: \"kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.124963 master-0 kubenswrapper[8678]: I1204 00:30:43.124945 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.124981 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125006 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125026 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125066 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125116 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125160 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125184 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125261 master-0 kubenswrapper[8678]: I1204 00:30:43.125221 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.125548 master-0 kubenswrapper[8678]: I1204 00:30:43.125280 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.179479 master-0 kubenswrapper[8678]: I1204 00:30:43.179430 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn"] Dec 04 00:30:43.180131 master-0 kubenswrapper[8678]: I1204 00:30:43.180107 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.185225 master-0 kubenswrapper[8678]: I1204 00:30:43.185194 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 00:30:43.185380 master-0 kubenswrapper[8678]: I1204 00:30:43.185359 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 00:30:43.186250 master-0 kubenswrapper[8678]: I1204 00:30:43.186128 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 00:30:43.203181 master-0 kubenswrapper[8678]: I1204 00:30:43.203138 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 00:30:43.205870 master-0 kubenswrapper[8678]: I1204 00:30:43.205832 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn"] Dec 04 00:30:43.227103 master-0 kubenswrapper[8678]: I1204 00:30:43.227070 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnml\" (UniqueName: \"kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227411 master-0 kubenswrapper[8678]: I1204 00:30:43.227395 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227510 master-0 kubenswrapper[8678]: I1204 00:30:43.227497 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227610 master-0 kubenswrapper[8678]: I1204 00:30:43.227597 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227697 master-0 kubenswrapper[8678]: I1204 00:30:43.227685 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227801 master-0 kubenswrapper[8678]: I1204 00:30:43.227787 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.227913 master-0 kubenswrapper[8678]: I1204 00:30:43.227900 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.228304 master-0 kubenswrapper[8678]: I1204 00:30:43.228276 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.228406 master-0 kubenswrapper[8678]: I1204 00:30:43.228390 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.228507 master-0 kubenswrapper[8678]: I1204 00:30:43.228494 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.228645 master-0 kubenswrapper[8678]: I1204 00:30:43.228630 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.228769 master-0 kubenswrapper[8678]: I1204 00:30:43.228757 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48b06281-202e-49e7-9c91-df59b9633efc-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:43.228850 master-0 kubenswrapper[8678]: I1204 00:30:43.228840 8678 reconciler_common.go:293] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/48b06281-202e-49e7-9c91-df59b9633efc-audit\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:43.228991 master-0 kubenswrapper[8678]: I1204 00:30:43.228950 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.229103 master-0 kubenswrapper[8678]: I1204 00:30:43.229088 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.229286 master-0 kubenswrapper[8678]: I1204 00:30:43.229269 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.229614 master-0 kubenswrapper[8678]: I1204 00:30:43.229571 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.229745 master-0 kubenswrapper[8678]: I1204 00:30:43.229707 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.229745 master-0 kubenswrapper[8678]: I1204 00:30:43.229729 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.230219 master-0 kubenswrapper[8678]: I1204 00:30:43.230188 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.240486 master-0 kubenswrapper[8678]: I1204 00:30:43.236033 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.240486 master-0 kubenswrapper[8678]: I1204 00:30:43.236793 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.240486 master-0 kubenswrapper[8678]: I1204 00:30:43.237026 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.259948 master-0 kubenswrapper[8678]: I1204 00:30:43.259898 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnml\" (UniqueName: \"kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.330562 master-0 kubenswrapper[8678]: I1204 00:30:43.330401 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.330562 master-0 kubenswrapper[8678]: I1204 00:30:43.330510 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.330786 master-0 kubenswrapper[8678]: I1204 00:30:43.330580 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.330786 master-0 kubenswrapper[8678]: I1204 00:30:43.330614 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.330786 master-0 kubenswrapper[8678]: I1204 00:30:43.330710 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25sts\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.330786 master-0 kubenswrapper[8678]: I1204 00:30:43.330752 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.345530 master-0 kubenswrapper[8678]: I1204 00:30:43.345451 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7867f9586b-dg7tn"] Dec 04 00:30:43.345866 master-0 kubenswrapper[8678]: E1204 00:30:43.345821 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" podUID="c11c2e6c-39f7-4784-a0e9-9351068e7104" Dec 04 00:30:43.351361 master-0 kubenswrapper[8678]: I1204 00:30:43.351040 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l"] Dec 04 00:30:43.351486 master-0 kubenswrapper[8678]: E1204 00:30:43.351387 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" podUID="b3a0246c-d8df-47c8-8703-39c8d82b0e0a" Dec 04 00:30:43.393497 master-0 kubenswrapper[8678]: I1204 00:30:43.393411 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:43.407205 master-0 kubenswrapper[8678]: I1204 00:30:43.407150 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg"] Dec 04 00:30:43.408053 master-0 kubenswrapper[8678]: I1204 00:30:43.407989 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.410577 master-0 kubenswrapper[8678]: I1204 00:30:43.410520 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 00:30:43.410879 master-0 kubenswrapper[8678]: I1204 00:30:43.410841 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 00:30:43.411142 master-0 kubenswrapper[8678]: I1204 00:30:43.411101 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 00:30:43.420078 master-0 kubenswrapper[8678]: I1204 00:30:43.419334 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg"] Dec 04 00:30:43.431295 master-0 kubenswrapper[8678]: I1204 00:30:43.431248 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431446 master-0 kubenswrapper[8678]: I1204 00:30:43.431303 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431446 master-0 kubenswrapper[8678]: I1204 00:30:43.431328 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431446 master-0 kubenswrapper[8678]: I1204 00:30:43.431397 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25sts\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431446 master-0 kubenswrapper[8678]: I1204 00:30:43.431441 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431618 master-0 kubenswrapper[8678]: I1204 00:30:43.431464 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.431618 master-0 kubenswrapper[8678]: I1204 00:30:43.431550 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.433020 master-0 kubenswrapper[8678]: I1204 00:30:43.432238 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.433020 master-0 kubenswrapper[8678]: I1204 00:30:43.432283 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.435771 master-0 kubenswrapper[8678]: I1204 00:30:43.435743 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.435991 master-0 kubenswrapper[8678]: I1204 00:30:43.435890 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.449229 master-0 kubenswrapper[8678]: I1204 00:30:43.449191 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sts\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.526246 master-0 kubenswrapper[8678]: I1204 00:30:43.526180 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:43.532832 master-0 kubenswrapper[8678]: I1204 00:30:43.532777 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.532964 master-0 kubenswrapper[8678]: I1204 00:30:43.532936 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.533109 master-0 kubenswrapper[8678]: I1204 00:30:43.533086 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.533170 master-0 kubenswrapper[8678]: I1204 00:30:43.533119 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznm9\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.533170 master-0 kubenswrapper[8678]: I1204 00:30:43.533150 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.634729 master-0 kubenswrapper[8678]: I1204 00:30:43.634650 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: I1204 00:30:43.634786 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: I1204 00:30:43.634812 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rznm9\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: I1204 00:30:43.634833 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: I1204 00:30:43.634860 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: I1204 00:30:43.634914 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635025 master-0 kubenswrapper[8678]: E1204 00:30:43.635022 8678 projected.go:288] Couldn't get configMap openshift-operator-controller/operator-controller-trusted-ca-bundle: configmap "operator-controller-trusted-ca-bundle" not found Dec 04 00:30:43.635403 master-0 kubenswrapper[8678]: E1204 00:30:43.635050 8678 projected.go:194] Error preparing data for projected volume ca-certs for pod openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg: configmap "operator-controller-trusted-ca-bundle" not found Dec 04 00:30:43.635403 master-0 kubenswrapper[8678]: E1204 00:30:43.635112 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs podName:47152378-4ef5-4eff-9b30-fd8635982f02 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:44.135095481 +0000 UTC m=+27.461828037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ca-certs" (UniqueName: "kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs") pod "operator-controller-controller-manager-5f78c89466-mwkdg" (UID: "47152378-4ef5-4eff-9b30-fd8635982f02") : configmap "operator-controller-trusted-ca-bundle" not found Dec 04 00:30:43.635403 master-0 kubenswrapper[8678]: I1204 00:30:43.635175 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.635673 master-0 kubenswrapper[8678]: I1204 00:30:43.635622 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:43.661950 master-0 kubenswrapper[8678]: I1204 00:30:43.661887 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznm9\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:44.141664 master-0 kubenswrapper[8678]: I1204 00:30:44.141616 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:44.142206 master-0 kubenswrapper[8678]: E1204 00:30:44.141820 8678 projected.go:301] Couldn't get configMap payload openshift-operator-controller/operator-controller-trusted-ca-bundle: configmap references non-existent config key: ca-bundle.crt Dec 04 00:30:44.142206 master-0 kubenswrapper[8678]: E1204 00:30:44.141841 8678 projected.go:194] Error preparing data for projected volume ca-certs for pod openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg: configmap references non-existent config key: ca-bundle.crt Dec 04 00:30:44.142206 master-0 kubenswrapper[8678]: E1204 00:30:44.141888 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs podName:47152378-4ef5-4eff-9b30-fd8635982f02 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:45.141872197 +0000 UTC m=+28.468604753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ca-certs" (UniqueName: "kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs") pod "operator-controller-controller-manager-5f78c89466-mwkdg" (UID: "47152378-4ef5-4eff-9b30-fd8635982f02") : configmap references non-existent config key: ca-bundle.crt Dec 04 00:30:44.254495 master-0 kubenswrapper[8678]: I1204 00:30:44.253236 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:30:44.254495 master-0 kubenswrapper[8678]: I1204 00:30:44.254092 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.255840 master-0 kubenswrapper[8678]: I1204 00:30:44.255552 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:44.255840 master-0 kubenswrapper[8678]: I1204 00:30:44.255548 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:44.256183 master-0 kubenswrapper[8678]: I1204 00:30:44.256093 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Dec 04 00:30:44.267433 master-0 kubenswrapper[8678]: I1204 00:30:44.267376 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:30:44.292124 master-0 kubenswrapper[8678]: I1204 00:30:44.292064 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:44.297053 master-0 kubenswrapper[8678]: I1204 00:30:44.296902 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:44.445246 master-0 kubenswrapper[8678]: I1204 00:30:44.445116 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d7d7\" (UniqueName: \"kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7\") pod \"c11c2e6c-39f7-4784-a0e9-9351068e7104\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " Dec 04 00:30:44.445246 master-0 kubenswrapper[8678]: I1204 00:30:44.445223 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config\") pod \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " Dec 04 00:30:44.445463 master-0 kubenswrapper[8678]: I1204 00:30:44.445262 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config\") pod \"c11c2e6c-39f7-4784-a0e9-9351068e7104\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " Dec 04 00:30:44.445463 master-0 kubenswrapper[8678]: I1204 00:30:44.445307 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8btr\" (UniqueName: \"kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr\") pod \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\" (UID: \"b3a0246c-d8df-47c8-8703-39c8d82b0e0a\") " Dec 04 00:30:44.445463 master-0 kubenswrapper[8678]: I1204 00:30:44.445343 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") pod \"c11c2e6c-39f7-4784-a0e9-9351068e7104\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " Dec 04 00:30:44.445551 master-0 kubenswrapper[8678]: I1204 00:30:44.445484 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles\") pod \"c11c2e6c-39f7-4784-a0e9-9351068e7104\" (UID: \"c11c2e6c-39f7-4784-a0e9-9351068e7104\") " Dec 04 00:30:44.445869 master-0 kubenswrapper[8678]: I1204 00:30:44.445698 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.445869 master-0 kubenswrapper[8678]: I1204 00:30:44.445856 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.446132 master-0 kubenswrapper[8678]: I1204 00:30:44.446083 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.446197 master-0 kubenswrapper[8678]: I1204 00:30:44.446122 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config" (OuterVolumeSpecName: "config") pod "c11c2e6c-39f7-4784-a0e9-9351068e7104" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:44.446284 master-0 kubenswrapper[8678]: I1204 00:30:44.446212 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config" (OuterVolumeSpecName: "config") pod "b3a0246c-d8df-47c8-8703-39c8d82b0e0a" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:44.446364 master-0 kubenswrapper[8678]: I1204 00:30:44.446323 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "c11c2e6c-39f7-4784-a0e9-9351068e7104" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:30:44.446542 master-0 kubenswrapper[8678]: I1204 00:30:44.446514 8678 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.446606 master-0 kubenswrapper[8678]: I1204 00:30:44.446554 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.446606 master-0 kubenswrapper[8678]: I1204 00:30:44.446570 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.448731 master-0 kubenswrapper[8678]: I1204 00:30:44.448360 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "c11c2e6c-39f7-4784-a0e9-9351068e7104" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:30:44.449740 master-0 kubenswrapper[8678]: I1204 00:30:44.449381 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7" (OuterVolumeSpecName: "kube-api-access-2d7d7") pod "c11c2e6c-39f7-4784-a0e9-9351068e7104" (UID: "c11c2e6c-39f7-4784-a0e9-9351068e7104"). InnerVolumeSpecName "kube-api-access-2d7d7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:30:44.450619 master-0 kubenswrapper[8678]: I1204 00:30:44.450295 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr" (OuterVolumeSpecName: "kube-api-access-v8btr") pod "b3a0246c-d8df-47c8-8703-39c8d82b0e0a" (UID: "b3a0246c-d8df-47c8-8703-39c8d82b0e0a"). InnerVolumeSpecName "kube-api-access-v8btr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:30:44.547561 master-0 kubenswrapper[8678]: I1204 00:30:44.547492 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.547802 master-0 kubenswrapper[8678]: I1204 00:30:44.547607 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.547802 master-0 kubenswrapper[8678]: I1204 00:30:44.547656 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.547802 master-0 kubenswrapper[8678]: I1204 00:30:44.547717 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.548016 master-0 kubenswrapper[8678]: I1204 00:30:44.547828 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.548016 master-0 kubenswrapper[8678]: I1204 00:30:44.547748 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2d7d7\" (UniqueName: \"kubernetes.io/projected/c11c2e6c-39f7-4784-a0e9-9351068e7104-kube-api-access-2d7d7\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.548016 master-0 kubenswrapper[8678]: I1204 00:30:44.547999 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v8btr\" (UniqueName: \"kubernetes.io/projected/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-kube-api-access-v8btr\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.548261 master-0 kubenswrapper[8678]: I1204 00:30:44.548034 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c11c2e6c-39f7-4784-a0e9-9351068e7104-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:44.563568 master-0 kubenswrapper[8678]: I1204 00:30:44.563540 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access\") pod \"installer-1-master-0\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.591385 master-0 kubenswrapper[8678]: I1204 00:30:44.591354 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:30:44.857520 master-0 kubenswrapper[8678]: I1204 00:30:44.857043 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b06281-202e-49e7-9c91-df59b9633efc" path="/var/lib/kubelet/pods/48b06281-202e-49e7-9c91-df59b9633efc/volumes" Dec 04 00:30:44.908833 master-0 kubenswrapper[8678]: I1204 00:30:44.908781 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 00:30:44.909336 master-0 kubenswrapper[8678]: I1204 00:30:44.909316 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:44.911432 master-0 kubenswrapper[8678]: I1204 00:30:44.911400 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Dec 04 00:30:44.920002 master-0 kubenswrapper[8678]: I1204 00:30:44.919935 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 00:30:45.046579 master-0 kubenswrapper[8678]: I1204 00:30:45.046483 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-87cd489bc-llsfr"] Dec 04 00:30:45.047649 master-0 kubenswrapper[8678]: I1204 00:30:45.047608 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.050977 master-0 kubenswrapper[8678]: I1204 00:30:45.050912 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 00:30:45.051134 master-0 kubenswrapper[8678]: I1204 00:30:45.050996 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 00:30:45.051238 master-0 kubenswrapper[8678]: I1204 00:30:45.051186 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 00:30:45.051903 master-0 kubenswrapper[8678]: I1204 00:30:45.051871 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 00:30:45.052079 master-0 kubenswrapper[8678]: I1204 00:30:45.052058 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 00:30:45.056865 master-0 kubenswrapper[8678]: I1204 00:30:45.056812 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.057090 master-0 kubenswrapper[8678]: I1204 00:30:45.057052 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.057193 master-0 kubenswrapper[8678]: I1204 00:30:45.057166 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.065691 master-0 kubenswrapper[8678]: I1204 00:30:45.065625 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 00:30:45.069079 master-0 kubenswrapper[8678]: I1204 00:30:45.069017 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-87cd489bc-llsfr"] Dec 04 00:30:45.069484 master-0 kubenswrapper[8678]: I1204 00:30:45.069452 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 00:30:45.088894 master-0 kubenswrapper[8678]: I1204 00:30:45.088849 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 00:30:45.158417 master-0 kubenswrapper[8678]: I1204 00:30:45.158262 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.158417 master-0 kubenswrapper[8678]: I1204 00:30:45.158332 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.158417 master-0 kubenswrapper[8678]: I1204 00:30:45.158390 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158428 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158465 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158471 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158546 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158668 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rb5q\" (UniqueName: \"kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158687 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158782 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158819 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158855 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159170 master-0 kubenswrapper[8678]: I1204 00:30:45.158874 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.159500 master-0 kubenswrapper[8678]: I1204 00:30:45.159314 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.163738 master-0 kubenswrapper[8678]: I1204 00:30:45.163196 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:45.184306 master-0 kubenswrapper[8678]: I1204 00:30:45.184246 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access\") pod \"installer-1-master-0\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.230865 master-0 kubenswrapper[8678]: I1204 00:30:45.230809 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:45.259139 master-0 kubenswrapper[8678]: I1204 00:30:45.259097 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l" Dec 04 00:30:45.259139 master-0 kubenswrapper[8678]: I1204 00:30:45.259122 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7867f9586b-dg7tn" Dec 04 00:30:45.259701 master-0 kubenswrapper[8678]: I1204 00:30:45.259679 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259776 master-0 kubenswrapper[8678]: I1204 00:30:45.259711 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259776 master-0 kubenswrapper[8678]: I1204 00:30:45.259756 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259776 master-0 kubenswrapper[8678]: I1204 00:30:45.259773 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259885 master-0 kubenswrapper[8678]: I1204 00:30:45.259798 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259885 master-0 kubenswrapper[8678]: I1204 00:30:45.259843 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5rb5q\" (UniqueName: \"kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.259957 master-0 kubenswrapper[8678]: I1204 00:30:45.259909 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.260007 master-0 kubenswrapper[8678]: I1204 00:30:45.259961 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.260672 master-0 kubenswrapper[8678]: I1204 00:30:45.260647 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.261126 master-0 kubenswrapper[8678]: I1204 00:30:45.261104 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.262018 master-0 kubenswrapper[8678]: I1204 00:30:45.261995 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.262146 master-0 kubenswrapper[8678]: I1204 00:30:45.262124 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.263124 master-0 kubenswrapper[8678]: I1204 00:30:45.263070 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.265682 master-0 kubenswrapper[8678]: I1204 00:30:45.265648 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.267289 master-0 kubenswrapper[8678]: I1204 00:30:45.267253 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.271080 master-0 kubenswrapper[8678]: I1204 00:30:45.271035 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 00:30:45.279731 master-0 kubenswrapper[8678]: I1204 00:30:45.279648 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rb5q\" (UniqueName: \"kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.325103 master-0 kubenswrapper[8678]: I1204 00:30:45.325041 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:30:45.326652 master-0 kubenswrapper[8678]: I1204 00:30:45.326617 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.329579 master-0 kubenswrapper[8678]: I1204 00:30:45.329546 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:30:45.329763 master-0 kubenswrapper[8678]: I1204 00:30:45.329690 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:30:45.329840 master-0 kubenswrapper[8678]: I1204 00:30:45.329811 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:30:45.330096 master-0 kubenswrapper[8678]: I1204 00:30:45.330067 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:30:45.332341 master-0 kubenswrapper[8678]: I1204 00:30:45.332286 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:30:45.338465 master-0 kubenswrapper[8678]: I1204 00:30:45.338411 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l"] Dec 04 00:30:45.341694 master-0 kubenswrapper[8678]: I1204 00:30:45.341617 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:30:45.344292 master-0 kubenswrapper[8678]: I1204 00:30:45.344179 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d97c6dd4-x4c5l"] Dec 04 00:30:45.368535 master-0 kubenswrapper[8678]: I1204 00:30:45.368483 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7867f9586b-dg7tn"] Dec 04 00:30:45.374302 master-0 kubenswrapper[8678]: I1204 00:30:45.374252 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-7867f9586b-dg7tn"] Dec 04 00:30:45.382746 master-0 kubenswrapper[8678]: I1204 00:30:45.382708 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:45.462819 master-0 kubenswrapper[8678]: I1204 00:30:45.462761 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.462909 master-0 kubenswrapper[8678]: I1204 00:30:45.462836 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txdjg\" (UniqueName: \"kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.462909 master-0 kubenswrapper[8678]: I1204 00:30:45.462901 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.464589 master-0 kubenswrapper[8678]: I1204 00:30:45.463025 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.464589 master-0 kubenswrapper[8678]: I1204 00:30:45.463080 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:45.464589 master-0 kubenswrapper[8678]: I1204 00:30:45.463094 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b3a0246c-d8df-47c8-8703-39c8d82b0e0a-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.563811 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-txdjg\" (UniqueName: \"kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.563872 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.564002 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.564038 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.564078 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c11c2e6c-39f7-4784-a0e9-9351068e7104-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.564883 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.565810 master-0 kubenswrapper[8678]: I1204 00:30:45.565735 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.577523 master-0 kubenswrapper[8678]: I1204 00:30:45.577325 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.589274 master-0 kubenswrapper[8678]: I1204 00:30:45.585269 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-txdjg\" (UniqueName: \"kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg\") pod \"route-controller-manager-76fff54dc4-vgnpd\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.674716 master-0 kubenswrapper[8678]: I1204 00:30:45.674667 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:45.908911 master-0 kubenswrapper[8678]: I1204 00:30:45.908871 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:30:45.911552 master-0 kubenswrapper[8678]: I1204 00:30:45.911330 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 00:30:45.913063 master-0 kubenswrapper[8678]: I1204 00:30:45.912996 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg"] Dec 04 00:30:45.914672 master-0 kubenswrapper[8678]: I1204 00:30:45.914635 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-56f6ccc758-vsg29"] Dec 04 00:30:45.939991 master-0 kubenswrapper[8678]: W1204 00:30:45.939826 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47152378_4ef5_4eff_9b30_fd8635982f02.slice/crio-abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d WatchSource:0}: Error finding container abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d: Status 404 returned error can't find the container with id abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d Dec 04 00:30:45.941040 master-0 kubenswrapper[8678]: W1204 00:30:45.940900 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf25c964_8d39_457a_9214_6cadfecf3943.slice/crio-c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f WatchSource:0}: Error finding container c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f: Status 404 returned error can't find the container with id c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f Dec 04 00:30:46.059907 master-0 kubenswrapper[8678]: I1204 00:30:46.059807 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn"] Dec 04 00:30:46.059907 master-0 kubenswrapper[8678]: I1204 00:30:46.059875 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-87cd489bc-llsfr"] Dec 04 00:30:46.190990 master-0 kubenswrapper[8678]: I1204 00:30:46.187248 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:30:46.290908 master-0 kubenswrapper[8678]: I1204 00:30:46.290839 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" event={"ID":"89be8775-ded0-4680-ae6f-3c60575ad4b8","Type":"ContainerStarted","Data":"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20"} Dec 04 00:30:46.297370 master-0 kubenswrapper[8678]: I1204 00:30:46.297318 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" event={"ID":"46a9c1fd-6e78-4d87-85ef-f8fc195bb980","Type":"ContainerStarted","Data":"757db1e370e5b4cbd7b221ef1b6bf638c1107af84e7d48c8bb84579675cd71b1"} Dec 04 00:30:46.305697 master-0 kubenswrapper[8678]: I1204 00:30:46.305636 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerStarted","Data":"b7f9fde08392c65ce1c3c95f566f8400383b906d186df46ad254525d83c87159"} Dec 04 00:30:46.315963 master-0 kubenswrapper[8678]: I1204 00:30:46.315881 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"7f7447d4710a416cc2bf07cc529cad4cd19da29df353f24e562e2960080bf926"} Dec 04 00:30:46.315963 master-0 kubenswrapper[8678]: I1204 00:30:46.315957 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"bd570164e4f250f953ddde8e60445d595b3a58298a3711e92e8a9ec240f35d10"} Dec 04 00:30:46.323809 master-0 kubenswrapper[8678]: I1204 00:30:46.323749 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"af25c964-8d39-457a-9214-6cadfecf3943","Type":"ContainerStarted","Data":"c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f"} Dec 04 00:30:46.329041 master-0 kubenswrapper[8678]: I1204 00:30:46.325364 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" event={"ID":"e8375dfa-3a83-415b-bce5-0819a73255c1","Type":"ContainerStarted","Data":"20506a98e84c99331cafba85c5145c3a1768787edab149ad75ff8ef3a56fe612"} Dec 04 00:30:46.329041 master-0 kubenswrapper[8678]: I1204 00:30:46.325394 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" event={"ID":"e8375dfa-3a83-415b-bce5-0819a73255c1","Type":"ContainerStarted","Data":"5a4b2c130e0f4fe793e82e6504b38f35706167c3f77d43ddf5030dba45561fd4"} Dec 04 00:30:46.329041 master-0 kubenswrapper[8678]: I1204 00:30:46.328443 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"463d57da-a6b6-40a7-b55b-90b5a187aed4","Type":"ContainerStarted","Data":"46441a01a04010f2bbf14286151d0c9346c90660c7c0a3c48c5057c8bbd0b36e"} Dec 04 00:30:46.330178 master-0 kubenswrapper[8678]: I1204 00:30:46.330140 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" event={"ID":"4b5c0b0e-6015-473f-b7b8-0e91900cd82d","Type":"ContainerStarted","Data":"d4939b21289b30f741e5b063601cba30ecee1e657055a7fef29dabdb7ced8760"} Dec 04 00:30:46.343953 master-0 kubenswrapper[8678]: I1204 00:30:46.341818 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerStarted","Data":"abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d"} Dec 04 00:30:46.343953 master-0 kubenswrapper[8678]: I1204 00:30:46.342697 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" event={"ID":"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e","Type":"ContainerStarted","Data":"3fdd82f108e7fb2a5a37183344b9e219302032210a97c4d05d1c7dc63a17842b"} Dec 04 00:30:46.343953 master-0 kubenswrapper[8678]: I1204 00:30:46.343370 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" event={"ID":"7af17f6f-6bda-4972-a72a-9d9059cd2fa6","Type":"ContainerStarted","Data":"b67b9d50d899e5a64493410038447a1d3c6621b8f7e5bf837d77b9ba67d41a60"} Dec 04 00:30:46.381953 master-0 kubenswrapper[8678]: I1204 00:30:46.381762 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cr7sj"] Dec 04 00:30:46.382744 master-0 kubenswrapper[8678]: I1204 00:30:46.382708 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.387076 master-0 kubenswrapper[8678]: I1204 00:30:46.387031 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 00:30:46.387414 master-0 kubenswrapper[8678]: I1204 00:30:46.387382 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 00:30:46.387612 master-0 kubenswrapper[8678]: I1204 00:30:46.387585 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 00:30:46.392114 master-0 kubenswrapper[8678]: I1204 00:30:46.392058 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 00:30:46.430033 master-0 kubenswrapper[8678]: I1204 00:30:46.417862 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cr7sj"] Dec 04 00:30:46.482957 master-0 kubenswrapper[8678]: I1204 00:30:46.481562 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89j7\" (UniqueName: \"kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.482957 master-0 kubenswrapper[8678]: I1204 00:30:46.481666 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.482957 master-0 kubenswrapper[8678]: I1204 00:30:46.481725 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.586077 master-0 kubenswrapper[8678]: I1204 00:30:46.585456 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s89j7\" (UniqueName: \"kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.586077 master-0 kubenswrapper[8678]: I1204 00:30:46.585521 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.586077 master-0 kubenswrapper[8678]: I1204 00:30:46.585564 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.586595 master-0 kubenswrapper[8678]: I1204 00:30:46.586280 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.586700 master-0 kubenswrapper[8678]: E1204 00:30:46.586672 8678 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Dec 04 00:30:46.586845 master-0 kubenswrapper[8678]: E1204 00:30:46.586716 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls podName:f190ddab-e7d0-4dd6-8bb7-359a02393259 nodeName:}" failed. No retries permitted until 2025-12-04 00:30:47.086705607 +0000 UTC m=+30.413438163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls") pod "dns-default-cr7sj" (UID: "f190ddab-e7d0-4dd6-8bb7-359a02393259") : secret "dns-default-metrics-tls" not found Dec 04 00:30:46.604129 master-0 kubenswrapper[8678]: I1204 00:30:46.604061 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89j7\" (UniqueName: \"kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:46.865203 master-0 kubenswrapper[8678]: I1204 00:30:46.865134 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a0246c-d8df-47c8-8703-39c8d82b0e0a" path="/var/lib/kubelet/pods/b3a0246c-d8df-47c8-8703-39c8d82b0e0a/volumes" Dec 04 00:30:46.865660 master-0 kubenswrapper[8678]: I1204 00:30:46.865631 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c11c2e6c-39f7-4784-a0e9-9351068e7104" path="/var/lib/kubelet/pods/c11c2e6c-39f7-4784-a0e9-9351068e7104/volumes" Dec 04 00:30:46.866024 master-0 kubenswrapper[8678]: I1204 00:30:46.865981 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5bwrm"] Dec 04 00:30:46.866796 master-0 kubenswrapper[8678]: I1204 00:30:46.866765 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:46.991533 master-0 kubenswrapper[8678]: I1204 00:30:46.991408 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:46.991773 master-0 kubenswrapper[8678]: I1204 00:30:46.991577 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjgh\" (UniqueName: \"kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.094495 master-0 kubenswrapper[8678]: I1204 00:30:47.093496 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.094495 master-0 kubenswrapper[8678]: I1204 00:30:47.093584 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:47.094495 master-0 kubenswrapper[8678]: I1204 00:30:47.093679 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjgh\" (UniqueName: \"kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.094495 master-0 kubenswrapper[8678]: I1204 00:30:47.094140 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.098287 master-0 kubenswrapper[8678]: I1204 00:30:47.098256 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:47.110026 master-0 kubenswrapper[8678]: I1204 00:30:47.109984 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjgh\" (UniqueName: \"kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.192397 master-0 kubenswrapper[8678]: I1204 00:30:47.192342 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:30:47.210918 master-0 kubenswrapper[8678]: W1204 00:30:47.210866 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85684df_0014_4d28_9b00_9c6a6942cc94.slice/crio-5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827 WatchSource:0}: Error finding container 5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827: Status 404 returned error can't find the container with id 5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827 Dec 04 00:30:47.307442 master-0 kubenswrapper[8678]: I1204 00:30:47.307388 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:47.361215 master-0 kubenswrapper[8678]: I1204 00:30:47.361079 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerStarted","Data":"f134fa404e41ccccd9a96968aae081a3d4c05ff32e7941607b4075f5497a7ae4"} Dec 04 00:30:47.361215 master-0 kubenswrapper[8678]: I1204 00:30:47.361145 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerStarted","Data":"688995f7125a802acc963d9b1021b9df02503d82c2259266aed07ddfedcadbb7"} Dec 04 00:30:47.363175 master-0 kubenswrapper[8678]: I1204 00:30:47.362139 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:47.364058 master-0 kubenswrapper[8678]: I1204 00:30:47.364029 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerStarted","Data":"5cc96808b45503da6bf6344b9c5ff5ce37d5054b4e7c842cfc8ce66e57d55c0b"} Dec 04 00:30:47.364117 master-0 kubenswrapper[8678]: I1204 00:30:47.364068 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerStarted","Data":"36a2cab4ca8775c3db41d1bd854a9aa530900e8e907d105b1156a340fd433e8d"} Dec 04 00:30:47.364735 master-0 kubenswrapper[8678]: I1204 00:30:47.364572 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:47.378282 master-0 kubenswrapper[8678]: I1204 00:30:47.378211 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"af25c964-8d39-457a-9214-6cadfecf3943","Type":"ContainerStarted","Data":"ac3c3f86fb624407fb4e83dc7253e2823922e10ea8a41094ef13f1bdb4f8569e"} Dec 04 00:30:47.385061 master-0 kubenswrapper[8678]: I1204 00:30:47.384998 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5bwrm" event={"ID":"e85684df-0014-4d28-9b00-9c6a6942cc94","Type":"ContainerStarted","Data":"5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827"} Dec 04 00:30:47.388209 master-0 kubenswrapper[8678]: I1204 00:30:47.388124 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podStartSLOduration=4.388107556 podStartE2EDuration="4.388107556s" podCreationTimestamp="2025-12-04 00:30:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:47.384681259 +0000 UTC m=+30.711413835" watchObservedRunningTime="2025-12-04 00:30:47.388107556 +0000 UTC m=+30.714840122" Dec 04 00:30:47.395462 master-0 kubenswrapper[8678]: I1204 00:30:47.395200 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"463d57da-a6b6-40a7-b55b-90b5a187aed4","Type":"ContainerStarted","Data":"2d89c372c05805535244dae698b4ac15fe947f62bb80840bccfb764e23f23224"} Dec 04 00:30:47.476140 master-0 kubenswrapper[8678]: I1204 00:30:47.473969 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podStartSLOduration=4.473947252 podStartE2EDuration="4.473947252s" podCreationTimestamp="2025-12-04 00:30:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:47.472976225 +0000 UTC m=+30.799708791" watchObservedRunningTime="2025-12-04 00:30:47.473947252 +0000 UTC m=+30.800679818" Dec 04 00:30:47.476140 master-0 kubenswrapper[8678]: I1204 00:30:47.474620 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-1-master-0" podStartSLOduration=3.474613291 podStartE2EDuration="3.474613291s" podCreationTimestamp="2025-12-04 00:30:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:47.441607742 +0000 UTC m=+30.768340288" watchObservedRunningTime="2025-12-04 00:30:47.474613291 +0000 UTC m=+30.801345847" Dec 04 00:30:47.497534 master-0 kubenswrapper[8678]: I1204 00:30:47.497367 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-1-master-0" podStartSLOduration=3.497344841 podStartE2EDuration="3.497344841s" podCreationTimestamp="2025-12-04 00:30:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:47.494808399 +0000 UTC m=+30.821540955" watchObservedRunningTime="2025-12-04 00:30:47.497344841 +0000 UTC m=+30.824077397" Dec 04 00:30:47.809025 master-0 kubenswrapper[8678]: I1204 00:30:47.803692 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cr7sj"] Dec 04 00:30:47.826628 master-0 kubenswrapper[8678]: W1204 00:30:47.826527 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf190ddab_e7d0_4dd6_8bb7_359a02393259.slice/crio-bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5 WatchSource:0}: Error finding container bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5: Status 404 returned error can't find the container with id bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5 Dec 04 00:30:48.066287 master-0 kubenswrapper[8678]: I1204 00:30:48.066109 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:30:48.066716 master-0 kubenswrapper[8678]: I1204 00:30:48.066685 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.069266 master-0 kubenswrapper[8678]: I1204 00:30:48.069220 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:30:48.069357 master-0 kubenswrapper[8678]: I1204 00:30:48.069259 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:30:48.069405 master-0 kubenswrapper[8678]: I1204 00:30:48.069398 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:30:48.069656 master-0 kubenswrapper[8678]: I1204 00:30:48.069613 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:30:48.079053 master-0 kubenswrapper[8678]: I1204 00:30:48.078682 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:30:48.083718 master-0 kubenswrapper[8678]: I1204 00:30:48.080982 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:30:48.086101 master-0 kubenswrapper[8678]: I1204 00:30:48.086076 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:30:48.217950 master-0 kubenswrapper[8678]: I1204 00:30:48.217516 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5qzg\" (UniqueName: \"kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.217950 master-0 kubenswrapper[8678]: I1204 00:30:48.217612 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.217950 master-0 kubenswrapper[8678]: I1204 00:30:48.217650 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.217950 master-0 kubenswrapper[8678]: I1204 00:30:48.217733 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.217950 master-0 kubenswrapper[8678]: I1204 00:30:48.217772 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319056 master-0 kubenswrapper[8678]: I1204 00:30:48.318906 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319056 master-0 kubenswrapper[8678]: I1204 00:30:48.318993 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319367 master-0 kubenswrapper[8678]: I1204 00:30:48.319066 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c5qzg\" (UniqueName: \"kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319367 master-0 kubenswrapper[8678]: I1204 00:30:48.319093 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319367 master-0 kubenswrapper[8678]: I1204 00:30:48.319115 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.319982 master-0 kubenswrapper[8678]: I1204 00:30:48.319961 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.321273 master-0 kubenswrapper[8678]: I1204 00:30:48.321242 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.322788 master-0 kubenswrapper[8678]: I1204 00:30:48.322754 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.326715 master-0 kubenswrapper[8678]: I1204 00:30:48.326674 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.339284 master-0 kubenswrapper[8678]: I1204 00:30:48.339232 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5qzg\" (UniqueName: \"kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg\") pod \"controller-manager-595c869cf5-sc69w\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.400539 master-0 kubenswrapper[8678]: I1204 00:30:48.400478 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr7sj" event={"ID":"f190ddab-e7d0-4dd6-8bb7-359a02393259","Type":"ContainerStarted","Data":"bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5"} Dec 04 00:30:48.403626 master-0 kubenswrapper[8678]: I1204 00:30:48.403597 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5bwrm" event={"ID":"e85684df-0014-4d28-9b00-9c6a6942cc94","Type":"ContainerStarted","Data":"a9cab83358f3d813c5796728dc396a72ebb7ae033f198d72cb026894d30a7c27"} Dec 04 00:30:48.409821 master-0 kubenswrapper[8678]: I1204 00:30:48.409781 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:30:48.417076 master-0 kubenswrapper[8678]: I1204 00:30:48.417024 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5bwrm" podStartSLOduration=2.417008649 podStartE2EDuration="2.417008649s" podCreationTimestamp="2025-12-04 00:30:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:30:48.415479786 +0000 UTC m=+31.742212342" watchObservedRunningTime="2025-12-04 00:30:48.417008649 +0000 UTC m=+31.743741205" Dec 04 00:30:49.737557 master-0 kubenswrapper[8678]: I1204 00:30:49.737494 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:49.737557 master-0 kubenswrapper[8678]: I1204 00:30:49.737546 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:49.738104 master-0 kubenswrapper[8678]: I1204 00:30:49.737843 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:49.741137 master-0 kubenswrapper[8678]: I1204 00:30:49.741107 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:49.741268 master-0 kubenswrapper[8678]: I1204 00:30:49.741221 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:49.741355 master-0 kubenswrapper[8678]: I1204 00:30:49.741325 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:49.839065 master-0 kubenswrapper[8678]: I1204 00:30:49.838974 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:49.839065 master-0 kubenswrapper[8678]: I1204 00:30:49.839059 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:49.839616 master-0 kubenswrapper[8678]: I1204 00:30:49.839101 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:49.839616 master-0 kubenswrapper[8678]: I1204 00:30:49.839142 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:49.843315 master-0 kubenswrapper[8678]: I1204 00:30:49.843268 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:49.844739 master-0 kubenswrapper[8678]: I1204 00:30:49.844700 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"multus-admission-controller-78ddcf56f9-x5jff\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:49.845324 master-0 kubenswrapper[8678]: I1204 00:30:49.845282 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:49.845496 master-0 kubenswrapper[8678]: I1204 00:30:49.845440 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:49.908408 master-0 kubenswrapper[8678]: I1204 00:30:49.908324 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:30:49.908641 master-0 kubenswrapper[8678]: I1204 00:30:49.908442 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:30:49.910486 master-0 kubenswrapper[8678]: I1204 00:30:49.910436 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:30:49.910635 master-0 kubenswrapper[8678]: I1204 00:30:49.910592 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:30:49.912319 master-0 kubenswrapper[8678]: I1204 00:30:49.912286 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:30:49.919251 master-0 kubenswrapper[8678]: I1204 00:30:49.919201 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:30:49.919329 master-0 kubenswrapper[8678]: I1204 00:30:49.919294 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:30:50.866831 master-0 kubenswrapper[8678]: I1204 00:30:50.866775 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:30:50.867445 master-0 kubenswrapper[8678]: I1204 00:30:50.867010 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/installer-1-master-0" podUID="463d57da-a6b6-40a7-b55b-90b5a187aed4" containerName="installer" containerID="cri-o://2d89c372c05805535244dae698b4ac15fe947f62bb80840bccfb764e23f23224" gracePeriod=30 Dec 04 00:30:51.429024 master-0 kubenswrapper[8678]: I1204 00:30:51.428973 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" event={"ID":"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e","Type":"ContainerStarted","Data":"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c"} Dec 04 00:30:51.429399 master-0 kubenswrapper[8678]: I1204 00:30:51.429352 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:51.447216 master-0 kubenswrapper[8678]: I1204 00:30:51.445707 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" podStartSLOduration=4.105572593 podStartE2EDuration="8.445674413s" podCreationTimestamp="2025-12-04 00:30:43 +0000 UTC" firstStartedPulling="2025-12-04 00:30:46.216585008 +0000 UTC m=+29.543317574" lastFinishedPulling="2025-12-04 00:30:50.556686818 +0000 UTC m=+33.883419394" observedRunningTime="2025-12-04 00:30:51.443283296 +0000 UTC m=+34.770015872" watchObservedRunningTime="2025-12-04 00:30:51.445674413 +0000 UTC m=+34.772407009" Dec 04 00:30:51.598989 master-0 kubenswrapper[8678]: I1204 00:30:51.597145 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:30:51.624341 master-0 kubenswrapper[8678]: I1204 00:30:51.624289 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r"] Dec 04 00:30:51.644553 master-0 kubenswrapper[8678]: I1204 00:30:51.644506 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:30:51.686695 master-0 kubenswrapper[8678]: I1204 00:30:51.683340 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf"] Dec 04 00:30:51.688703 master-0 kubenswrapper[8678]: I1204 00:30:51.688663 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:30:51.688908 master-0 kubenswrapper[8678]: I1204 00:30:51.688873 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:30:51.690754 master-0 kubenswrapper[8678]: I1204 00:30:51.690457 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz"] Dec 04 00:30:51.691750 master-0 kubenswrapper[8678]: I1204 00:30:51.691712 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5"] Dec 04 00:30:51.850903 master-0 kubenswrapper[8678]: I1204 00:30:51.850847 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn"] Dec 04 00:30:51.854056 master-0 kubenswrapper[8678]: I1204 00:30:51.853470 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t85qp"] Dec 04 00:30:51.860527 master-0 kubenswrapper[8678]: W1204 00:30:51.860465 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a83a76c_050e_4378_ac3a_1213d6d53773.slice/crio-088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b WatchSource:0}: Error finding container 088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b: Status 404 returned error can't find the container with id 088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b Dec 04 00:30:51.865300 master-0 kubenswrapper[8678]: W1204 00:30:51.865068 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f01d68_92ae_45b8_8501_645e439b5295.slice/crio-88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a WatchSource:0}: Error finding container 88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a: Status 404 returned error can't find the container with id 88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a Dec 04 00:30:52.435095 master-0 kubenswrapper[8678]: I1204 00:30:52.435019 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerStarted","Data":"33cf50dddcd93f720ca2efeba9e6e7f9c2f4ad9ce4ace46bbe2653eb9453a59c"} Dec 04 00:30:52.436687 master-0 kubenswrapper[8678]: I1204 00:30:52.436626 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" event={"ID":"0a6dcc87-66c9-4781-b725-426fc13b7610","Type":"ContainerStarted","Data":"cfa8bf5ec790aa66bb086855b23fdd7f30750c2157b4007184b3691c06f25978"} Dec 04 00:30:52.438762 master-0 kubenswrapper[8678]: I1204 00:30:52.438443 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" event={"ID":"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8","Type":"ContainerStarted","Data":"2a98a5d982257969db8c53b7549324edfb17072359c4ef2f1b840f5a2439be7f"} Dec 04 00:30:52.441958 master-0 kubenswrapper[8678]: I1204 00:30:52.441846 8678 generic.go:334] "Generic (PLEG): container finished" podID="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" containerID="d7e932bfc93d6424ba109adf9ccfa0aad6919b98e264b7ab4e4f0ba5956458fd" exitCode=0 Dec 04 00:30:52.442048 master-0 kubenswrapper[8678]: I1204 00:30:52.441970 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" event={"ID":"7af17f6f-6bda-4972-a72a-9d9059cd2fa6","Type":"ContainerDied","Data":"d7e932bfc93d6424ba109adf9ccfa0aad6919b98e264b7ab4e4f0ba5956458fd"} Dec 04 00:30:52.444938 master-0 kubenswrapper[8678]: I1204 00:30:52.444859 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" event={"ID":"ffe9d26b-34e2-4506-9c38-69b85ab210a1","Type":"ContainerStarted","Data":"52f656c6701b64f3eb5181c0b0fd4550d4b20ce73f741ff988f2cd1ac210fc50"} Dec 04 00:30:52.448079 master-0 kubenswrapper[8678]: I1204 00:30:52.448041 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr7sj" event={"ID":"f190ddab-e7d0-4dd6-8bb7-359a02393259","Type":"ContainerStarted","Data":"c8cec610295f0f5c4b2beebeed48b821118fd22044240819cc25189c5be786a9"} Dec 04 00:30:52.448134 master-0 kubenswrapper[8678]: I1204 00:30:52.448080 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr7sj" event={"ID":"f190ddab-e7d0-4dd6-8bb7-359a02393259","Type":"ContainerStarted","Data":"77da594d9ac42d1e897db24850238aeab54afa74e20aa1e14657f617268ded54"} Dec 04 00:30:52.448250 master-0 kubenswrapper[8678]: I1204 00:30:52.448215 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:30:52.451372 master-0 kubenswrapper[8678]: I1204 00:30:52.451335 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" event={"ID":"c79edcd7-4399-4ded-9b03-9084ad9e14b4","Type":"ContainerStarted","Data":"d041bb4a9e3db8bbf43f4f78b669c974131a898a41f55e8b3be1b164bc17bd17"} Dec 04 00:30:52.451424 master-0 kubenswrapper[8678]: I1204 00:30:52.451377 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" event={"ID":"c79edcd7-4399-4ded-9b03-9084ad9e14b4","Type":"ContainerStarted","Data":"3fe4a6cd4cada46a728249b8c43a7c74f080b5f782c7415dc019cf4f1ea4ead6"} Dec 04 00:30:52.454715 master-0 kubenswrapper[8678]: I1204 00:30:52.454513 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerStarted","Data":"e4b83ab4443aa0c31704f38f77c4aaefe8bb38a88f809f9098c0a8032fdc6bbc"} Dec 04 00:30:52.465087 master-0 kubenswrapper[8678]: I1204 00:30:52.465003 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t85qp" event={"ID":"9a83a76c-050e-4378-ac3a-1213d6d53773","Type":"ContainerStarted","Data":"088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b"} Dec 04 00:30:52.480899 master-0 kubenswrapper[8678]: I1204 00:30:52.480837 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" event={"ID":"f2f01d68-92ae-45b8-8501-645e439b5295","Type":"ContainerStarted","Data":"88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a"} Dec 04 00:30:52.485479 master-0 kubenswrapper[8678]: I1204 00:30:52.485426 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cr7sj" podStartSLOduration=3.200230165 podStartE2EDuration="6.48541454s" podCreationTimestamp="2025-12-04 00:30:46 +0000 UTC" firstStartedPulling="2025-12-04 00:30:47.829337446 +0000 UTC m=+31.156070032" lastFinishedPulling="2025-12-04 00:30:51.114521831 +0000 UTC m=+34.441254407" observedRunningTime="2025-12-04 00:30:52.483863907 +0000 UTC m=+35.810596473" watchObservedRunningTime="2025-12-04 00:30:52.48541454 +0000 UTC m=+35.812147096" Dec 04 00:30:52.496776 master-0 kubenswrapper[8678]: I1204 00:30:52.496632 8678 generic.go:334] "Generic (PLEG): container finished" podID="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" containerID="cd7a6fc7079a4931c7aa831daced8240cbd41b8c609540c81117d50d9ee6f498" exitCode=0 Dec 04 00:30:52.496957 master-0 kubenswrapper[8678]: I1204 00:30:52.496892 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" event={"ID":"4b5c0b0e-6015-473f-b7b8-0e91900cd82d","Type":"ContainerDied","Data":"cd7a6fc7079a4931c7aa831daced8240cbd41b8c609540c81117d50d9ee6f498"} Dec 04 00:30:53.250514 master-0 kubenswrapper[8678]: I1204 00:30:53.250459 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:30:53.252799 master-0 kubenswrapper[8678]: I1204 00:30:53.252765 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.258120 master-0 kubenswrapper[8678]: I1204 00:30:53.258077 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:30:53.405510 master-0 kubenswrapper[8678]: I1204 00:30:53.405381 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.405510 master-0 kubenswrapper[8678]: I1204 00:30:53.405470 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.405823 master-0 kubenswrapper[8678]: I1204 00:30:53.405652 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.506885 master-0 kubenswrapper[8678]: I1204 00:30:53.506825 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.506885 master-0 kubenswrapper[8678]: I1204 00:30:53.506882 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.507442 master-0 kubenswrapper[8678]: I1204 00:30:53.506943 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.507442 master-0 kubenswrapper[8678]: I1204 00:30:53.506995 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.507442 master-0 kubenswrapper[8678]: I1204 00:30:53.507046 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.512440 master-0 kubenswrapper[8678]: I1204 00:30:53.512404 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" event={"ID":"4b5c0b0e-6015-473f-b7b8-0e91900cd82d","Type":"ContainerStarted","Data":"72974c227b8b64eeed841cba4585e2a0f6f40548c0961e9d3ea586081e73dd1d"} Dec 04 00:30:53.523046 master-0 kubenswrapper[8678]: I1204 00:30:53.519383 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" event={"ID":"7af17f6f-6bda-4972-a72a-9d9059cd2fa6","Type":"ContainerStarted","Data":"fbf10a7c68895682d98465ccd8d1c9bca563713a0cd0d2baaa57afbf11c30bc1"} Dec 04 00:30:53.523046 master-0 kubenswrapper[8678]: I1204 00:30:53.519437 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" event={"ID":"7af17f6f-6bda-4972-a72a-9d9059cd2fa6","Type":"ContainerStarted","Data":"2691b8a6e5e82f7e6ff32bd32cc59325901b4dfd69ffb17d2da117244e97ab2f"} Dec 04 00:30:53.529891 master-0 kubenswrapper[8678]: I1204 00:30:53.529846 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access\") pod \"installer-2-master-0\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.534322 master-0 kubenswrapper[8678]: I1204 00:30:53.534273 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:30:53.541999 master-0 kubenswrapper[8678]: I1204 00:30:53.541911 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" podStartSLOduration=4.071063819 podStartE2EDuration="8.541891939s" podCreationTimestamp="2025-12-04 00:30:45 +0000 UTC" firstStartedPulling="2025-12-04 00:30:46.08236355 +0000 UTC m=+29.409096106" lastFinishedPulling="2025-12-04 00:30:50.55319168 +0000 UTC m=+33.879924226" observedRunningTime="2025-12-04 00:30:53.540950163 +0000 UTC m=+36.867682719" watchObservedRunningTime="2025-12-04 00:30:53.541891939 +0000 UTC m=+36.868624495" Dec 04 00:30:53.585710 master-0 kubenswrapper[8678]: I1204 00:30:53.585263 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:30:53.593376 master-0 kubenswrapper[8678]: I1204 00:30:53.593277 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" podStartSLOduration=13.47927905 podStartE2EDuration="18.593248685s" podCreationTimestamp="2025-12-04 00:30:35 +0000 UTC" firstStartedPulling="2025-12-04 00:30:45.948524032 +0000 UTC m=+29.275256588" lastFinishedPulling="2025-12-04 00:30:51.062493647 +0000 UTC m=+34.389226223" observedRunningTime="2025-12-04 00:30:53.592978178 +0000 UTC m=+36.919710744" watchObservedRunningTime="2025-12-04 00:30:53.593248685 +0000 UTC m=+36.919981241" Dec 04 00:30:54.300848 master-0 kubenswrapper[8678]: I1204 00:30:54.293238 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 00:30:54.300848 master-0 kubenswrapper[8678]: I1204 00:30:54.297441 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 00:30:54.300848 master-0 kubenswrapper[8678]: I1204 00:30:54.297701 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.302886 master-0 kubenswrapper[8678]: I1204 00:30:54.302297 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 00:30:54.419046 master-0 kubenswrapper[8678]: I1204 00:30:54.418998 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.419046 master-0 kubenswrapper[8678]: I1204 00:30:54.419057 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.419294 master-0 kubenswrapper[8678]: I1204 00:30:54.419095 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.520571 master-0 kubenswrapper[8678]: I1204 00:30:54.520502 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.520571 master-0 kubenswrapper[8678]: I1204 00:30:54.520573 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.521218 master-0 kubenswrapper[8678]: I1204 00:30:54.520605 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.521218 master-0 kubenswrapper[8678]: I1204 00:30:54.520680 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.521218 master-0 kubenswrapper[8678]: I1204 00:30:54.520677 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.552321 master-0 kubenswrapper[8678]: I1204 00:30:54.538167 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:54.619861 master-0 kubenswrapper[8678]: I1204 00:30:54.619801 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:30:55.240742 master-0 kubenswrapper[8678]: I1204 00:30:55.240689 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:30:55.385427 master-0 kubenswrapper[8678]: I1204 00:30:55.384435 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:55.385427 master-0 kubenswrapper[8678]: I1204 00:30:55.384592 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:55.398082 master-0 kubenswrapper[8678]: I1204 00:30:55.398031 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:55.534634 master-0 kubenswrapper[8678]: I1204 00:30:55.534504 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:30:58.395025 master-0 kubenswrapper[8678]: I1204 00:30:58.394127 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:58.395025 master-0 kubenswrapper[8678]: I1204 00:30:58.394717 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:58.406720 master-0 kubenswrapper[8678]: I1204 00:30:58.406664 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:30:58.558921 master-0 kubenswrapper[8678]: I1204 00:30:58.558866 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:31:00.379746 master-0 kubenswrapper[8678]: I1204 00:31:00.379638 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-version/cluster-version-operator-869c786959-rg92r"] Dec 04 00:31:00.380276 master-0 kubenswrapper[8678]: I1204 00:31:00.379984 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" podUID="89be8775-ded0-4680-ae6f-3c60575ad4b8" containerName="cluster-version-operator" containerID="cri-o://626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20" gracePeriod=130 Dec 04 00:31:00.506176 master-0 kubenswrapper[8678]: I1204 00:31:00.506135 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:31:00.582882 master-0 kubenswrapper[8678]: I1204 00:31:00.581220 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:31:00.582882 master-0 kubenswrapper[8678]: I1204 00:31:00.581483 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" podUID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" containerName="route-controller-manager" containerID="cri-o://078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c" gracePeriod=30 Dec 04 00:31:00.660887 master-0 kubenswrapper[8678]: I1204 00:31:00.660763 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:31:01.271325 master-0 kubenswrapper[8678]: I1204 00:31:01.270001 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:31:01.310054 master-0 kubenswrapper[8678]: I1204 00:31:01.309990 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 00:31:01.325720 master-0 kubenswrapper[8678]: I1204 00:31:01.324013 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:31:01.332856 master-0 kubenswrapper[8678]: I1204 00:31:01.329789 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:31:01.341533 master-0 kubenswrapper[8678]: W1204 00:31:01.333508 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf099c1a6_5f9e_4d81_8656_dd8f003f0143.slice/crio-1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0 WatchSource:0}: Error finding container 1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0: Status 404 returned error can't find the container with id 1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0 Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450378 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") pod \"89be8775-ded0-4680-ae6f-3c60575ad4b8\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450434 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") pod \"89be8775-ded0-4680-ae6f-3c60575ad4b8\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450469 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca\") pod \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450520 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config\") pod \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450544 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") pod \"89be8775-ded0-4680-ae6f-3c60575ad4b8\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450580 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txdjg\" (UniqueName: \"kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg\") pod \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450614 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") pod \"89be8775-ded0-4680-ae6f-3c60575ad4b8\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450642 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert\") pod \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\" (UID: \"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.450666 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") pod \"89be8775-ded0-4680-ae6f-3c60575ad4b8\" (UID: \"89be8775-ded0-4680-ae6f-3c60575ad4b8\") " Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.451385 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "89be8775-ded0-4680-ae6f-3c60575ad4b8" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.451453 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs" (OuterVolumeSpecName: "etc-ssl-certs") pod "89be8775-ded0-4680-ae6f-3c60575ad4b8" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8"). InnerVolumeSpecName "etc-ssl-certs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.452171 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca" (OuterVolumeSpecName: "client-ca") pod "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" (UID: "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.452542 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config" (OuterVolumeSpecName: "config") pod "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" (UID: "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:01.455994 master-0 kubenswrapper[8678]: I1204 00:31:01.452570 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads" (OuterVolumeSpecName: "etc-cvo-updatepayloads") pod "89be8775-ded0-4680-ae6f-3c60575ad4b8" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8"). InnerVolumeSpecName "etc-cvo-updatepayloads". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:01.456737 master-0 kubenswrapper[8678]: I1204 00:31:01.453996 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "89be8775-ded0-4680-ae6f-3c60575ad4b8" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:31:01.456737 master-0 kubenswrapper[8678]: I1204 00:31:01.454338 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "89be8775-ded0-4680-ae6f-3c60575ad4b8" (UID: "89be8775-ded0-4680-ae6f-3c60575ad4b8"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:01.458174 master-0 kubenswrapper[8678]: I1204 00:31:01.457152 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" (UID: "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:31:01.466596 master-0 kubenswrapper[8678]: I1204 00:31:01.466465 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg" (OuterVolumeSpecName: "kube-api-access-txdjg") pod "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" (UID: "a0a81e16-2ced-4c87-8520-cd06e6cd3d7e"). InnerVolumeSpecName "kube-api-access-txdjg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551736 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-txdjg\" (UniqueName: \"kubernetes.io/projected/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-kube-api-access-txdjg\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551776 8678 reconciler_common.go:293] "Volume detached for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-cvo-updatepayloads\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551810 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551820 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/89be8775-ded0-4680-ae6f-3c60575ad4b8-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551829 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89be8775-ded0-4680-ae6f-3c60575ad4b8-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551842 8678 reconciler_common.go:293] "Volume detached for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/89be8775-ded0-4680-ae6f-3c60575ad4b8-etc-ssl-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551851 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551860 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.553233 master-0 kubenswrapper[8678]: I1204 00:31:01.551868 8678 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89be8775-ded0-4680-ae6f-3c60575ad4b8-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:01.597374 master-0 kubenswrapper[8678]: I1204 00:31:01.597298 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" event={"ID":"ffe9d26b-34e2-4506-9c38-69b85ab210a1","Type":"ContainerStarted","Data":"e5bffc05aeaaed3e7b7f349d2dce51a96d4b7c835dd4935d60e66749c57999e2"} Dec 04 00:31:01.598520 master-0 kubenswrapper[8678]: I1204 00:31:01.598465 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:31:01.600516 master-0 kubenswrapper[8678]: I1204 00:31:01.600486 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"2f800d89-ebdc-4956-8124-3514983665fa","Type":"ContainerStarted","Data":"fe178b4b248ae4dfa93066e37783b6da70c66a59d5bc9eff054b67fc466cce7a"} Dec 04 00:31:01.622987 master-0 kubenswrapper[8678]: I1204 00:31:01.620638 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:31:01.622987 master-0 kubenswrapper[8678]: I1204 00:31:01.622926 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" event={"ID":"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8","Type":"ContainerStarted","Data":"e83c4118176b0f3010e4f4b0d01a505dc7427e41d25ff84ba2f4bb4204724432"} Dec 04 00:31:01.623915 master-0 kubenswrapper[8678]: I1204 00:31:01.623421 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:31:01.630956 master-0 kubenswrapper[8678]: I1204 00:31:01.630010 8678 generic.go:334] "Generic (PLEG): container finished" podID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" containerID="078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c" exitCode=0 Dec 04 00:31:01.636617 master-0 kubenswrapper[8678]: I1204 00:31:01.636520 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" Dec 04 00:31:01.636880 master-0 kubenswrapper[8678]: I1204 00:31:01.636535 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" event={"ID":"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e","Type":"ContainerDied","Data":"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c"} Dec 04 00:31:01.636984 master-0 kubenswrapper[8678]: I1204 00:31:01.636906 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd" event={"ID":"a0a81e16-2ced-4c87-8520-cd06e6cd3d7e","Type":"ContainerDied","Data":"3fdd82f108e7fb2a5a37183344b9e219302032210a97c4d05d1c7dc63a17842b"} Dec 04 00:31:01.636984 master-0 kubenswrapper[8678]: I1204 00:31:01.636957 8678 scope.go:117] "RemoveContainer" containerID="078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c" Dec 04 00:31:01.653142 master-0 kubenswrapper[8678]: I1204 00:31:01.653079 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t85qp" event={"ID":"9a83a76c-050e-4378-ac3a-1213d6d53773","Type":"ContainerStarted","Data":"c9f73bd1930206e17c972ebdb131bd5325c3832f5eaa96add8874c380f9f2588"} Dec 04 00:31:01.653142 master-0 kubenswrapper[8678]: I1204 00:31:01.653135 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t85qp" event={"ID":"9a83a76c-050e-4378-ac3a-1213d6d53773","Type":"ContainerStarted","Data":"f09ef2ac3b3078a2cf02a64a3f07c1085ad22253859255059d5ceffab785993d"} Dec 04 00:31:01.661101 master-0 kubenswrapper[8678]: I1204 00:31:01.661062 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:31:01.690602 master-0 kubenswrapper[8678]: I1204 00:31:01.688257 8678 scope.go:117] "RemoveContainer" containerID="078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c" Dec 04 00:31:01.690602 master-0 kubenswrapper[8678]: E1204 00:31:01.689301 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c\": container with ID starting with 078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c not found: ID does not exist" containerID="078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c" Dec 04 00:31:01.690602 master-0 kubenswrapper[8678]: I1204 00:31:01.689353 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c"} err="failed to get container status \"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c\": rpc error: code = NotFound desc = could not find container \"078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c\": container with ID starting with 078dd3ad17b06169cf0d0b5a7a94cdc682f11a78d3e5f737214f079c1445255c not found: ID does not exist" Dec 04 00:31:01.690602 master-0 kubenswrapper[8678]: I1204 00:31:01.690151 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:31:01.692999 master-0 kubenswrapper[8678]: I1204 00:31:01.692888 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerStarted","Data":"f5fd45065f6028b9bd37b848d95f0635563ba5e83e0c91f9cb776f679ba44b4b"} Dec 04 00:31:01.699063 master-0 kubenswrapper[8678]: I1204 00:31:01.699010 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" event={"ID":"f2f01d68-92ae-45b8-8501-645e439b5295","Type":"ContainerStarted","Data":"a9f4990dcdfbb3626bc25c21b0ce4b7de3280d0a9ee24887714731517ab0bf78"} Dec 04 00:31:01.704970 master-0 kubenswrapper[8678]: I1204 00:31:01.703226 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-76fff54dc4-vgnpd"] Dec 04 00:31:01.705121 master-0 kubenswrapper[8678]: I1204 00:31:01.705000 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"f099c1a6-5f9e-4d81-8656-dd8f003f0143","Type":"ContainerStarted","Data":"1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0"} Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.706568 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerStarted","Data":"21271674bed5db800ead1d33a02a41079776995c09f1c049ca58e762322ee71d"} Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.706921 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.708238 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" event={"ID":"c79edcd7-4399-4ded-9b03-9084ad9e14b4","Type":"ContainerStarted","Data":"91047caa011840485cf0440ea5435e7255eea04d0a040e632ceb8483ac22b986"} Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.708350 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.708362 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.708396 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.709963 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" event={"ID":"0a6dcc87-66c9-4781-b725-426fc13b7610","Type":"ContainerStarted","Data":"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493"} Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.710065 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:31:01.718979 master-0 kubenswrapper[8678]: I1204 00:31:01.710014 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" podUID="0a6dcc87-66c9-4781-b725-426fc13b7610" containerName="controller-manager" containerID="cri-o://8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493" gracePeriod=30 Dec 04 00:31:01.719556 master-0 kubenswrapper[8678]: I1204 00:31:01.719085 8678 generic.go:334] "Generic (PLEG): container finished" podID="89be8775-ded0-4680-ae6f-3c60575ad4b8" containerID="626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20" exitCode=0 Dec 04 00:31:01.719556 master-0 kubenswrapper[8678]: I1204 00:31:01.719164 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" event={"ID":"89be8775-ded0-4680-ae6f-3c60575ad4b8","Type":"ContainerDied","Data":"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20"} Dec 04 00:31:01.719556 master-0 kubenswrapper[8678]: I1204 00:31:01.719209 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" event={"ID":"89be8775-ded0-4680-ae6f-3c60575ad4b8","Type":"ContainerDied","Data":"49c276e5e76341df0b5e942bcde97bef23aceeb2719085ccee2f7772e1c03109"} Dec 04 00:31:01.719556 master-0 kubenswrapper[8678]: I1204 00:31:01.719239 8678 scope.go:117] "RemoveContainer" containerID="626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20" Dec 04 00:31:01.719556 master-0 kubenswrapper[8678]: I1204 00:31:01.719466 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-869c786959-rg92r" Dec 04 00:31:01.724188 master-0 kubenswrapper[8678]: I1204 00:31:01.724128 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:31:01.763156 master-0 kubenswrapper[8678]: I1204 00:31:01.762611 8678 scope.go:117] "RemoveContainer" containerID="626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20" Dec 04 00:31:01.764061 master-0 kubenswrapper[8678]: E1204 00:31:01.763594 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20\": container with ID starting with 626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20 not found: ID does not exist" containerID="626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20" Dec 04 00:31:01.764061 master-0 kubenswrapper[8678]: I1204 00:31:01.763633 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20"} err="failed to get container status \"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20\": rpc error: code = NotFound desc = could not find container \"626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20\": container with ID starting with 626c6f0e2d5f35765126f2f0178383e2c0dc13a833b62810ab224f59dbd25a20 not found: ID does not exist" Dec 04 00:31:01.851999 master-0 kubenswrapper[8678]: I1204 00:31:01.851918 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" podStartSLOduration=9.748024643 podStartE2EDuration="18.851900214s" podCreationTimestamp="2025-12-04 00:30:43 +0000 UTC" firstStartedPulling="2025-12-04 00:30:51.718984867 +0000 UTC m=+35.045717423" lastFinishedPulling="2025-12-04 00:31:00.822860438 +0000 UTC m=+44.149592994" observedRunningTime="2025-12-04 00:31:01.850373451 +0000 UTC m=+45.177106007" watchObservedRunningTime="2025-12-04 00:31:01.851900214 +0000 UTC m=+45.178632760" Dec 04 00:31:01.937952 master-0 kubenswrapper[8678]: I1204 00:31:01.937891 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-version/cluster-version-operator-869c786959-rg92r"] Dec 04 00:31:01.943148 master-0 kubenswrapper[8678]: I1204 00:31:01.943066 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cluster-version/cluster-version-operator-869c786959-rg92r"] Dec 04 00:31:01.976586 master-0 kubenswrapper[8678]: I1204 00:31:01.975802 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr"] Dec 04 00:31:01.978245 master-0 kubenswrapper[8678]: E1204 00:31:01.977636 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" containerName="route-controller-manager" Dec 04 00:31:01.978245 master-0 kubenswrapper[8678]: I1204 00:31:01.977664 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" containerName="route-controller-manager" Dec 04 00:31:01.978245 master-0 kubenswrapper[8678]: E1204 00:31:01.977675 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="89be8775-ded0-4680-ae6f-3c60575ad4b8" containerName="cluster-version-operator" Dec 04 00:31:01.978245 master-0 kubenswrapper[8678]: I1204 00:31:01.977682 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="89be8775-ded0-4680-ae6f-3c60575ad4b8" containerName="cluster-version-operator" Dec 04 00:31:01.979898 master-0 kubenswrapper[8678]: I1204 00:31:01.979038 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="89be8775-ded0-4680-ae6f-3c60575ad4b8" containerName="cluster-version-operator" Dec 04 00:31:01.979898 master-0 kubenswrapper[8678]: I1204 00:31:01.979069 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" containerName="route-controller-manager" Dec 04 00:31:01.979898 master-0 kubenswrapper[8678]: I1204 00:31:01.979567 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:01.985833 master-0 kubenswrapper[8678]: I1204 00:31:01.985654 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:31:01.985993 master-0 kubenswrapper[8678]: I1204 00:31:01.985974 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:31:01.986050 master-0 kubenswrapper[8678]: I1204 00:31:01.986026 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:31:02.066376 master-0 kubenswrapper[8678]: I1204 00:31:02.066320 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.066376 master-0 kubenswrapper[8678]: I1204 00:31:02.066371 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.066599 master-0 kubenswrapper[8678]: I1204 00:31:02.066399 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.066599 master-0 kubenswrapper[8678]: I1204 00:31:02.066431 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.066599 master-0 kubenswrapper[8678]: I1204 00:31:02.066450 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.082199 master-0 kubenswrapper[8678]: I1204 00:31:02.082153 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:31:02.082910 master-0 kubenswrapper[8678]: I1204 00:31:02.082865 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.088880 master-0 kubenswrapper[8678]: I1204 00:31:02.088832 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:31:02.089475 master-0 kubenswrapper[8678]: I1204 00:31:02.089451 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:31:02.089699 master-0 kubenswrapper[8678]: I1204 00:31:02.089681 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:31:02.089886 master-0 kubenswrapper[8678]: I1204 00:31:02.089868 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:31:02.090039 master-0 kubenswrapper[8678]: I1204 00:31:02.090023 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:31:02.090145 master-0 kubenswrapper[8678]: I1204 00:31:02.090130 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:31:02.167548 master-0 kubenswrapper[8678]: I1204 00:31:02.167485 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569fm\" (UniqueName: \"kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.167760 master-0 kubenswrapper[8678]: I1204 00:31:02.167569 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.167760 master-0 kubenswrapper[8678]: I1204 00:31:02.167609 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.167760 master-0 kubenswrapper[8678]: I1204 00:31:02.167638 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.167760 master-0 kubenswrapper[8678]: I1204 00:31:02.167695 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.167760 master-0 kubenswrapper[8678]: I1204 00:31:02.167728 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.168028 master-0 kubenswrapper[8678]: I1204 00:31:02.167789 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.168028 master-0 kubenswrapper[8678]: I1204 00:31:02.167829 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.168028 master-0 kubenswrapper[8678]: I1204 00:31:02.167884 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.169299 master-0 kubenswrapper[8678]: I1204 00:31:02.168454 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.169299 master-0 kubenswrapper[8678]: I1204 00:31:02.168542 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.169299 master-0 kubenswrapper[8678]: I1204 00:31:02.169243 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.182356 master-0 kubenswrapper[8678]: I1204 00:31:02.182230 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:31:02.185684 master-0 kubenswrapper[8678]: I1204 00:31:02.183802 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.193913 master-0 kubenswrapper[8678]: I1204 00:31:02.188061 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.196739 master-0 kubenswrapper[8678]: I1204 00:31:02.196659 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.205089 master-0 kubenswrapper[8678]: I1204 00:31:02.203457 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:31:02.228745 master-0 kubenswrapper[8678]: I1204 00:31:02.227427 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273068 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273137 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273199 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273235 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273269 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c9kv\" (UniqueName: \"kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273305 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.277089 master-0 kubenswrapper[8678]: I1204 00:31:02.273338 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-569fm\" (UniqueName: \"kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.277594 master-0 kubenswrapper[8678]: I1204 00:31:02.277500 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.278684 master-0 kubenswrapper[8678]: I1204 00:31:02.278403 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.283117 master-0 kubenswrapper[8678]: I1204 00:31:02.279432 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.299259 master-0 kubenswrapper[8678]: I1204 00:31:02.299213 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:31:02.303993 master-0 kubenswrapper[8678]: I1204 00:31:02.302965 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-569fm\" (UniqueName: \"kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm\") pod \"route-controller-manager-ccff84fcd-dbncp\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.316818 master-0 kubenswrapper[8678]: I1204 00:31:02.316781 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:31:02.321513 master-0 kubenswrapper[8678]: W1204 00:31:02.321345 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004c989d_6ae8_4147_8355_af1118fe6a98.slice/crio-c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885 WatchSource:0}: Error finding container c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885: Status 404 returned error can't find the container with id c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885 Dec 04 00:31:02.375495 master-0 kubenswrapper[8678]: I1204 00:31:02.375017 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca\") pod \"0a6dcc87-66c9-4781-b725-426fc13b7610\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " Dec 04 00:31:02.375495 master-0 kubenswrapper[8678]: I1204 00:31:02.375404 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config\") pod \"0a6dcc87-66c9-4781-b725-426fc13b7610\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " Dec 04 00:31:02.375495 master-0 kubenswrapper[8678]: I1204 00:31:02.375478 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert\") pod \"0a6dcc87-66c9-4781-b725-426fc13b7610\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " Dec 04 00:31:02.375495 master-0 kubenswrapper[8678]: I1204 00:31:02.375499 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles\") pod \"0a6dcc87-66c9-4781-b725-426fc13b7610\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " Dec 04 00:31:02.375799 master-0 kubenswrapper[8678]: I1204 00:31:02.375550 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5qzg\" (UniqueName: \"kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg\") pod \"0a6dcc87-66c9-4781-b725-426fc13b7610\" (UID: \"0a6dcc87-66c9-4781-b725-426fc13b7610\") " Dec 04 00:31:02.375799 master-0 kubenswrapper[8678]: I1204 00:31:02.375706 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.375799 master-0 kubenswrapper[8678]: I1204 00:31:02.375733 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.375799 master-0 kubenswrapper[8678]: I1204 00:31:02.375754 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8c9kv\" (UniqueName: \"kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.376727 master-0 kubenswrapper[8678]: I1204 00:31:02.376420 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.377381 master-0 kubenswrapper[8678]: I1204 00:31:02.377011 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config" (OuterVolumeSpecName: "config") pod "0a6dcc87-66c9-4781-b725-426fc13b7610" (UID: "0a6dcc87-66c9-4781-b725-426fc13b7610"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:02.377381 master-0 kubenswrapper[8678]: I1204 00:31:02.377201 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "0a6dcc87-66c9-4781-b725-426fc13b7610" (UID: "0a6dcc87-66c9-4781-b725-426fc13b7610"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:02.377773 master-0 kubenswrapper[8678]: I1204 00:31:02.377622 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca" (OuterVolumeSpecName: "client-ca") pod "0a6dcc87-66c9-4781-b725-426fc13b7610" (UID: "0a6dcc87-66c9-4781-b725-426fc13b7610"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:31:02.377892 master-0 kubenswrapper[8678]: I1204 00:31:02.377861 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.379350 master-0 kubenswrapper[8678]: I1204 00:31:02.379267 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg" (OuterVolumeSpecName: "kube-api-access-c5qzg") pod "0a6dcc87-66c9-4781-b725-426fc13b7610" (UID: "0a6dcc87-66c9-4781-b725-426fc13b7610"). InnerVolumeSpecName "kube-api-access-c5qzg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:02.380196 master-0 kubenswrapper[8678]: I1204 00:31:02.380159 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "0a6dcc87-66c9-4781-b725-426fc13b7610" (UID: "0a6dcc87-66c9-4781-b725-426fc13b7610"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:31:02.394187 master-0 kubenswrapper[8678]: I1204 00:31:02.394158 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c9kv\" (UniqueName: \"kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv\") pod \"community-operators-9rfw4\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.413771 master-0 kubenswrapper[8678]: I1204 00:31:02.413726 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:02.478153 master-0 kubenswrapper[8678]: I1204 00:31:02.478030 8678 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:02.478153 master-0 kubenswrapper[8678]: I1204 00:31:02.478064 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a6dcc87-66c9-4781-b725-426fc13b7610-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:02.478153 master-0 kubenswrapper[8678]: I1204 00:31:02.478078 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c5qzg\" (UniqueName: \"kubernetes.io/projected/0a6dcc87-66c9-4781-b725-426fc13b7610-kube-api-access-c5qzg\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:02.478153 master-0 kubenswrapper[8678]: I1204 00:31:02.478089 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:02.478153 master-0 kubenswrapper[8678]: I1204 00:31:02.478102 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6dcc87-66c9-4781-b725-426fc13b7610-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:02.551594 master-0 kubenswrapper[8678]: I1204 00:31:02.551527 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:02.738480 master-0 kubenswrapper[8678]: I1204 00:31:02.738352 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"2f800d89-ebdc-4956-8124-3514983665fa","Type":"ContainerStarted","Data":"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e"} Dec 04 00:31:02.738480 master-0 kubenswrapper[8678]: I1204 00:31:02.738421 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/installer-2-master-0" podUID="2f800d89-ebdc-4956-8124-3514983665fa" containerName="installer" containerID="cri-o://190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e" gracePeriod=30 Dec 04 00:31:02.741746 master-0 kubenswrapper[8678]: I1204 00:31:02.741666 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" event={"ID":"004c989d-6ae8-4147-8355-af1118fe6a98","Type":"ContainerStarted","Data":"c3851f459af3a52ca2d5286fdbe5bfbc4f8adb04de417f015b441c48011e4416"} Dec 04 00:31:02.741811 master-0 kubenswrapper[8678]: I1204 00:31:02.741754 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" event={"ID":"004c989d-6ae8-4147-8355-af1118fe6a98","Type":"ContainerStarted","Data":"c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885"} Dec 04 00:31:02.746247 master-0 kubenswrapper[8678]: I1204 00:31:02.746183 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:31:02.746540 master-0 kubenswrapper[8678]: E1204 00:31:02.746506 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a6dcc87-66c9-4781-b725-426fc13b7610" containerName="controller-manager" Dec 04 00:31:02.746579 master-0 kubenswrapper[8678]: I1204 00:31:02.746540 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6dcc87-66c9-4781-b725-426fc13b7610" containerName="controller-manager" Dec 04 00:31:02.746733 master-0 kubenswrapper[8678]: I1204 00:31:02.746683 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a6dcc87-66c9-4781-b725-426fc13b7610" containerName="controller-manager" Dec 04 00:31:02.747706 master-0 kubenswrapper[8678]: I1204 00:31:02.747668 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:02.752513 master-0 kubenswrapper[8678]: I1204 00:31:02.751913 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:31:02.755048 master-0 kubenswrapper[8678]: I1204 00:31:02.754754 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerStarted","Data":"d62bd69369e5368a4619ac055f16012c8f68ba6882c98f721292b2e4eeb9e3e0"} Dec 04 00:31:02.757691 master-0 kubenswrapper[8678]: I1204 00:31:02.756911 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"f099c1a6-5f9e-4d81-8656-dd8f003f0143","Type":"ContainerStarted","Data":"d96499e83423aa41557961bd962596742a89753f0be63a3ad713fb62a1bb63b2"} Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.770355 8678 generic.go:334] "Generic (PLEG): container finished" podID="0a6dcc87-66c9-4781-b725-426fc13b7610" containerID="8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493" exitCode=0 Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.771250 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.771727 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" event={"ID":"0a6dcc87-66c9-4781-b725-426fc13b7610","Type":"ContainerDied","Data":"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493"} Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.771812 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-595c869cf5-sc69w" event={"ID":"0a6dcc87-66c9-4781-b725-426fc13b7610","Type":"ContainerDied","Data":"cfa8bf5ec790aa66bb086855b23fdd7f30750c2157b4007184b3691c06f25978"} Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.771870 8678 scope.go:117] "RemoveContainer" containerID="8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493" Dec 04 00:31:02.782757 master-0 kubenswrapper[8678]: I1204 00:31:02.780307 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:31:02.806609 master-0 kubenswrapper[8678]: I1204 00:31:02.806527 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-2-master-0" podStartSLOduration=9.806504076 podStartE2EDuration="9.806504076s" podCreationTimestamp="2025-12-04 00:30:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:02.764071754 +0000 UTC m=+46.090804320" watchObservedRunningTime="2025-12-04 00:31:02.806504076 +0000 UTC m=+46.133236632" Dec 04 00:31:02.815231 master-0 kubenswrapper[8678]: I1204 00:31:02.815159 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-1-master-0" podStartSLOduration=8.815135902 podStartE2EDuration="8.815135902s" podCreationTimestamp="2025-12-04 00:30:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:02.793630668 +0000 UTC m=+46.120363224" watchObservedRunningTime="2025-12-04 00:31:02.815135902 +0000 UTC m=+46.141868458" Dec 04 00:31:02.816273 master-0 kubenswrapper[8678]: I1204 00:31:02.816225 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:31:02.817258 master-0 kubenswrapper[8678]: I1204 00:31:02.817223 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" podStartSLOduration=1.817214131 podStartE2EDuration="1.817214131s" podCreationTimestamp="2025-12-04 00:31:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:02.814833913 +0000 UTC m=+46.141566469" watchObservedRunningTime="2025-12-04 00:31:02.817214131 +0000 UTC m=+46.143946677" Dec 04 00:31:02.864059 master-0 kubenswrapper[8678]: W1204 00:31:02.863994 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187031e5_1d74_4d95_8163_d0c46e8e6734.slice/crio-fd706b1b34f264c9e738d9898089f6a639826d7ffe04c12ca3feba1d6691d6a4 WatchSource:0}: Error finding container fd706b1b34f264c9e738d9898089f6a639826d7ffe04c12ca3feba1d6691d6a4: Status 404 returned error can't find the container with id fd706b1b34f264c9e738d9898089f6a639826d7ffe04c12ca3feba1d6691d6a4 Dec 04 00:31:02.866155 master-0 kubenswrapper[8678]: I1204 00:31:02.866125 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89be8775-ded0-4680-ae6f-3c60575ad4b8" path="/var/lib/kubelet/pods/89be8775-ded0-4680-ae6f-3c60575ad4b8/volumes" Dec 04 00:31:02.866763 master-0 kubenswrapper[8678]: I1204 00:31:02.866732 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a81e16-2ced-4c87-8520-cd06e6cd3d7e" path="/var/lib/kubelet/pods/a0a81e16-2ced-4c87-8520-cd06e6cd3d7e/volumes" Dec 04 00:31:02.885665 master-0 kubenswrapper[8678]: I1204 00:31:02.885156 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:02.885665 master-0 kubenswrapper[8678]: I1204 00:31:02.885234 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjn7\" (UniqueName: \"kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:02.885665 master-0 kubenswrapper[8678]: I1204 00:31:02.885255 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:02.889229 master-0 kubenswrapper[8678]: I1204 00:31:02.889199 8678 scope.go:117] "RemoveContainer" containerID="8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493" Dec 04 00:31:02.893995 master-0 kubenswrapper[8678]: E1204 00:31:02.893904 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493\": container with ID starting with 8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493 not found: ID does not exist" containerID="8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493" Dec 04 00:31:02.894081 master-0 kubenswrapper[8678]: I1204 00:31:02.894014 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493"} err="failed to get container status \"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493\": rpc error: code = NotFound desc = could not find container \"8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493\": container with ID starting with 8548847e6d867a6cbddbd202af9ffbcaa9390fd2b43fa62169827a4c4aba9493 not found: ID does not exist" Dec 04 00:31:02.926706 master-0 kubenswrapper[8678]: I1204 00:31:02.926603 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:31:02.930596 master-0 kubenswrapper[8678]: I1204 00:31:02.930515 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-595c869cf5-sc69w"] Dec 04 00:31:03.020205 master-0 kubenswrapper[8678]: I1204 00:31:03.020081 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.020205 master-0 kubenswrapper[8678]: I1204 00:31:03.020142 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjn7\" (UniqueName: \"kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.020205 master-0 kubenswrapper[8678]: I1204 00:31:03.020166 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.022350 master-0 kubenswrapper[8678]: I1204 00:31:03.020715 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.022350 master-0 kubenswrapper[8678]: I1204 00:31:03.020784 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.046310 master-0 kubenswrapper[8678]: I1204 00:31:03.046264 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjn7\" (UniqueName: \"kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7\") pod \"redhat-marketplace-wlmqp\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.061007 master-0 kubenswrapper[8678]: I1204 00:31:03.059562 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:31:03.200381 master-0 kubenswrapper[8678]: I1204 00:31:03.200331 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:03.286714 master-0 kubenswrapper[8678]: I1204 00:31:03.285517 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:31:03.286714 master-0 kubenswrapper[8678]: I1204 00:31:03.286246 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.290572 master-0 kubenswrapper[8678]: I1204 00:31:03.288518 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 00:31:03.297600 master-0 kubenswrapper[8678]: I1204 00:31:03.297570 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:31:03.326566 master-0 kubenswrapper[8678]: I1204 00:31:03.326529 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-2-master-0_2f800d89-ebdc-4956-8124-3514983665fa/installer/0.log" Dec 04 00:31:03.326739 master-0 kubenswrapper[8678]: I1204 00:31:03.326711 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:31:03.425278 master-0 kubenswrapper[8678]: I1204 00:31:03.425236 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock\") pod \"2f800d89-ebdc-4956-8124-3514983665fa\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " Dec 04 00:31:03.425706 master-0 kubenswrapper[8678]: I1204 00:31:03.425688 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir\") pod \"2f800d89-ebdc-4956-8124-3514983665fa\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " Dec 04 00:31:03.426059 master-0 kubenswrapper[8678]: I1204 00:31:03.426014 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock" (OuterVolumeSpecName: "var-lock") pod "2f800d89-ebdc-4956-8124-3514983665fa" (UID: "2f800d89-ebdc-4956-8124-3514983665fa"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:03.426460 master-0 kubenswrapper[8678]: I1204 00:31:03.426422 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "2f800d89-ebdc-4956-8124-3514983665fa" (UID: "2f800d89-ebdc-4956-8124-3514983665fa"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:03.426790 master-0 kubenswrapper[8678]: I1204 00:31:03.426767 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access\") pod \"2f800d89-ebdc-4956-8124-3514983665fa\" (UID: \"2f800d89-ebdc-4956-8124-3514983665fa\") " Dec 04 00:31:03.427191 master-0 kubenswrapper[8678]: I1204 00:31:03.427153 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.427340 master-0 kubenswrapper[8678]: I1204 00:31:03.427311 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.427471 master-0 kubenswrapper[8678]: I1204 00:31:03.427454 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.427849 master-0 kubenswrapper[8678]: I1204 00:31:03.427832 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:03.427957 master-0 kubenswrapper[8678]: I1204 00:31:03.427938 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f800d89-ebdc-4956-8124-3514983665fa-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:03.430965 master-0 kubenswrapper[8678]: I1204 00:31:03.430759 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "2f800d89-ebdc-4956-8124-3514983665fa" (UID: "2f800d89-ebdc-4956-8124-3514983665fa"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:03.528849 master-0 kubenswrapper[8678]: I1204 00:31:03.528804 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.529483 master-0 kubenswrapper[8678]: I1204 00:31:03.529461 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.529599 master-0 kubenswrapper[8678]: I1204 00:31:03.529581 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.529728 master-0 kubenswrapper[8678]: I1204 00:31:03.529712 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2f800d89-ebdc-4956-8124-3514983665fa-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:03.530159 master-0 kubenswrapper[8678]: I1204 00:31:03.528903 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.530350 master-0 kubenswrapper[8678]: I1204 00:31:03.530315 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:03.779584 master-0 kubenswrapper[8678]: I1204 00:31:03.779514 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" event={"ID":"187031e5-1d74-4d95-8163-d0c46e8e6734","Type":"ContainerStarted","Data":"b8e242238e9bbc63620508dabeaccc004f016f449e6a4a22f8f976464721a60c"} Dec 04 00:31:03.779584 master-0 kubenswrapper[8678]: I1204 00:31:03.779592 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" event={"ID":"187031e5-1d74-4d95-8163-d0c46e8e6734","Type":"ContainerStarted","Data":"fd706b1b34f264c9e738d9898089f6a639826d7ffe04c12ca3feba1d6691d6a4"} Dec 04 00:31:03.780514 master-0 kubenswrapper[8678]: I1204 00:31:03.780477 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:03.783043 master-0 kubenswrapper[8678]: I1204 00:31:03.782911 8678 generic.go:334] "Generic (PLEG): container finished" podID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerID="c63f2e654b6b42a56ebf1acb79fcb5ebada66926722d7935eea90b37a368bcfa" exitCode=0 Dec 04 00:31:03.783043 master-0 kubenswrapper[8678]: I1204 00:31:03.782971 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9rfw4" event={"ID":"41f0ae0a-011e-4a4d-8fb6-773afb62f04d","Type":"ContainerDied","Data":"c63f2e654b6b42a56ebf1acb79fcb5ebada66926722d7935eea90b37a368bcfa"} Dec 04 00:31:03.783043 master-0 kubenswrapper[8678]: I1204 00:31:03.783029 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9rfw4" event={"ID":"41f0ae0a-011e-4a4d-8fb6-773afb62f04d","Type":"ContainerStarted","Data":"d2b2b5bc4ff300cc1548fc4cdef713cb3d0b6977a057b305ee5b86bcad20f784"} Dec 04 00:31:03.785548 master-0 kubenswrapper[8678]: I1204 00:31:03.785521 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-2-master-0_2f800d89-ebdc-4956-8124-3514983665fa/installer/0.log" Dec 04 00:31:03.785600 master-0 kubenswrapper[8678]: I1204 00:31:03.785565 8678 generic.go:334] "Generic (PLEG): container finished" podID="2f800d89-ebdc-4956-8124-3514983665fa" containerID="190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e" exitCode=1 Dec 04 00:31:03.785752 master-0 kubenswrapper[8678]: I1204 00:31:03.785718 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"2f800d89-ebdc-4956-8124-3514983665fa","Type":"ContainerDied","Data":"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e"} Dec 04 00:31:03.785876 master-0 kubenswrapper[8678]: I1204 00:31:03.785841 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 00:31:03.785876 master-0 kubenswrapper[8678]: I1204 00:31:03.785844 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"2f800d89-ebdc-4956-8124-3514983665fa","Type":"ContainerDied","Data":"fe178b4b248ae4dfa93066e37783b6da70c66a59d5bc9eff054b67fc466cce7a"} Dec 04 00:31:03.786059 master-0 kubenswrapper[8678]: I1204 00:31:03.786039 8678 scope.go:117] "RemoveContainer" containerID="190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e" Dec 04 00:31:03.803102 master-0 kubenswrapper[8678]: I1204 00:31:03.803042 8678 scope.go:117] "RemoveContainer" containerID="190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e" Dec 04 00:31:03.803673 master-0 kubenswrapper[8678]: E1204 00:31:03.803637 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e\": container with ID starting with 190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e not found: ID does not exist" containerID="190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e" Dec 04 00:31:03.803722 master-0 kubenswrapper[8678]: I1204 00:31:03.803677 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e"} err="failed to get container status \"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e\": rpc error: code = NotFound desc = could not find container \"190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e\": container with ID starting with 190d72a6b2441d2930353c6a993769373ffba33c7ed81ee891fc42fba12ba83e not found: ID does not exist" Dec 04 00:31:04.075798 master-0 kubenswrapper[8678]: I1204 00:31:04.075654 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:31:04.076088 master-0 kubenswrapper[8678]: E1204 00:31:04.076063 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f800d89-ebdc-4956-8124-3514983665fa" containerName="installer" Dec 04 00:31:04.076088 master-0 kubenswrapper[8678]: I1204 00:31:04.076088 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f800d89-ebdc-4956-8124-3514983665fa" containerName="installer" Dec 04 00:31:04.076333 master-0 kubenswrapper[8678]: I1204 00:31:04.076309 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f800d89-ebdc-4956-8124-3514983665fa" containerName="installer" Dec 04 00:31:04.076981 master-0 kubenswrapper[8678]: I1204 00:31:04.076956 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.139601 master-0 kubenswrapper[8678]: I1204 00:31:04.139525 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.139813 master-0 kubenswrapper[8678]: I1204 00:31:04.139785 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.139910 master-0 kubenswrapper[8678]: I1204 00:31:04.139886 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.240816 master-0 kubenswrapper[8678]: I1204 00:31:04.240741 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.241063 master-0 kubenswrapper[8678]: I1204 00:31:04.240861 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.241063 master-0 kubenswrapper[8678]: I1204 00:31:04.240975 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.241182 master-0 kubenswrapper[8678]: I1204 00:31:04.241144 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.241248 master-0 kubenswrapper[8678]: I1204 00:31:04.241180 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.324095 master-0 kubenswrapper[8678]: I1204 00:31:04.324004 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:31:04.325427 master-0 kubenswrapper[8678]: I1204 00:31:04.325396 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.326469 master-0 kubenswrapper[8678]: I1204 00:31:04.326384 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:31:04.332765 master-0 kubenswrapper[8678]: I1204 00:31:04.332716 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.338357 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access\") pod \"installer-3-master-0\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.338657 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.338960 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.339096 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.339229 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.341994 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.346534 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.346598 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.346618 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rcl\" (UniqueName: \"kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.346640 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.359150 master-0 kubenswrapper[8678]: I1204 00:31:04.346672 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.364300 master-0 kubenswrapper[8678]: I1204 00:31:04.364239 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:04.373253 master-0 kubenswrapper[8678]: I1204 00:31:04.373205 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:31:04.373634 master-0 kubenswrapper[8678]: I1204 00:31:04.373257 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" podStartSLOduration=4.373232251 podStartE2EDuration="4.373232251s" podCreationTimestamp="2025-12-04 00:31:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:04.370909464 +0000 UTC m=+47.697642030" watchObservedRunningTime="2025-12-04 00:31:04.373232251 +0000 UTC m=+47.699964807" Dec 04 00:31:04.399212 master-0 kubenswrapper[8678]: I1204 00:31:04.398621 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:31:04.404371 master-0 kubenswrapper[8678]: I1204 00:31:04.403023 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:31:04.406625 master-0 kubenswrapper[8678]: I1204 00:31:04.406571 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:31:04.406808 master-0 kubenswrapper[8678]: I1204 00:31:04.406783 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:04.409401 master-0 kubenswrapper[8678]: I1204 00:31:04.409357 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.442702 master-0 kubenswrapper[8678]: I1204 00:31:04.442657 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.448648 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.448789 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.448853 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.448878 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.448972 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rcl\" (UniqueName: \"kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.449015 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.452087 master-0 kubenswrapper[8678]: I1204 00:31:04.449387 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgrlr\" (UniqueName: \"kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.455308 master-0 kubenswrapper[8678]: I1204 00:31:04.455037 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:31:04.460763 master-0 kubenswrapper[8678]: I1204 00:31:04.460690 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.460943 master-0 kubenswrapper[8678]: I1204 00:31:04.460887 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.461012 master-0 kubenswrapper[8678]: I1204 00:31:04.459340 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.461313 master-0 kubenswrapper[8678]: I1204 00:31:04.461278 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.464480 master-0 kubenswrapper[8678]: I1204 00:31:04.464432 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 00:31:04.482945 master-0 kubenswrapper[8678]: I1204 00:31:04.482864 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.493459 master-0 kubenswrapper[8678]: I1204 00:31:04.489865 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rcl\" (UniqueName: \"kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl\") pod \"controller-manager-5bbbf854f-x8c6r\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.539556 master-0 kubenswrapper[8678]: I1204 00:31:04.539487 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:04.563607 master-0 kubenswrapper[8678]: I1204 00:31:04.563541 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.563808 master-0 kubenswrapper[8678]: I1204 00:31:04.563636 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wgrlr\" (UniqueName: \"kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.563808 master-0 kubenswrapper[8678]: I1204 00:31:04.563697 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.564288 master-0 kubenswrapper[8678]: I1204 00:31:04.564249 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.564591 master-0 kubenswrapper[8678]: I1204 00:31:04.564554 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.587048 master-0 kubenswrapper[8678]: I1204 00:31:04.586890 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgrlr\" (UniqueName: \"kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr\") pod \"redhat-operators-g9q5w\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.738254 master-0 kubenswrapper[8678]: I1204 00:31:04.738208 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:04.786232 master-0 kubenswrapper[8678]: I1204 00:31:04.786182 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:04.804621 master-0 kubenswrapper[8678]: I1204 00:31:04.804558 8678 generic.go:334] "Generic (PLEG): container finished" podID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerID="0260f1b2a33a3eebffe951682fa3e58669a3e91c63d7896a0192719bf910c148" exitCode=0 Dec 04 00:31:04.805848 master-0 kubenswrapper[8678]: I1204 00:31:04.805812 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wlmqp" event={"ID":"27c42a3f-b337-4726-b1db-27a3e2092dde","Type":"ContainerDied","Data":"0260f1b2a33a3eebffe951682fa3e58669a3e91c63d7896a0192719bf910c148"} Dec 04 00:31:04.805910 master-0 kubenswrapper[8678]: I1204 00:31:04.805853 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wlmqp" event={"ID":"27c42a3f-b337-4726-b1db-27a3e2092dde","Type":"ContainerStarted","Data":"444fa404b19fae88c47c64476fab3c6780f0cbc4ceb42762cb9dc3d72adb6c30"} Dec 04 00:31:04.867879 master-0 kubenswrapper[8678]: I1204 00:31:04.867360 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6dcc87-66c9-4781-b725-426fc13b7610" path="/var/lib/kubelet/pods/0a6dcc87-66c9-4781-b725-426fc13b7610/volumes" Dec 04 00:31:04.868209 master-0 kubenswrapper[8678]: I1204 00:31:04.868178 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f800d89-ebdc-4956-8124-3514983665fa" path="/var/lib/kubelet/pods/2f800d89-ebdc-4956-8124-3514983665fa/volumes" Dec 04 00:31:04.906895 master-0 kubenswrapper[8678]: I1204 00:31:04.906853 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:31:05.069564 master-0 kubenswrapper[8678]: I1204 00:31:05.069518 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:31:05.137101 master-0 kubenswrapper[8678]: I1204 00:31:05.136735 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:31:05.138818 master-0 kubenswrapper[8678]: I1204 00:31:05.138788 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.148021 master-0 kubenswrapper[8678]: I1204 00:31:05.147941 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:31:05.180998 master-0 kubenswrapper[8678]: I1204 00:31:05.178387 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.180998 master-0 kubenswrapper[8678]: I1204 00:31:05.178502 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfvp\" (UniqueName: \"kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.180998 master-0 kubenswrapper[8678]: I1204 00:31:05.178546 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.208205 master-0 kubenswrapper[8678]: I1204 00:31:05.200024 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:31:05.281955 master-0 kubenswrapper[8678]: I1204 00:31:05.280906 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfvp\" (UniqueName: \"kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.281955 master-0 kubenswrapper[8678]: I1204 00:31:05.280995 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.281955 master-0 kubenswrapper[8678]: I1204 00:31:05.281039 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.281955 master-0 kubenswrapper[8678]: I1204 00:31:05.281547 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.281955 master-0 kubenswrapper[8678]: I1204 00:31:05.281792 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.299249 master-0 kubenswrapper[8678]: I1204 00:31:05.295505 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:31:05.385631 master-0 kubenswrapper[8678]: I1204 00:31:05.385324 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfvp\" (UniqueName: \"kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp\") pod \"certified-operators-5mxnd\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.471392 master-0 kubenswrapper[8678]: I1204 00:31:05.471102 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:05.584328 master-0 kubenswrapper[8678]: W1204 00:31:05.584240 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7289ceb2_9c01_4216_85c4_8e829f8914e0.slice/crio-2336240cf3110dccbdaaa1652909b56c3294564a12b035a2cba1f0709bcd823e WatchSource:0}: Error finding container 2336240cf3110dccbdaaa1652909b56c3294564a12b035a2cba1f0709bcd823e: Status 404 returned error can't find the container with id 2336240cf3110dccbdaaa1652909b56c3294564a12b035a2cba1f0709bcd823e Dec 04 00:31:05.585388 master-0 kubenswrapper[8678]: W1204 00:31:05.585341 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad761d1_d42c_4e56_9220_73ea1678eef5.slice/crio-e66b9d70cab55e01eb0fe4b058f0e6e54c3713e0eb6e4eb2664bc7df24d12174 WatchSource:0}: Error finding container e66b9d70cab55e01eb0fe4b058f0e6e54c3713e0eb6e4eb2664bc7df24d12174: Status 404 returned error can't find the container with id e66b9d70cab55e01eb0fe4b058f0e6e54c3713e0eb6e4eb2664bc7df24d12174 Dec 04 00:31:05.823397 master-0 kubenswrapper[8678]: I1204 00:31:05.823009 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerStarted","Data":"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00"} Dec 04 00:31:05.823397 master-0 kubenswrapper[8678]: I1204 00:31:05.823070 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerStarted","Data":"e66b9d70cab55e01eb0fe4b058f0e6e54c3713e0eb6e4eb2664bc7df24d12174"} Dec 04 00:31:05.825092 master-0 kubenswrapper[8678]: I1204 00:31:05.823880 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:05.825647 master-0 kubenswrapper[8678]: I1204 00:31:05.825268 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:31:05.825647 master-0 kubenswrapper[8678]: I1204 00:31:05.825306 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:31:05.825647 master-0 kubenswrapper[8678]: I1204 00:31:05.825614 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"7289ceb2-9c01-4216-85c4-8e829f8914e0","Type":"ContainerStarted","Data":"2336240cf3110dccbdaaa1652909b56c3294564a12b035a2cba1f0709bcd823e"} Dec 04 00:31:05.828157 master-0 kubenswrapper[8678]: I1204 00:31:05.827529 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"589ef02a-5447-43d6-8758-67916768cb54","Type":"ContainerStarted","Data":"eb9752bda63f59e422adedb362f3511d5e58c33687bfbe07f1c9b5c8e6269f19"} Dec 04 00:31:05.828157 master-0 kubenswrapper[8678]: I1204 00:31:05.827561 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"589ef02a-5447-43d6-8758-67916768cb54","Type":"ContainerStarted","Data":"6c829ae351da01cb8e274d2da6df88a49ed93566116896e25fa67f83f2b0e080"} Dec 04 00:31:05.829919 master-0 kubenswrapper[8678]: I1204 00:31:05.829839 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-g9q5w" event={"ID":"701d4ae9-e905-497b-96a5-0547eaee4073","Type":"ContainerStarted","Data":"b0812c11c868c93c56106d3e4e563a694957f43a0522155508f9ad0fa31c2af6"} Dec 04 00:31:05.829919 master-0 kubenswrapper[8678]: I1204 00:31:05.829876 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-g9q5w" event={"ID":"701d4ae9-e905-497b-96a5-0547eaee4073","Type":"ContainerStarted","Data":"61ca997dcbbbb6c02d13fc1692e0f5209abef55c7e3d9e56221bd818b019d615"} Dec 04 00:31:05.851902 master-0 kubenswrapper[8678]: I1204 00:31:05.851624 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podStartSLOduration=5.850784431 podStartE2EDuration="5.850784431s" podCreationTimestamp="2025-12-04 00:31:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:05.846867799 +0000 UTC m=+49.173600355" watchObservedRunningTime="2025-12-04 00:31:05.850784431 +0000 UTC m=+49.177516987" Dec 04 00:31:05.869601 master-0 kubenswrapper[8678]: I1204 00:31:05.869530 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-3-master-0" podStartSLOduration=2.869513795 podStartE2EDuration="2.869513795s" podCreationTimestamp="2025-12-04 00:31:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:05.867874389 +0000 UTC m=+49.194606945" watchObservedRunningTime="2025-12-04 00:31:05.869513795 +0000 UTC m=+49.196246351" Dec 04 00:31:06.012707 master-0 kubenswrapper[8678]: I1204 00:31:06.012630 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:31:06.035718 master-0 kubenswrapper[8678]: W1204 00:31:06.035647 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1568fd73_c51d_43c5_82d0_d938ecdf698f.slice/crio-e343ec38220612ebdd6e006cc166f6f07cd261e63b1759dac420fcf59e0e4c05 WatchSource:0}: Error finding container e343ec38220612ebdd6e006cc166f6f07cd261e63b1759dac420fcf59e0e4c05: Status 404 returned error can't find the container with id e343ec38220612ebdd6e006cc166f6f07cd261e63b1759dac420fcf59e0e4c05 Dec 04 00:31:06.867742 master-0 kubenswrapper[8678]: I1204 00:31:06.867548 8678 generic.go:334] "Generic (PLEG): container finished" podID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerID="29e7a5dc7a6a66069db88df24c212b94653dc047ed38836f0fcc68ce92912cbb" exitCode=0 Dec 04 00:31:06.876825 master-0 kubenswrapper[8678]: I1204 00:31:06.876778 8678 generic.go:334] "Generic (PLEG): container finished" podID="701d4ae9-e905-497b-96a5-0547eaee4073" containerID="b0812c11c868c93c56106d3e4e563a694957f43a0522155508f9ad0fa31c2af6" exitCode=0 Dec 04 00:31:06.906341 master-0 kubenswrapper[8678]: I1204 00:31:06.903949 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5mxnd" event={"ID":"1568fd73-c51d-43c5-82d0-d938ecdf698f","Type":"ContainerDied","Data":"29e7a5dc7a6a66069db88df24c212b94653dc047ed38836f0fcc68ce92912cbb"} Dec 04 00:31:06.906341 master-0 kubenswrapper[8678]: I1204 00:31:06.904079 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:31:06.906341 master-0 kubenswrapper[8678]: I1204 00:31:06.904097 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5mxnd" event={"ID":"1568fd73-c51d-43c5-82d0-d938ecdf698f","Type":"ContainerStarted","Data":"e343ec38220612ebdd6e006cc166f6f07cd261e63b1759dac420fcf59e0e4c05"} Dec 04 00:31:06.906341 master-0 kubenswrapper[8678]: I1204 00:31:06.904109 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-g9q5w" event={"ID":"701d4ae9-e905-497b-96a5-0547eaee4073","Type":"ContainerDied","Data":"b0812c11c868c93c56106d3e4e563a694957f43a0522155508f9ad0fa31c2af6"} Dec 04 00:31:06.906341 master-0 kubenswrapper[8678]: I1204 00:31:06.904127 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"7289ceb2-9c01-4216-85c4-8e829f8914e0","Type":"ContainerStarted","Data":"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65"} Dec 04 00:31:07.104431 master-0 kubenswrapper[8678]: I1204 00:31:07.104359 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-1-master-0" podStartSLOduration=4.104332965 podStartE2EDuration="4.104332965s" podCreationTimestamp="2025-12-04 00:31:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:31:07.101260067 +0000 UTC m=+50.427992623" watchObservedRunningTime="2025-12-04 00:31:07.104332965 +0000 UTC m=+50.431065521" Dec 04 00:31:09.153161 master-0 kubenswrapper[8678]: I1204 00:31:09.151428 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:31:09.334715 master-0 kubenswrapper[8678]: I1204 00:31:09.334649 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-cl29d"] Dec 04 00:31:09.335946 master-0 kubenswrapper[8678]: I1204 00:31:09.335908 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.338475 master-0 kubenswrapper[8678]: I1204 00:31:09.338326 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-d7vtk" Dec 04 00:31:09.347174 master-0 kubenswrapper[8678]: I1204 00:31:09.347122 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cl29d"] Dec 04 00:31:09.458838 master-0 kubenswrapper[8678]: I1204 00:31:09.458704 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.458838 master-0 kubenswrapper[8678]: I1204 00:31:09.458783 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.458838 master-0 kubenswrapper[8678]: I1204 00:31:09.458859 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslx5\" (UniqueName: \"kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.560466 master-0 kubenswrapper[8678]: I1204 00:31:09.560407 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.560690 master-0 kubenswrapper[8678]: I1204 00:31:09.560499 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sslx5\" (UniqueName: \"kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.560690 master-0 kubenswrapper[8678]: I1204 00:31:09.560566 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.561110 master-0 kubenswrapper[8678]: I1204 00:31:09.561086 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.561386 master-0 kubenswrapper[8678]: I1204 00:31:09.561357 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.580960 master-0 kubenswrapper[8678]: I1204 00:31:09.580900 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslx5\" (UniqueName: \"kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:09.660881 master-0 kubenswrapper[8678]: I1204 00:31:09.660827 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:10.406004 master-0 kubenswrapper[8678]: I1204 00:31:10.405347 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:31:10.741739 master-0 kubenswrapper[8678]: I1204 00:31:10.741655 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-m4q5k"] Dec 04 00:31:10.743296 master-0 kubenswrapper[8678]: I1204 00:31:10.742914 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.745673 master-0 kubenswrapper[8678]: I1204 00:31:10.745636 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4xsx2" Dec 04 00:31:10.757505 master-0 kubenswrapper[8678]: I1204 00:31:10.757098 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-m4q5k"] Dec 04 00:31:10.892960 master-0 kubenswrapper[8678]: I1204 00:31:10.892734 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.892960 master-0 kubenswrapper[8678]: I1204 00:31:10.892798 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.892960 master-0 kubenswrapper[8678]: I1204 00:31:10.892845 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt7lk\" (UniqueName: \"kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.994700 master-0 kubenswrapper[8678]: I1204 00:31:10.994470 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.994700 master-0 kubenswrapper[8678]: I1204 00:31:10.994517 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.994700 master-0 kubenswrapper[8678]: I1204 00:31:10.994561 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qt7lk\" (UniqueName: \"kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.995402 master-0 kubenswrapper[8678]: I1204 00:31:10.995278 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:10.995402 master-0 kubenswrapper[8678]: I1204 00:31:10.995286 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:11.011314 master-0 kubenswrapper[8678]: I1204 00:31:11.011268 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt7lk\" (UniqueName: \"kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:11.092231 master-0 kubenswrapper[8678]: I1204 00:31:11.092149 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cl29d"] Dec 04 00:31:11.095977 master-0 kubenswrapper[8678]: I1204 00:31:11.095543 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:11.098271 master-0 kubenswrapper[8678]: W1204 00:31:11.098236 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87adb521_b8d3_4201_b775_50c8c03956fc.slice/crio-7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2 WatchSource:0}: Error finding container 7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2: Status 404 returned error can't find the container with id 7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2 Dec 04 00:31:11.328361 master-0 kubenswrapper[8678]: I1204 00:31:11.328268 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:31:11.452138 master-0 kubenswrapper[8678]: I1204 00:31:11.451627 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:31:11.452138 master-0 kubenswrapper[8678]: I1204 00:31:11.451897 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/installer-3-master-0" podUID="589ef02a-5447-43d6-8758-67916768cb54" containerName="installer" containerID="cri-o://eb9752bda63f59e422adedb362f3511d5e58c33687bfbe07f1c9b5c8e6269f19" gracePeriod=30 Dec 04 00:31:11.534705 master-0 kubenswrapper[8678]: I1204 00:31:11.534579 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-dvxb6"] Dec 04 00:31:11.535804 master-0 kubenswrapper[8678]: I1204 00:31:11.535783 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.538985 master-0 kubenswrapper[8678]: I1204 00:31:11.538859 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-94kgq" Dec 04 00:31:11.545851 master-0 kubenswrapper[8678]: I1204 00:31:11.545803 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dvxb6"] Dec 04 00:31:11.560191 master-0 kubenswrapper[8678]: I1204 00:31:11.560129 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-m4q5k"] Dec 04 00:31:11.610016 master-0 kubenswrapper[8678]: I1204 00:31:11.606480 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.610016 master-0 kubenswrapper[8678]: I1204 00:31:11.606614 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.610016 master-0 kubenswrapper[8678]: I1204 00:31:11.606667 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt9j7\" (UniqueName: \"kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.727344 master-0 kubenswrapper[8678]: I1204 00:31:11.725543 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.727344 master-0 kubenswrapper[8678]: I1204 00:31:11.725642 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9j7\" (UniqueName: \"kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.727344 master-0 kubenswrapper[8678]: I1204 00:31:11.725682 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.727344 master-0 kubenswrapper[8678]: I1204 00:31:11.726162 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.727344 master-0 kubenswrapper[8678]: I1204 00:31:11.726660 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.766271 master-0 kubenswrapper[8678]: I1204 00:31:11.766217 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9j7\" (UniqueName: \"kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.865982 master-0 kubenswrapper[8678]: I1204 00:31:11.865853 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:31:11.918598 master-0 kubenswrapper[8678]: I1204 00:31:11.917753 8678 generic.go:334] "Generic (PLEG): container finished" podID="87adb521-b8d3-4201-b775-50c8c03956fc" containerID="d516ca20f1a8865e78f54f55e95e34898b42fc4b68d175dfe798bfb61fce6f2d" exitCode=0 Dec 04 00:31:11.918598 master-0 kubenswrapper[8678]: I1204 00:31:11.918029 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cl29d" event={"ID":"87adb521-b8d3-4201-b775-50c8c03956fc","Type":"ContainerDied","Data":"d516ca20f1a8865e78f54f55e95e34898b42fc4b68d175dfe798bfb61fce6f2d"} Dec 04 00:31:11.918598 master-0 kubenswrapper[8678]: I1204 00:31:11.918127 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cl29d" event={"ID":"87adb521-b8d3-4201-b775-50c8c03956fc","Type":"ContainerStarted","Data":"7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2"} Dec 04 00:31:11.920303 master-0 kubenswrapper[8678]: I1204 00:31:11.920215 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_589ef02a-5447-43d6-8758-67916768cb54/installer/0.log" Dec 04 00:31:11.920303 master-0 kubenswrapper[8678]: I1204 00:31:11.920243 8678 generic.go:334] "Generic (PLEG): container finished" podID="589ef02a-5447-43d6-8758-67916768cb54" containerID="eb9752bda63f59e422adedb362f3511d5e58c33687bfbe07f1c9b5c8e6269f19" exitCode=1 Dec 04 00:31:11.920303 master-0 kubenswrapper[8678]: I1204 00:31:11.920266 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"589ef02a-5447-43d6-8758-67916768cb54","Type":"ContainerDied","Data":"eb9752bda63f59e422adedb362f3511d5e58c33687bfbe07f1c9b5c8e6269f19"} Dec 04 00:31:13.132958 master-0 kubenswrapper[8678]: I1204 00:31:13.128078 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:31:13.464058 master-0 kubenswrapper[8678]: I1204 00:31:13.460761 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 00:31:13.464058 master-0 kubenswrapper[8678]: I1204 00:31:13.461480 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.464967 master-0 kubenswrapper[8678]: I1204 00:31:13.464898 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"installer-sa-dockercfg-zcnpq" Dec 04 00:31:13.474565 master-0 kubenswrapper[8678]: I1204 00:31:13.474484 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 00:31:13.544778 master-0 kubenswrapper[8678]: I1204 00:31:13.543405 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-zc792"] Dec 04 00:31:13.544778 master-0 kubenswrapper[8678]: I1204 00:31:13.544432 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.546574 master-0 kubenswrapper[8678]: I1204 00:31:13.546542 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-v4pfc" Dec 04 00:31:13.554717 master-0 kubenswrapper[8678]: I1204 00:31:13.552712 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.554717 master-0 kubenswrapper[8678]: I1204 00:31:13.552772 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.554717 master-0 kubenswrapper[8678]: I1204 00:31:13.552826 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.556957 master-0 kubenswrapper[8678]: I1204 00:31:13.556888 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zc792"] Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658551 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658621 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658664 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd68g\" (UniqueName: \"kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658695 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658802 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.658843 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.659098 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.662000 master-0 kubenswrapper[8678]: I1204 00:31:13.659151 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.684096 master-0 kubenswrapper[8678]: I1204 00:31:13.684046 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.760641 master-0 kubenswrapper[8678]: I1204 00:31:13.760491 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.760641 master-0 kubenswrapper[8678]: I1204 00:31:13.760574 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fd68g\" (UniqueName: \"kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.760641 master-0 kubenswrapper[8678]: I1204 00:31:13.760601 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.761209 master-0 kubenswrapper[8678]: I1204 00:31:13.761165 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.761484 master-0 kubenswrapper[8678]: I1204 00:31:13.761446 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.778262 master-0 kubenswrapper[8678]: I1204 00:31:13.778197 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd68g\" (UniqueName: \"kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:13.778869 master-0 kubenswrapper[8678]: I1204 00:31:13.778817 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:31:13.867619 master-0 kubenswrapper[8678]: I1204 00:31:13.867554 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:31:15.647099 master-0 kubenswrapper[8678]: I1204 00:31:15.647029 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72"] Dec 04 00:31:15.648148 master-0 kubenswrapper[8678]: I1204 00:31:15.648004 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:15.651610 master-0 kubenswrapper[8678]: I1204 00:31:15.651551 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-zg65n" Dec 04 00:31:15.651806 master-0 kubenswrapper[8678]: I1204 00:31:15.651756 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 00:31:15.662918 master-0 kubenswrapper[8678]: I1204 00:31:15.662407 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72"] Dec 04 00:31:15.662918 master-0 kubenswrapper[8678]: I1204 00:31:15.662783 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 00:31:15.663770 master-0 kubenswrapper[8678]: I1204 00:31:15.663244 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 00:31:15.792422 master-0 kubenswrapper[8678]: I1204 00:31:15.792332 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnmjf\" (UniqueName: \"kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:15.792674 master-0 kubenswrapper[8678]: I1204 00:31:15.792460 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:15.894085 master-0 kubenswrapper[8678]: I1204 00:31:15.894000 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bnmjf\" (UniqueName: \"kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:15.894344 master-0 kubenswrapper[8678]: I1204 00:31:15.894105 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:15.898005 master-0 kubenswrapper[8678]: I1204 00:31:15.897899 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:18.294198 master-0 kubenswrapper[8678]: I1204 00:31:18.294084 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 00:31:18.306667 master-0 kubenswrapper[8678]: I1204 00:31:18.306579 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 00:31:18.317868 master-0 kubenswrapper[8678]: I1204 00:31:18.317764 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnmjf\" (UniqueName: \"kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:18.384487 master-0 kubenswrapper[8678]: I1204 00:31:18.384390 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-zg65n" Dec 04 00:31:18.392535 master-0 kubenswrapper[8678]: I1204 00:31:18.392463 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:31:18.661751 master-0 kubenswrapper[8678]: W1204 00:31:18.661651 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf75491_0c03_4e02_9074_c9be808badd4.slice/crio-3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c WatchSource:0}: Error finding container 3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c: Status 404 returned error can't find the container with id 3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c Dec 04 00:31:18.961230 master-0 kubenswrapper[8678]: I1204 00:31:18.961038 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-1-master-0_463d57da-a6b6-40a7-b55b-90b5a187aed4/installer/0.log" Dec 04 00:31:18.961230 master-0 kubenswrapper[8678]: I1204 00:31:18.961191 8678 generic.go:334] "Generic (PLEG): container finished" podID="463d57da-a6b6-40a7-b55b-90b5a187aed4" containerID="2d89c372c05805535244dae698b4ac15fe947f62bb80840bccfb764e23f23224" exitCode=1 Dec 04 00:31:18.961567 master-0 kubenswrapper[8678]: I1204 00:31:18.961295 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"463d57da-a6b6-40a7-b55b-90b5a187aed4","Type":"ContainerDied","Data":"2d89c372c05805535244dae698b4ac15fe947f62bb80840bccfb764e23f23224"} Dec 04 00:31:18.962803 master-0 kubenswrapper[8678]: I1204 00:31:18.962710 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-m4q5k" event={"ID":"6bf75491-0c03-4e02-9074-c9be808badd4","Type":"ContainerStarted","Data":"3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c"} Dec 04 00:31:24.179798 master-0 kubenswrapper[8678]: I1204 00:31:24.179713 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:31:24.180776 master-0 kubenswrapper[8678]: I1204 00:31:24.180011 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/installer-1-master-0" podUID="7289ceb2-9c01-4216-85c4-8e829f8914e0" containerName="installer" containerID="cri-o://badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65" gracePeriod=30 Dec 04 00:31:26.010722 master-0 kubenswrapper[8678]: I1204 00:31:26.010566 8678 generic.go:334] "Generic (PLEG): container finished" podID="dd621016-f4f2-4839-aae0-a804e6023423" containerID="72ef57cbc2ab2d91c22b8824c0c1162b62192c4d47fd678a0547242b1b0822b4" exitCode=0 Dec 04 00:31:26.010722 master-0 kubenswrapper[8678]: I1204 00:31:26.010672 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerDied","Data":"72ef57cbc2ab2d91c22b8824c0c1162b62192c4d47fd678a0547242b1b0822b4"} Dec 04 00:31:26.011453 master-0 kubenswrapper[8678]: I1204 00:31:26.011417 8678 scope.go:117] "RemoveContainer" containerID="72ef57cbc2ab2d91c22b8824c0c1162b62192c4d47fd678a0547242b1b0822b4" Dec 04 00:31:28.267766 master-0 kubenswrapper[8678]: I1204 00:31:28.267689 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6"] Dec 04 00:31:28.275043 master-0 kubenswrapper[8678]: I1204 00:31:28.272121 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.279816 master-0 kubenswrapper[8678]: I1204 00:31:28.279756 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 00:31:28.280553 master-0 kubenswrapper[8678]: I1204 00:31:28.280427 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-dnxpd" Dec 04 00:31:28.281114 master-0 kubenswrapper[8678]: I1204 00:31:28.281079 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 00:31:28.281345 master-0 kubenswrapper[8678]: I1204 00:31:28.281307 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 00:31:28.281562 master-0 kubenswrapper[8678]: I1204 00:31:28.281364 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 00:31:28.281702 master-0 kubenswrapper[8678]: I1204 00:31:28.281410 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 00:31:28.300238 master-0 kubenswrapper[8678]: I1204 00:31:28.300175 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.300407 master-0 kubenswrapper[8678]: I1204 00:31:28.300251 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.300407 master-0 kubenswrapper[8678]: I1204 00:31:28.300361 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbh9\" (UniqueName: \"kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.300547 master-0 kubenswrapper[8678]: I1204 00:31:28.300441 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.401609 master-0 kubenswrapper[8678]: I1204 00:31:28.401494 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-knbh9\" (UniqueName: \"kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.401963 master-0 kubenswrapper[8678]: I1204 00:31:28.401626 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.401963 master-0 kubenswrapper[8678]: I1204 00:31:28.401797 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.401963 master-0 kubenswrapper[8678]: I1204 00:31:28.401890 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.403488 master-0 kubenswrapper[8678]: I1204 00:31:28.403392 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.404111 master-0 kubenswrapper[8678]: I1204 00:31:28.404058 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:28.406521 master-0 kubenswrapper[8678]: I1204 00:31:28.406467 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:29.531411 master-0 kubenswrapper[8678]: I1204 00:31:29.531329 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 00:31:29.533848 master-0 kubenswrapper[8678]: I1204 00:31:29.533803 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.537602 master-0 kubenswrapper[8678]: I1204 00:31:29.537576 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-xwbnk" Dec 04 00:31:29.730175 master-0 kubenswrapper[8678]: I1204 00:31:29.730103 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.730385 master-0 kubenswrapper[8678]: I1204 00:31:29.730197 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.730385 master-0 kubenswrapper[8678]: I1204 00:31:29.730304 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.831521 master-0 kubenswrapper[8678]: I1204 00:31:29.831354 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.831521 master-0 kubenswrapper[8678]: I1204 00:31:29.831426 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.831521 master-0 kubenswrapper[8678]: I1204 00:31:29.831454 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.832031 master-0 kubenswrapper[8678]: I1204 00:31:29.831570 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:29.832031 master-0 kubenswrapper[8678]: I1204 00:31:29.831618 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:31.085575 master-0 kubenswrapper[8678]: I1204 00:31:31.085494 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 00:31:31.333976 master-0 kubenswrapper[8678]: I1204 00:31:31.329608 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbh9\" (UniqueName: \"kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9\") pod \"machine-approver-5775bfbf6d-xq2l6\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:31.346658 master-0 kubenswrapper[8678]: I1204 00:31:31.345421 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:31.372243 master-0 kubenswrapper[8678]: I1204 00:31:31.369303 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:31:31.390138 master-0 kubenswrapper[8678]: I1204 00:31:31.390074 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 00:31:31.390457 master-0 kubenswrapper[8678]: I1204 00:31:31.390390 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0-master-0" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcdctl" containerID="cri-o://e06a5b4e4be58273879a0e221f9819c741e49f33730780a29935b023d52dc5fc" gracePeriod=30 Dec 04 00:31:31.390643 master-0 kubenswrapper[8678]: I1204 00:31:31.390572 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0-master-0" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcd" containerID="cri-o://c9637097b486453df64c71018abb37b06dfffe6f736dcd239764c377bfc5b3ec" gracePeriod=30 Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.393872 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: E1204 00:31:31.394198 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcd" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.394217 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcd" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: E1204 00:31:31.394237 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcdctl" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.394246 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcdctl" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.394392 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcd" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.394410 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="41b95a38663dd6fe34e183818a475977" containerName="etcdctl" Dec 04 00:31:31.400788 master-0 kubenswrapper[8678]: I1204 00:31:31.396393 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.494112 master-0 kubenswrapper[8678]: I1204 00:31:31.494061 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_589ef02a-5447-43d6-8758-67916768cb54/installer/0.log" Dec 04 00:31:31.494342 master-0 kubenswrapper[8678]: I1204 00:31:31.494138 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:31.585849 master-0 kubenswrapper[8678]: I1204 00:31:31.585768 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.585849 master-0 kubenswrapper[8678]: I1204 00:31:31.585837 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.586153 master-0 kubenswrapper[8678]: I1204 00:31:31.585868 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.586153 master-0 kubenswrapper[8678]: I1204 00:31:31.585896 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.586153 master-0 kubenswrapper[8678]: I1204 00:31:31.585917 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.586153 master-0 kubenswrapper[8678]: I1204 00:31:31.585963 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.616153 master-0 kubenswrapper[8678]: I1204 00:31:31.612474 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:31:31.687075 master-0 kubenswrapper[8678]: I1204 00:31:31.686964 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock\") pod \"589ef02a-5447-43d6-8758-67916768cb54\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " Dec 04 00:31:31.687401 master-0 kubenswrapper[8678]: I1204 00:31:31.687167 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir\") pod \"589ef02a-5447-43d6-8758-67916768cb54\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " Dec 04 00:31:31.687401 master-0 kubenswrapper[8678]: I1204 00:31:31.687222 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access\") pod \"589ef02a-5447-43d6-8758-67916768cb54\" (UID: \"589ef02a-5447-43d6-8758-67916768cb54\") " Dec 04 00:31:31.687401 master-0 kubenswrapper[8678]: I1204 00:31:31.687146 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock" (OuterVolumeSpecName: "var-lock") pod "589ef02a-5447-43d6-8758-67916768cb54" (UID: "589ef02a-5447-43d6-8758-67916768cb54"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:31.687401 master-0 kubenswrapper[8678]: I1204 00:31:31.687195 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "589ef02a-5447-43d6-8758-67916768cb54" (UID: "589ef02a-5447-43d6-8758-67916768cb54"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:31.687632 master-0 kubenswrapper[8678]: I1204 00:31:31.687531 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687632 master-0 kubenswrapper[8678]: I1204 00:31:31.687584 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687748 master-0 kubenswrapper[8678]: I1204 00:31:31.687632 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687748 master-0 kubenswrapper[8678]: I1204 00:31:31.687683 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687748 master-0 kubenswrapper[8678]: I1204 00:31:31.687700 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687748 master-0 kubenswrapper[8678]: I1204 00:31:31.687725 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.687748 master-0 kubenswrapper[8678]: I1204 00:31:31.687737 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688047 master-0 kubenswrapper[8678]: I1204 00:31:31.687780 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688047 master-0 kubenswrapper[8678]: I1204 00:31:31.687800 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688536 master-0 kubenswrapper[8678]: I1204 00:31:31.687811 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688768 master-0 kubenswrapper[8678]: I1204 00:31:31.688576 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688768 master-0 kubenswrapper[8678]: I1204 00:31:31.688601 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir\") pod \"etcd-master-0\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:31:31.688858 master-0 kubenswrapper[8678]: I1204 00:31:31.688808 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:31.688858 master-0 kubenswrapper[8678]: I1204 00:31:31.688835 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/589ef02a-5447-43d6-8758-67916768cb54-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:31.692263 master-0 kubenswrapper[8678]: I1204 00:31:31.692198 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "589ef02a-5447-43d6-8758-67916768cb54" (UID: "589ef02a-5447-43d6-8758-67916768cb54"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:31.789898 master-0 kubenswrapper[8678]: I1204 00:31:31.789786 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/589ef02a-5447-43d6-8758-67916768cb54-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:32.044696 master-0 kubenswrapper[8678]: I1204 00:31:32.044554 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_589ef02a-5447-43d6-8758-67916768cb54/installer/0.log" Dec 04 00:31:32.044696 master-0 kubenswrapper[8678]: I1204 00:31:32.044645 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"589ef02a-5447-43d6-8758-67916768cb54","Type":"ContainerDied","Data":"6c829ae351da01cb8e274d2da6df88a49ed93566116896e25fa67f83f2b0e080"} Dec 04 00:31:32.045083 master-0 kubenswrapper[8678]: I1204 00:31:32.044805 8678 scope.go:117] "RemoveContainer" containerID="eb9752bda63f59e422adedb362f3511d5e58c33687bfbe07f1c9b5c8e6269f19" Dec 04 00:31:32.045083 master-0 kubenswrapper[8678]: I1204 00:31:32.044907 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 00:31:32.046249 master-0 kubenswrapper[8678]: I1204 00:31:32.046208 8678 generic.go:334] "Generic (PLEG): container finished" podID="655dc370-c0d1-4d03-a317-64bf099aff1b" containerID="0db991bc2c684e18f0fe34aa8f75dfa9ac756868127a83baa31a7ad2463083aa" exitCode=0 Dec 04 00:31:32.046249 master-0 kubenswrapper[8678]: I1204 00:31:32.046245 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerDied","Data":"0db991bc2c684e18f0fe34aa8f75dfa9ac756868127a83baa31a7ad2463083aa"} Dec 04 00:31:32.046734 master-0 kubenswrapper[8678]: I1204 00:31:32.046697 8678 scope.go:117] "RemoveContainer" containerID="0db991bc2c684e18f0fe34aa8f75dfa9ac756868127a83baa31a7ad2463083aa" Dec 04 00:31:34.836240 master-0 kubenswrapper[8678]: I1204 00:31:34.836198 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-1-master-0_463d57da-a6b6-40a7-b55b-90b5a187aed4/installer/0.log" Dec 04 00:31:34.836614 master-0 kubenswrapper[8678]: I1204 00:31:34.836294 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:31:34.945775 master-0 kubenswrapper[8678]: W1204 00:31:34.945709 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9c7534_48b5_4a4f_a534_267f33544210.slice/crio-b566db61a8be0af3dfe32b78896da946ada78cbd35b78135d4c1372f66a4fa19 WatchSource:0}: Error finding container b566db61a8be0af3dfe32b78896da946ada78cbd35b78135d4c1372f66a4fa19: Status 404 returned error can't find the container with id b566db61a8be0af3dfe32b78896da946ada78cbd35b78135d4c1372f66a4fa19 Dec 04 00:31:35.029053 master-0 kubenswrapper[8678]: I1204 00:31:35.029022 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir\") pod \"463d57da-a6b6-40a7-b55b-90b5a187aed4\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " Dec 04 00:31:35.029162 master-0 kubenswrapper[8678]: I1204 00:31:35.029075 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock\") pod \"463d57da-a6b6-40a7-b55b-90b5a187aed4\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " Dec 04 00:31:35.029162 master-0 kubenswrapper[8678]: I1204 00:31:35.029140 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access\") pod \"463d57da-a6b6-40a7-b55b-90b5a187aed4\" (UID: \"463d57da-a6b6-40a7-b55b-90b5a187aed4\") " Dec 04 00:31:35.029421 master-0 kubenswrapper[8678]: I1204 00:31:35.029391 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "463d57da-a6b6-40a7-b55b-90b5a187aed4" (UID: "463d57da-a6b6-40a7-b55b-90b5a187aed4"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:35.029482 master-0 kubenswrapper[8678]: I1204 00:31:35.029443 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock" (OuterVolumeSpecName: "var-lock") pod "463d57da-a6b6-40a7-b55b-90b5a187aed4" (UID: "463d57da-a6b6-40a7-b55b-90b5a187aed4"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:35.036988 master-0 kubenswrapper[8678]: I1204 00:31:35.036943 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "463d57da-a6b6-40a7-b55b-90b5a187aed4" (UID: "463d57da-a6b6-40a7-b55b-90b5a187aed4"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:35.131125 master-0 kubenswrapper[8678]: I1204 00:31:35.130599 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:35.131125 master-0 kubenswrapper[8678]: I1204 00:31:35.130634 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/463d57da-a6b6-40a7-b55b-90b5a187aed4-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:35.131125 master-0 kubenswrapper[8678]: I1204 00:31:35.130644 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/463d57da-a6b6-40a7-b55b-90b5a187aed4-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:35.140222 master-0 kubenswrapper[8678]: I1204 00:31:35.140125 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"463d57da-a6b6-40a7-b55b-90b5a187aed4","Type":"ContainerDied","Data":"46441a01a04010f2bbf14286151d0c9346c90660c7c0a3c48c5057c8bbd0b36e"} Dec 04 00:31:35.140222 master-0 kubenswrapper[8678]: I1204 00:31:35.140203 8678 scope.go:117] "RemoveContainer" containerID="2d89c372c05805535244dae698b4ac15fe947f62bb80840bccfb764e23f23224" Dec 04 00:31:35.140385 master-0 kubenswrapper[8678]: I1204 00:31:35.140341 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 00:31:35.166705 master-0 kubenswrapper[8678]: I1204 00:31:35.166650 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerStarted","Data":"b566db61a8be0af3dfe32b78896da946ada78cbd35b78135d4c1372f66a4fa19"} Dec 04 00:31:36.174574 master-0 kubenswrapper[8678]: I1204 00:31:36.174514 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerStarted","Data":"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4"} Dec 04 00:31:36.176494 master-0 kubenswrapper[8678]: I1204 00:31:36.176465 8678 generic.go:334] "Generic (PLEG): container finished" podID="701d4ae9-e905-497b-96a5-0547eaee4073" containerID="403fb28c648e8b713ed321767fe6d95600049c4b15111253ea8c1b753bc095d8" exitCode=0 Dec 04 00:31:36.176603 master-0 kubenswrapper[8678]: I1204 00:31:36.176533 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-g9q5w" event={"ID":"701d4ae9-e905-497b-96a5-0547eaee4073","Type":"ContainerDied","Data":"403fb28c648e8b713ed321767fe6d95600049c4b15111253ea8c1b753bc095d8"} Dec 04 00:31:36.178765 master-0 kubenswrapper[8678]: I1204 00:31:36.178733 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerStarted","Data":"4a833ea2a9a15920b34c9ef6e8f314468e42b929cf904fcaab498c2e48700df5"} Dec 04 00:31:36.181390 master-0 kubenswrapper[8678]: I1204 00:31:36.181239 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerStarted","Data":"04b6797d433194e1224976bde27df7380ac53111703d386c9136d1bdaf11768c"} Dec 04 00:31:36.184427 master-0 kubenswrapper[8678]: I1204 00:31:36.184397 8678 generic.go:334] "Generic (PLEG): container finished" podID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerID="f65a6d3049f35ae094100abad2b8c8e3445f843790f6f94ff485d70f3fc3bda7" exitCode=0 Dec 04 00:31:36.184526 master-0 kubenswrapper[8678]: I1204 00:31:36.184451 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5mxnd" event={"ID":"1568fd73-c51d-43c5-82d0-d938ecdf698f","Type":"ContainerDied","Data":"f65a6d3049f35ae094100abad2b8c8e3445f843790f6f94ff485d70f3fc3bda7"} Dec 04 00:31:36.186433 master-0 kubenswrapper[8678]: I1204 00:31:36.186402 8678 generic.go:334] "Generic (PLEG): container finished" podID="6bf75491-0c03-4e02-9074-c9be808badd4" containerID="560704e0aa4e94086401afcfa753359b76f4ad836e4da9eb3594a626e90afa1f" exitCode=0 Dec 04 00:31:36.186496 master-0 kubenswrapper[8678]: I1204 00:31:36.186449 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-m4q5k" event={"ID":"6bf75491-0c03-4e02-9074-c9be808badd4","Type":"ContainerDied","Data":"560704e0aa4e94086401afcfa753359b76f4ad836e4da9eb3594a626e90afa1f"} Dec 04 00:31:36.188620 master-0 kubenswrapper[8678]: I1204 00:31:36.188595 8678 generic.go:334] "Generic (PLEG): container finished" podID="87adb521-b8d3-4201-b775-50c8c03956fc" containerID="7523d2094b7d9f0f4c1bf4fb5fb915bcee3ec77caca9eebcffa9058251f228f8" exitCode=0 Dec 04 00:31:36.188734 master-0 kubenswrapper[8678]: I1204 00:31:36.188640 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cl29d" event={"ID":"87adb521-b8d3-4201-b775-50c8c03956fc","Type":"ContainerDied","Data":"7523d2094b7d9f0f4c1bf4fb5fb915bcee3ec77caca9eebcffa9058251f228f8"} Dec 04 00:31:36.191135 master-0 kubenswrapper[8678]: I1204 00:31:36.191036 8678 generic.go:334] "Generic (PLEG): container finished" podID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerID="d182b6ceeb56eb6280bcd223b1fb6b5344a19015388b95a9502ac848b6950eba" exitCode=0 Dec 04 00:31:36.191135 master-0 kubenswrapper[8678]: I1204 00:31:36.191111 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9rfw4" event={"ID":"41f0ae0a-011e-4a4d-8fb6-773afb62f04d","Type":"ContainerDied","Data":"d182b6ceeb56eb6280bcd223b1fb6b5344a19015388b95a9502ac848b6950eba"} Dec 04 00:31:36.194062 master-0 kubenswrapper[8678]: I1204 00:31:36.193490 8678 generic.go:334] "Generic (PLEG): container finished" podID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerID="b741fe2121d281d124864f628cf1a492e955ebbdd79c6d25fa66273d1b34db7b" exitCode=0 Dec 04 00:31:36.194062 master-0 kubenswrapper[8678]: I1204 00:31:36.193518 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wlmqp" event={"ID":"27c42a3f-b337-4726-b1db-27a3e2092dde","Type":"ContainerDied","Data":"b741fe2121d281d124864f628cf1a492e955ebbdd79c6d25fa66273d1b34db7b"} Dec 04 00:31:36.974470 master-0 kubenswrapper[8678]: I1204 00:31:36.974427 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:36.987326 master-0 kubenswrapper[8678]: I1204 00:31:36.987295 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:36.987463 master-0 kubenswrapper[8678]: I1204 00:31:36.987426 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:37.005376 master-0 kubenswrapper[8678]: I1204 00:31:37.005332 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:37.160284 master-0 kubenswrapper[8678]: I1204 00:31:37.160247 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxjn7\" (UniqueName: \"kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7\") pod \"27c42a3f-b337-4726-b1db-27a3e2092dde\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " Dec 04 00:31:37.160402 master-0 kubenswrapper[8678]: I1204 00:31:37.160297 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgrlr\" (UniqueName: \"kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr\") pod \"701d4ae9-e905-497b-96a5-0547eaee4073\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " Dec 04 00:31:37.160402 master-0 kubenswrapper[8678]: I1204 00:31:37.160345 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content\") pod \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " Dec 04 00:31:37.160402 master-0 kubenswrapper[8678]: I1204 00:31:37.160368 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzfvp\" (UniqueName: \"kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp\") pod \"1568fd73-c51d-43c5-82d0-d938ecdf698f\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160418 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content\") pod \"701d4ae9-e905-497b-96a5-0547eaee4073\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160477 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities\") pod \"27c42a3f-b337-4726-b1db-27a3e2092dde\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160498 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content\") pod \"27c42a3f-b337-4726-b1db-27a3e2092dde\" (UID: \"27c42a3f-b337-4726-b1db-27a3e2092dde\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160519 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c9kv\" (UniqueName: \"kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv\") pod \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160534 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities\") pod \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\" (UID: \"41f0ae0a-011e-4a4d-8fb6-773afb62f04d\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160556 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities\") pod \"701d4ae9-e905-497b-96a5-0547eaee4073\" (UID: \"701d4ae9-e905-497b-96a5-0547eaee4073\") " Dec 04 00:31:37.160578 master-0 kubenswrapper[8678]: I1204 00:31:37.160584 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities\") pod \"1568fd73-c51d-43c5-82d0-d938ecdf698f\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " Dec 04 00:31:37.160839 master-0 kubenswrapper[8678]: I1204 00:31:37.160604 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content\") pod \"1568fd73-c51d-43c5-82d0-d938ecdf698f\" (UID: \"1568fd73-c51d-43c5-82d0-d938ecdf698f\") " Dec 04 00:31:37.161802 master-0 kubenswrapper[8678]: I1204 00:31:37.161766 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities" (OuterVolumeSpecName: "utilities") pod "41f0ae0a-011e-4a4d-8fb6-773afb62f04d" (UID: "41f0ae0a-011e-4a4d-8fb6-773afb62f04d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.162212 master-0 kubenswrapper[8678]: I1204 00:31:37.161824 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities" (OuterVolumeSpecName: "utilities") pod "701d4ae9-e905-497b-96a5-0547eaee4073" (UID: "701d4ae9-e905-497b-96a5-0547eaee4073"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.163361 master-0 kubenswrapper[8678]: I1204 00:31:37.163313 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities" (OuterVolumeSpecName: "utilities") pod "1568fd73-c51d-43c5-82d0-d938ecdf698f" (UID: "1568fd73-c51d-43c5-82d0-d938ecdf698f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.163462 master-0 kubenswrapper[8678]: I1204 00:31:37.163428 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities" (OuterVolumeSpecName: "utilities") pod "27c42a3f-b337-4726-b1db-27a3e2092dde" (UID: "27c42a3f-b337-4726-b1db-27a3e2092dde"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.163517 master-0 kubenswrapper[8678]: I1204 00:31:37.163458 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7" (OuterVolumeSpecName: "kube-api-access-xxjn7") pod "27c42a3f-b337-4726-b1db-27a3e2092dde" (UID: "27c42a3f-b337-4726-b1db-27a3e2092dde"). InnerVolumeSpecName "kube-api-access-xxjn7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:37.163589 master-0 kubenswrapper[8678]: I1204 00:31:37.163553 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp" (OuterVolumeSpecName: "kube-api-access-pzfvp") pod "1568fd73-c51d-43c5-82d0-d938ecdf698f" (UID: "1568fd73-c51d-43c5-82d0-d938ecdf698f"). InnerVolumeSpecName "kube-api-access-pzfvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:37.164328 master-0 kubenswrapper[8678]: I1204 00:31:37.164261 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv" (OuterVolumeSpecName: "kube-api-access-8c9kv") pod "41f0ae0a-011e-4a4d-8fb6-773afb62f04d" (UID: "41f0ae0a-011e-4a4d-8fb6-773afb62f04d"). InnerVolumeSpecName "kube-api-access-8c9kv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:37.166977 master-0 kubenswrapper[8678]: I1204 00:31:37.166949 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr" (OuterVolumeSpecName: "kube-api-access-wgrlr") pod "701d4ae9-e905-497b-96a5-0547eaee4073" (UID: "701d4ae9-e905-497b-96a5-0547eaee4073"). InnerVolumeSpecName "kube-api-access-wgrlr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:37.185289 master-0 kubenswrapper[8678]: I1204 00:31:37.185205 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "27c42a3f-b337-4726-b1db-27a3e2092dde" (UID: "27c42a3f-b337-4726-b1db-27a3e2092dde"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.197358 master-0 kubenswrapper[8678]: I1204 00:31:37.187980 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-1-master-0_7289ceb2-9c01-4216-85c4-8e829f8914e0/installer/0.log" Dec 04 00:31:37.197358 master-0 kubenswrapper[8678]: I1204 00:31:37.188060 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:37.201827 master-0 kubenswrapper[8678]: I1204 00:31:37.201768 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5mxnd" event={"ID":"1568fd73-c51d-43c5-82d0-d938ecdf698f","Type":"ContainerDied","Data":"e343ec38220612ebdd6e006cc166f6f07cd261e63b1759dac420fcf59e0e4c05"} Dec 04 00:31:37.201949 master-0 kubenswrapper[8678]: I1204 00:31:37.201870 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5mxnd" Dec 04 00:31:37.202042 master-0 kubenswrapper[8678]: I1204 00:31:37.201991 8678 scope.go:117] "RemoveContainer" containerID="f65a6d3049f35ae094100abad2b8c8e3445f843790f6f94ff485d70f3fc3bda7" Dec 04 00:31:37.204791 master-0 kubenswrapper[8678]: I1204 00:31:37.204738 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wlmqp" event={"ID":"27c42a3f-b337-4726-b1db-27a3e2092dde","Type":"ContainerDied","Data":"444fa404b19fae88c47c64476fab3c6780f0cbc4ceb42762cb9dc3d72adb6c30"} Dec 04 00:31:37.204853 master-0 kubenswrapper[8678]: I1204 00:31:37.204790 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wlmqp" Dec 04 00:31:37.210361 master-0 kubenswrapper[8678]: I1204 00:31:37.210187 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-m4q5k" event={"ID":"6bf75491-0c03-4e02-9074-c9be808badd4","Type":"ContainerStarted","Data":"169a373d3c6d0dc508b99753a1ce47ee9558b95c874853118845c82490d5a2bc"} Dec 04 00:31:37.216488 master-0 kubenswrapper[8678]: I1204 00:31:37.216421 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-g9q5w" event={"ID":"701d4ae9-e905-497b-96a5-0547eaee4073","Type":"ContainerDied","Data":"61ca997dcbbbb6c02d13fc1692e0f5209abef55c7e3d9e56221bd818b019d615"} Dec 04 00:31:37.216488 master-0 kubenswrapper[8678]: I1204 00:31:37.216487 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-g9q5w" Dec 04 00:31:37.218913 master-0 kubenswrapper[8678]: I1204 00:31:37.218859 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9rfw4" event={"ID":"41f0ae0a-011e-4a4d-8fb6-773afb62f04d","Type":"ContainerDied","Data":"d2b2b5bc4ff300cc1548fc4cdef713cb3d0b6977a057b305ee5b86bcad20f784"} Dec 04 00:31:37.219043 master-0 kubenswrapper[8678]: I1204 00:31:37.218971 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9rfw4" Dec 04 00:31:37.223378 master-0 kubenswrapper[8678]: I1204 00:31:37.223342 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-1-master-0_7289ceb2-9c01-4216-85c4-8e829f8914e0/installer/0.log" Dec 04 00:31:37.223493 master-0 kubenswrapper[8678]: I1204 00:31:37.223407 8678 generic.go:334] "Generic (PLEG): container finished" podID="7289ceb2-9c01-4216-85c4-8e829f8914e0" containerID="badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65" exitCode=1 Dec 04 00:31:37.223540 master-0 kubenswrapper[8678]: I1204 00:31:37.223499 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"7289ceb2-9c01-4216-85c4-8e829f8914e0","Type":"ContainerDied","Data":"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65"} Dec 04 00:31:37.223540 master-0 kubenswrapper[8678]: I1204 00:31:37.223521 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 00:31:37.223540 master-0 kubenswrapper[8678]: I1204 00:31:37.223539 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"7289ceb2-9c01-4216-85c4-8e829f8914e0","Type":"ContainerDied","Data":"2336240cf3110dccbdaaa1652909b56c3294564a12b035a2cba1f0709bcd823e"} Dec 04 00:31:37.223861 master-0 kubenswrapper[8678]: I1204 00:31:37.223808 8678 scope.go:117] "RemoveContainer" containerID="29e7a5dc7a6a66069db88df24c212b94653dc047ed38836f0fcc68ce92912cbb" Dec 04 00:31:37.226868 master-0 kubenswrapper[8678]: I1204 00:31:37.226820 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1568fd73-c51d-43c5-82d0-d938ecdf698f" (UID: "1568fd73-c51d-43c5-82d0-d938ecdf698f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.229778 master-0 kubenswrapper[8678]: I1204 00:31:37.229709 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "41f0ae0a-011e-4a4d-8fb6-773afb62f04d" (UID: "41f0ae0a-011e-4a4d-8fb6-773afb62f04d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.261851 master-0 kubenswrapper[8678]: I1204 00:31:37.261780 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262244 master-0 kubenswrapper[8678]: I1204 00:31:37.262227 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/27c42a3f-b337-4726-b1db-27a3e2092dde-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262358 master-0 kubenswrapper[8678]: I1204 00:31:37.262344 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8c9kv\" (UniqueName: \"kubernetes.io/projected/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-kube-api-access-8c9kv\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262476 master-0 kubenswrapper[8678]: I1204 00:31:37.262463 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262579 master-0 kubenswrapper[8678]: I1204 00:31:37.262566 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262679 master-0 kubenswrapper[8678]: I1204 00:31:37.262667 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262773 master-0 kubenswrapper[8678]: I1204 00:31:37.262760 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1568fd73-c51d-43c5-82d0-d938ecdf698f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262866 master-0 kubenswrapper[8678]: I1204 00:31:37.262854 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xxjn7\" (UniqueName: \"kubernetes.io/projected/27c42a3f-b337-4726-b1db-27a3e2092dde-kube-api-access-xxjn7\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.262971 master-0 kubenswrapper[8678]: I1204 00:31:37.262957 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wgrlr\" (UniqueName: \"kubernetes.io/projected/701d4ae9-e905-497b-96a5-0547eaee4073-kube-api-access-wgrlr\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.263197 master-0 kubenswrapper[8678]: I1204 00:31:37.263182 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/41f0ae0a-011e-4a4d-8fb6-773afb62f04d-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.263506 master-0 kubenswrapper[8678]: I1204 00:31:37.263492 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pzfvp\" (UniqueName: \"kubernetes.io/projected/1568fd73-c51d-43c5-82d0-d938ecdf698f-kube-api-access-pzfvp\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.271985 master-0 kubenswrapper[8678]: I1204 00:31:37.271960 8678 scope.go:117] "RemoveContainer" containerID="b741fe2121d281d124864f628cf1a492e955ebbdd79c6d25fa66273d1b34db7b" Dec 04 00:31:37.284376 master-0 kubenswrapper[8678]: I1204 00:31:37.284321 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "701d4ae9-e905-497b-96a5-0547eaee4073" (UID: "701d4ae9-e905-497b-96a5-0547eaee4073"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:31:37.292400 master-0 kubenswrapper[8678]: I1204 00:31:37.292337 8678 scope.go:117] "RemoveContainer" containerID="0260f1b2a33a3eebffe951682fa3e58669a3e91c63d7896a0192719bf910c148" Dec 04 00:31:37.313000 master-0 kubenswrapper[8678]: I1204 00:31:37.312943 8678 scope.go:117] "RemoveContainer" containerID="403fb28c648e8b713ed321767fe6d95600049c4b15111253ea8c1b753bc095d8" Dec 04 00:31:37.329089 master-0 kubenswrapper[8678]: I1204 00:31:37.329012 8678 scope.go:117] "RemoveContainer" containerID="b0812c11c868c93c56106d3e4e563a694957f43a0522155508f9ad0fa31c2af6" Dec 04 00:31:37.364223 master-0 kubenswrapper[8678]: I1204 00:31:37.364185 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir\") pod \"7289ceb2-9c01-4216-85c4-8e829f8914e0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " Dec 04 00:31:37.364570 master-0 kubenswrapper[8678]: I1204 00:31:37.364351 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "7289ceb2-9c01-4216-85c4-8e829f8914e0" (UID: "7289ceb2-9c01-4216-85c4-8e829f8914e0"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:37.364632 master-0 kubenswrapper[8678]: I1204 00:31:37.364556 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access\") pod \"7289ceb2-9c01-4216-85c4-8e829f8914e0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " Dec 04 00:31:37.364867 master-0 kubenswrapper[8678]: I1204 00:31:37.364853 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock\") pod \"7289ceb2-9c01-4216-85c4-8e829f8914e0\" (UID: \"7289ceb2-9c01-4216-85c4-8e829f8914e0\") " Dec 04 00:31:37.364994 master-0 kubenswrapper[8678]: I1204 00:31:37.364965 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock" (OuterVolumeSpecName: "var-lock") pod "7289ceb2-9c01-4216-85c4-8e829f8914e0" (UID: "7289ceb2-9c01-4216-85c4-8e829f8914e0"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:37.365242 master-0 kubenswrapper[8678]: I1204 00:31:37.365229 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.365305 master-0 kubenswrapper[8678]: I1204 00:31:37.365294 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7289ceb2-9c01-4216-85c4-8e829f8914e0-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.365385 master-0 kubenswrapper[8678]: I1204 00:31:37.365375 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/701d4ae9-e905-497b-96a5-0547eaee4073-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.367911 master-0 kubenswrapper[8678]: I1204 00:31:37.367861 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "7289ceb2-9c01-4216-85c4-8e829f8914e0" (UID: "7289ceb2-9c01-4216-85c4-8e829f8914e0"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:37.370356 master-0 kubenswrapper[8678]: I1204 00:31:37.370326 8678 scope.go:117] "RemoveContainer" containerID="d182b6ceeb56eb6280bcd223b1fb6b5344a19015388b95a9502ac848b6950eba" Dec 04 00:31:37.391752 master-0 kubenswrapper[8678]: I1204 00:31:37.391714 8678 scope.go:117] "RemoveContainer" containerID="c63f2e654b6b42a56ebf1acb79fcb5ebada66926722d7935eea90b37a368bcfa" Dec 04 00:31:37.466091 master-0 kubenswrapper[8678]: I1204 00:31:37.466020 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7289ceb2-9c01-4216-85c4-8e829f8914e0-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:37.472128 master-0 kubenswrapper[8678]: I1204 00:31:37.472087 8678 scope.go:117] "RemoveContainer" containerID="badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65" Dec 04 00:31:37.488817 master-0 kubenswrapper[8678]: I1204 00:31:37.488748 8678 scope.go:117] "RemoveContainer" containerID="badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65" Dec 04 00:31:37.489484 master-0 kubenswrapper[8678]: E1204 00:31:37.489364 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65\": container with ID starting with badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65 not found: ID does not exist" containerID="badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65" Dec 04 00:31:37.489484 master-0 kubenswrapper[8678]: I1204 00:31:37.489413 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65"} err="failed to get container status \"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65\": rpc error: code = NotFound desc = could not find container \"badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65\": container with ID starting with badfe9de90776fa29e59124d15f7e541e0f6050f26ecccc8c0bb230797dd0c65 not found: ID does not exist" Dec 04 00:31:38.235389 master-0 kubenswrapper[8678]: I1204 00:31:38.235260 8678 generic.go:334] "Generic (PLEG): container finished" podID="6bf75491-0c03-4e02-9074-c9be808badd4" containerID="169a373d3c6d0dc508b99753a1ce47ee9558b95c874853118845c82490d5a2bc" exitCode=0 Dec 04 00:31:38.235833 master-0 kubenswrapper[8678]: I1204 00:31:38.235343 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-m4q5k" event={"ID":"6bf75491-0c03-4e02-9074-c9be808badd4","Type":"ContainerDied","Data":"169a373d3c6d0dc508b99753a1ce47ee9558b95c874853118845c82490d5a2bc"} Dec 04 00:31:38.239756 master-0 kubenswrapper[8678]: I1204 00:31:38.239706 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerStarted","Data":"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4"} Dec 04 00:31:38.276824 master-0 kubenswrapper[8678]: I1204 00:31:38.276648 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" start-of-body= Dec 04 00:31:38.276824 master-0 kubenswrapper[8678]: I1204 00:31:38.276725 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" Dec 04 00:31:39.917007 master-0 kubenswrapper[8678]: I1204 00:31:39.916780 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:31:41.701056 master-0 kubenswrapper[8678]: E1204 00:31:41.700871 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:31:42.979065 master-0 kubenswrapper[8678]: I1204 00:31:42.978920 8678 patch_prober.go:28] interesting pod/etcd-operator-7978bf889c-zkr9h container/etcd-operator namespace/openshift-etcd-operator: Liveness probe status=failure output="Get \"https://10.128.0.23:8443/healthz\": dial tcp 10.128.0.23:8443: connect: connection refused" start-of-body= Dec 04 00:31:42.979852 master-0 kubenswrapper[8678]: I1204 00:31:42.979069 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" podUID="3e901355-2d0f-46f9-9d64-c4bc900b1839" containerName="etcd-operator" probeResult="failure" output="Get \"https://10.128.0.23:8443/healthz\": dial tcp 10.128.0.23:8443: connect: connection refused" Dec 04 00:31:44.439165 master-0 kubenswrapper[8678]: E1204 00:31:44.439043 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 00:31:44.440095 master-0 kubenswrapper[8678]: I1204 00:31:44.439583 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:31:45.284702 master-0 kubenswrapper[8678]: I1204 00:31:45.284438 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"5e40fbc1f91e93e83aa02f4c8705ede5b256793cec7aa3fb0036f5260cf5163f"} Dec 04 00:31:46.298645 master-0 kubenswrapper[8678]: I1204 00:31:46.298553 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-m4q5k" event={"ID":"6bf75491-0c03-4e02-9074-c9be808badd4","Type":"ContainerStarted","Data":"58d0ec93b3961b18b4f82c3944a8d35e3b0f1fe8c3ae0f62671a6417b7763d46"} Dec 04 00:31:46.300091 master-0 kubenswrapper[8678]: I1204 00:31:46.300022 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"67e38273020ce17d473eb917f328e45267b4f71464186e9b0145d163f9067d2c"} Dec 04 00:31:46.302351 master-0 kubenswrapper[8678]: I1204 00:31:46.302245 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cl29d" event={"ID":"87adb521-b8d3-4201-b775-50c8c03956fc","Type":"ContainerStarted","Data":"ee574414df682b2ae08ebd0d4c5536458494be431befebbb3d73cd84a523b21a"} Dec 04 00:31:46.306799 master-0 kubenswrapper[8678]: I1204 00:31:46.306733 8678 generic.go:334] "Generic (PLEG): container finished" podID="af25c964-8d39-457a-9214-6cadfecf3943" containerID="ac3c3f86fb624407fb4e83dc7253e2823922e10ea8a41094ef13f1bdb4f8569e" exitCode=0 Dec 04 00:31:46.306799 master-0 kubenswrapper[8678]: I1204 00:31:46.306782 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"af25c964-8d39-457a-9214-6cadfecf3943","Type":"ContainerDied","Data":"ac3c3f86fb624407fb4e83dc7253e2823922e10ea8a41094ef13f1bdb4f8569e"} Dec 04 00:31:47.314457 master-0 kubenswrapper[8678]: I1204 00:31:47.314371 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="67e38273020ce17d473eb917f328e45267b4f71464186e9b0145d163f9067d2c" exitCode=0 Dec 04 00:31:47.315219 master-0 kubenswrapper[8678]: I1204 00:31:47.314470 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerDied","Data":"67e38273020ce17d473eb917f328e45267b4f71464186e9b0145d163f9067d2c"} Dec 04 00:31:47.655102 master-0 kubenswrapper[8678]: I1204 00:31:47.655008 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 00:31:47.816096 master-0 kubenswrapper[8678]: I1204 00:31:47.815980 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock\") pod \"af25c964-8d39-457a-9214-6cadfecf3943\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " Dec 04 00:31:47.816438 master-0 kubenswrapper[8678]: I1204 00:31:47.816095 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock" (OuterVolumeSpecName: "var-lock") pod "af25c964-8d39-457a-9214-6cadfecf3943" (UID: "af25c964-8d39-457a-9214-6cadfecf3943"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:47.816438 master-0 kubenswrapper[8678]: I1204 00:31:47.816167 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access\") pod \"af25c964-8d39-457a-9214-6cadfecf3943\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " Dec 04 00:31:47.816438 master-0 kubenswrapper[8678]: I1204 00:31:47.816398 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir\") pod \"af25c964-8d39-457a-9214-6cadfecf3943\" (UID: \"af25c964-8d39-457a-9214-6cadfecf3943\") " Dec 04 00:31:47.816728 master-0 kubenswrapper[8678]: I1204 00:31:47.816636 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "af25c964-8d39-457a-9214-6cadfecf3943" (UID: "af25c964-8d39-457a-9214-6cadfecf3943"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:47.817295 master-0 kubenswrapper[8678]: I1204 00:31:47.817231 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:47.817382 master-0 kubenswrapper[8678]: I1204 00:31:47.817291 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af25c964-8d39-457a-9214-6cadfecf3943-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:47.820997 master-0 kubenswrapper[8678]: I1204 00:31:47.820953 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "af25c964-8d39-457a-9214-6cadfecf3943" (UID: "af25c964-8d39-457a-9214-6cadfecf3943"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:47.918500 master-0 kubenswrapper[8678]: I1204 00:31:47.918299 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/af25c964-8d39-457a-9214-6cadfecf3943-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:48.185813 master-0 kubenswrapper[8678]: E1204 00:31:48.185681 8678 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78739a7694769882b7e47ea5ac08a10.slice/crio-c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48.scope\": RecentStats: unable to find data in memory cache]" Dec 04 00:31:48.276264 master-0 kubenswrapper[8678]: I1204 00:31:48.276202 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" start-of-body= Dec 04 00:31:48.276264 master-0 kubenswrapper[8678]: I1204 00:31:48.276261 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" Dec 04 00:31:48.328978 master-0 kubenswrapper[8678]: I1204 00:31:48.328818 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"af25c964-8d39-457a-9214-6cadfecf3943","Type":"ContainerDied","Data":"c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f"} Dec 04 00:31:48.328978 master-0 kubenswrapper[8678]: I1204 00:31:48.328913 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f" Dec 04 00:31:48.328978 master-0 kubenswrapper[8678]: I1204 00:31:48.328919 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 00:31:48.337528 master-0 kubenswrapper[8678]: I1204 00:31:48.337484 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 00:31:48.337664 master-0 kubenswrapper[8678]: I1204 00:31:48.337563 8678 generic.go:334] "Generic (PLEG): container finished" podID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerID="d96499e83423aa41557961bd962596742a89753f0be63a3ad713fb62a1bb63b2" exitCode=1 Dec 04 00:31:48.337713 master-0 kubenswrapper[8678]: I1204 00:31:48.337667 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"f099c1a6-5f9e-4d81-8656-dd8f003f0143","Type":"ContainerDied","Data":"d96499e83423aa41557961bd962596742a89753f0be63a3ad713fb62a1bb63b2"} Dec 04 00:31:48.342580 master-0 kubenswrapper[8678]: I1204 00:31:48.342526 8678 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792" exitCode=1 Dec 04 00:31:48.342691 master-0 kubenswrapper[8678]: I1204 00:31:48.342644 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerDied","Data":"0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792"} Dec 04 00:31:48.342776 master-0 kubenswrapper[8678]: I1204 00:31:48.342721 8678 scope.go:117] "RemoveContainer" containerID="7ea8a9b86234b93e56e19f950f3d2d2961d8e816cc3f4e2162faaa102e036742" Dec 04 00:31:48.343962 master-0 kubenswrapper[8678]: I1204 00:31:48.343438 8678 scope.go:117] "RemoveContainer" containerID="0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792" Dec 04 00:31:49.350899 master-0 kubenswrapper[8678]: I1204 00:31:49.350830 8678 generic.go:334] "Generic (PLEG): container finished" podID="d78739a7694769882b7e47ea5ac08a10" containerID="c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48" exitCode=1 Dec 04 00:31:49.351659 master-0 kubenswrapper[8678]: I1204 00:31:49.351138 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerDied","Data":"c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48"} Dec 04 00:31:49.351659 master-0 kubenswrapper[8678]: I1204 00:31:49.351588 8678 scope.go:117] "RemoveContainer" containerID="c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48" Dec 04 00:31:49.441501 master-0 kubenswrapper[8678]: E1204 00:31:49.441254 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:31:39Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:31:39Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:31:39Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:31:39Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a17e9d83aeb6de5f0851aaacd1a9ebddbc8a4ac3ece2e4af8670aa0c33b8fc9c\\\"],\\\"sizeBytes\\\":1631769045},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:98ce2d349f8bc693d76d9a68097b758b987cf17ea3beb66bbd09d12fa78b4d0c\\\"],\\\"sizeBytes\\\":1232076476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a31af646ce5587c051459a88df413dc30be81e7f15399aa909e19effa7de772a\\\"],\\\"sizeBytes\\\":983731853},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\"],\\\"sizeBytes\\\":938321573},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f313372fe49afad871cc56225dcd4d31bed249abeab55fb288e1f854138fbf\\\"],\\\"sizeBytes\\\":870581225},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\\\"],\\\"sizeBytes\\\":857083855},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0e5c0acdd03dc840d7345ae397feaf6147a32a8fef89a0ac2ddc8d14b068c9ff\\\"],\\\"sizeBytes\\\":767313881},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:184239929f74bb7c56c1cf5b94b5f91dd4013a87034fe04b9fa1027d2bb6c5a4\\\"],\\\"sizeBytes\\\":682385666},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d866f93bed16cfebd8019ad6b89a4dd4abedfc20ee5d28d7edad045e7df0fda\\\"],\\\"sizeBytes\\\":677540255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14\\\"],\\\"sizeBytes\\\":672854011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff94e909d3b037c815e8ae67989a7616936e67195b758abac6b5d3f0d59562c8\\\"],\\\"sizeBytes\\\":616123373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da6f62afd2795d1b0af69532a5534c099bbb81d4e7abd2616b374db191552c51\\\"],\\\"sizeBytes\\\":583850203},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51a4c20765f54b6a6b5513f97cf54bb99631c2abe860949293456886a74f87fe\\\"],\\\"sizeBytes\\\":576621883},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc9758be9f0f0a480fb5e119ecb1e1101ef807bdc765a155212a8188d79b9e60\\\"],\\\"sizeBytes\\\":552687886},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e8903affdf29401b9a86b9f58795c9f445f34194960c7b2734f30601c48cbdf\\\"],\\\"sizeBytes\\\":543241813},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\\\"],\\\"sizeBytes\\\":532668041},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ceaa4102b35e54be54e23c8ea73bb0dac4978cffb54105ad00b51393f47595da\\\"],\\\"sizeBytes\\\":532338751},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca4933b9ba55069205ea53970128c4e8c4b46560ef721c8aaee00aaf736664b5\\\"],\\\"sizeBytes\\\":512852463},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:98c80d92a2ef8d44ee625b229b77b7bfdb1b06cbfe0d4df9e2ca2cba904467f7\\\"],\\\"sizeBytes\\\":512468025},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\"],\\\"sizeBytes\\\":509451797},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a2ef63f356c11ba629d8038474ab287797340de1219b4fee97c386975689110\\\"],\\\"sizeBytes\\\":507701628},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\\\"],\\\"sizeBytes\\\":506755373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:492103a8365ef9a1d5f237b4ba90aff87369167ec91db29ff0251ba5aab2b419\\\"],\\\"sizeBytes\\\":505663073},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c2b518cb834a0b6ca50d73eceb5f8e64aefb09094d39e4ba0d8e4632f6cdf908\\\"],\\\"sizeBytes\\\":505642108},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:58ed827ee19ac91b6f860d307797b24b8aec02e671605388c4afe4fa19ddfc36\\\"],\\\"sizeBytes\\\":503354646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefdc67602b8bc3941001b030ab95d82e10432f814634b80eb8ce45bc9ebd3de\\\"],\\\"sizeBytes\\\":503025552},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3051af3343018fecbf3a6edacea69de841fc5211c09e7fb6a2499188dc979395\\\"],\\\"sizeBytes\\\":502450335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cb6ecfb89e53653b69ae494ebc940b9fcf7b7db317b156e186435cc541589d9\\\"],\\\"sizeBytes\\\":500957387},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\\\"],\\\"sizeBytes\\\":500863090},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a6a3308d885301c7718a465f1af2d08a617abbdff23352d5422d1ae4af33cf\\\"],\\\"sizeBytes\\\":499812475},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\\\"],\\\"sizeBytes\\\":499719811},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:93145fd0c004dc4fca21435a32c7e55e962f321aff260d702f387cfdebee92a5\\\"],\\\"sizeBytes\\\":499096673},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0c6de747539dd00ede882fb4f73cead462bf0a7efda7173fd5d443ef7a00251\\\"],\\\"sizeBytes\\\":490470354},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6199be91b821875ba2609cf7fa886b74b9a8b573622fe33cc1bc39cd55acac08\\\"],\\\"sizeBytes\\\":489542560},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ebd79294a663cb38370ae81f9cda91cef7fb1370ec5b495b4bdb95e77272e6a8\\\"],\\\"sizeBytes\\\":481573011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b4e0b20fdb38d516e871ff5d593c4273cc9933cb6a65ec93e727ca4a7777fd20\\\"],\\\"sizeBytes\\\":478931717},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a3e2790bda8898df5e4e9cf1878103ac483ea1633819d76ea68976b0b2062b6\\\"],\\\"sizeBytes\\\":478655954},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:656fe650bac2929182cd0cf7d7e566d089f69e06541b8329c6d40b89346c03ca\\\"],\\\"sizeBytes\\\":462741734},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\\\"],\\\"sizeBytes\\\":459566623},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:607e31ebb2c85f53775455b38a607a68cb2bdab1e369f03c57e715a4ebb88831\\\"],\\\"sizeBytes\\\":458183681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36fa1378b9c26de6d45187b1e7352f3b1147109427fab3669b107d81fd967601\\\"],\\\"sizeBytes\\\":452603646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eac937aae64688cb47b38ad2cbba5aa7e6d41c691df1f3ca4ff81e5117084d1e\\\"],\\\"sizeBytes\\\":451053419},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7825952834ade266ce08d1a9eb0665e4661dea0a40647d3e1de2cf6266665e9d\\\"],\\\"sizeBytes\\\":443305841},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6dd80564094a262c1bb53c037288c9c69a46b22dc7dd3ee5c52384404ebfdc81\\\"],\\\"sizeBytes\\\":442523452},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:68dbccdff76515d5b659c9c2d031235073d292cb56a5385f8e69d24ac5f48b8f\\\"],\\\"sizeBytes\\\":437751308},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0e3400f1cb68a205bfb841b6b1a78045e7d80703830aa64979d46418d19c835\\\"],\\\"sizeBytes\\\":433128028},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee896bce586a3fcd37b4be8165cf1b4a83e88b5d47667de10475ec43e31b7926\\\"],\\\"sizeBytes\\\":406067436},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2f86d9ffe13cbab06ff676496b50a26bbc4819d8b81b98fbacca6aee9b56792f\\\"],\\\"sizeBytes\\\":401824348},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fff930cf757e23d388d86d05942b76e44d3bda5e387b299c239e4d12545d26dd\\\"],\\\"sizeBytes\\\":391002580}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": context deadline exceeded" Dec 04 00:31:49.661429 master-0 kubenswrapper[8678]: I1204 00:31:49.661251 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:49.661429 master-0 kubenswrapper[8678]: I1204 00:31:49.661328 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:49.753730 master-0 kubenswrapper[8678]: I1204 00:31:49.753659 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 00:31:49.753914 master-0 kubenswrapper[8678]: I1204 00:31:49.753742 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:31:49.844843 master-0 kubenswrapper[8678]: I1204 00:31:49.844743 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access\") pod \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " Dec 04 00:31:49.845176 master-0 kubenswrapper[8678]: I1204 00:31:49.845006 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock\") pod \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " Dec 04 00:31:49.845176 master-0 kubenswrapper[8678]: I1204 00:31:49.845056 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir\") pod \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\" (UID: \"f099c1a6-5f9e-4d81-8656-dd8f003f0143\") " Dec 04 00:31:49.845278 master-0 kubenswrapper[8678]: I1204 00:31:49.845195 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock" (OuterVolumeSpecName: "var-lock") pod "f099c1a6-5f9e-4d81-8656-dd8f003f0143" (UID: "f099c1a6-5f9e-4d81-8656-dd8f003f0143"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:49.845278 master-0 kubenswrapper[8678]: I1204 00:31:49.845218 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "f099c1a6-5f9e-4d81-8656-dd8f003f0143" (UID: "f099c1a6-5f9e-4d81-8656-dd8f003f0143"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:31:49.845497 master-0 kubenswrapper[8678]: I1204 00:31:49.845447 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:49.845497 master-0 kubenswrapper[8678]: I1204 00:31:49.845483 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:49.849836 master-0 kubenswrapper[8678]: I1204 00:31:49.849754 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f099c1a6-5f9e-4d81-8656-dd8f003f0143" (UID: "f099c1a6-5f9e-4d81-8656-dd8f003f0143"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:31:49.946761 master-0 kubenswrapper[8678]: I1204 00:31:49.946659 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f099c1a6-5f9e-4d81-8656-dd8f003f0143-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:31:50.359577 master-0 kubenswrapper[8678]: I1204 00:31:50.359546 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 00:31:50.360172 master-0 kubenswrapper[8678]: I1204 00:31:50.360146 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"f099c1a6-5f9e-4d81-8656-dd8f003f0143","Type":"ContainerDied","Data":"1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0"} Dec 04 00:31:50.360303 master-0 kubenswrapper[8678]: I1204 00:31:50.360286 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0" Dec 04 00:31:50.360403 master-0 kubenswrapper[8678]: I1204 00:31:50.360219 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:31:50.708100 master-0 kubenswrapper[8678]: I1204 00:31:50.708004 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-cl29d" podUID="87adb521-b8d3-4201-b775-50c8c03956fc" containerName="registry-server" probeResult="failure" output=< Dec 04 00:31:50.708100 master-0 kubenswrapper[8678]: timeout: failed to connect service ":50051" within 1s Dec 04 00:31:50.708100 master-0 kubenswrapper[8678]: > Dec 04 00:31:51.097496 master-0 kubenswrapper[8678]: I1204 00:31:51.097450 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:51.097804 master-0 kubenswrapper[8678]: I1204 00:31:51.097781 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:51.157699 master-0 kubenswrapper[8678]: I1204 00:31:51.157599 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:51.232118 master-0 kubenswrapper[8678]: I1204 00:31:51.232057 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:31:51.376845 master-0 kubenswrapper[8678]: I1204 00:31:51.376623 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"d78739a7694769882b7e47ea5ac08a10","Type":"ContainerStarted","Data":"4aff4c8c2a743025b7aa9d20fc797e5f60c554bd1c109adee5ee7fd129880d47"} Dec 04 00:31:51.380691 master-0 kubenswrapper[8678]: I1204 00:31:51.380640 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/0.log" Dec 04 00:31:51.380879 master-0 kubenswrapper[8678]: I1204 00:31:51.380739 8678 generic.go:334] "Generic (PLEG): container finished" podID="8a5721ad-a077-439a-9ec0-57d90dfb5c14" containerID="df73f6fd7772f71c1dc73cb2e3646ba79fbf327a83f244a8d49e3d13bf7bcc50" exitCode=1 Dec 04 00:31:51.380879 master-0 kubenswrapper[8678]: I1204 00:31:51.380807 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerDied","Data":"df73f6fd7772f71c1dc73cb2e3646ba79fbf327a83f244a8d49e3d13bf7bcc50"} Dec 04 00:31:51.382066 master-0 kubenswrapper[8678]: I1204 00:31:51.382011 8678 scope.go:117] "RemoveContainer" containerID="df73f6fd7772f71c1dc73cb2e3646ba79fbf327a83f244a8d49e3d13bf7bcc50" Dec 04 00:31:51.385250 master-0 kubenswrapper[8678]: I1204 00:31:51.385173 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"b61315793344ebcd4455235dcd882405194cc9e5d9bb66073a26fedf6f49f28c"} Dec 04 00:31:51.444998 master-0 kubenswrapper[8678]: I1204 00:31:51.443813 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:31:51.702124 master-0 kubenswrapper[8678]: E1204 00:31:51.701869 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:31:52.394387 master-0 kubenswrapper[8678]: I1204 00:31:52.394312 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/0.log" Dec 04 00:31:52.395505 master-0 kubenswrapper[8678]: I1204 00:31:52.394588 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerStarted","Data":"7f51b557a3ad1653c4152bc3d0fece4c806c2c0777a98f5a35231532d2e85bae"} Dec 04 00:31:55.968590 master-0 kubenswrapper[8678]: I1204 00:31:55.968488 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:31:58.277338 master-0 kubenswrapper[8678]: I1204 00:31:58.276706 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" start-of-body= Dec 04 00:31:58.278084 master-0 kubenswrapper[8678]: I1204 00:31:58.277461 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": dial tcp 10.128.0.24:8443: connect: connection refused" Dec 04 00:31:58.278084 master-0 kubenswrapper[8678]: I1204 00:31:58.277639 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:31:58.278743 master-0 kubenswrapper[8678]: I1204 00:31:58.278675 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="authentication-operator" containerStatusID={"Type":"cri-o","ID":"7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9"} pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" containerMessage="Container authentication-operator failed liveness probe, will be restarted" Dec 04 00:31:58.278837 master-0 kubenswrapper[8678]: I1204 00:31:58.278760 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" containerID="cri-o://7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9" gracePeriod=30 Dec 04 00:31:59.446382 master-0 kubenswrapper[8678]: E1204 00:31:59.443492 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:31:59.719417 master-0 kubenswrapper[8678]: I1204 00:31:59.719351 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:31:59.768222 master-0 kubenswrapper[8678]: I1204 00:31:59.768167 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:32:00.462480 master-0 kubenswrapper[8678]: I1204 00:32:00.462391 8678 generic.go:334] "Generic (PLEG): container finished" podID="41b95a38663dd6fe34e183818a475977" containerID="c9637097b486453df64c71018abb37b06dfffe6f736dcd239764c377bfc5b3ec" exitCode=0 Dec 04 00:32:01.232299 master-0 kubenswrapper[8678]: I1204 00:32:01.232162 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:32:01.352711 master-0 kubenswrapper[8678]: E1204 00:32:01.352598 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 00:32:01.471110 master-0 kubenswrapper[8678]: I1204 00:32:01.471063 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0-master-0_41b95a38663dd6fe34e183818a475977/etcdctl/0.log" Dec 04 00:32:01.471539 master-0 kubenswrapper[8678]: I1204 00:32:01.471142 8678 generic.go:334] "Generic (PLEG): container finished" podID="41b95a38663dd6fe34e183818a475977" containerID="e06a5b4e4be58273879a0e221f9819c741e49f33730780a29935b023d52dc5fc" exitCode=137 Dec 04 00:32:01.535651 master-0 kubenswrapper[8678]: I1204 00:32:01.535580 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0-master-0_41b95a38663dd6fe34e183818a475977/etcdctl/0.log" Dec 04 00:32:01.535830 master-0 kubenswrapper[8678]: I1204 00:32:01.535720 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:32:01.703358 master-0 kubenswrapper[8678]: E1204 00:32:01.703277 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:01.728870 master-0 kubenswrapper[8678]: I1204 00:32:01.728808 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs" (OuterVolumeSpecName: "certs") pod "41b95a38663dd6fe34e183818a475977" (UID: "41b95a38663dd6fe34e183818a475977"). InnerVolumeSpecName "certs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:32:01.729099 master-0 kubenswrapper[8678]: I1204 00:32:01.728950 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") pod \"41b95a38663dd6fe34e183818a475977\" (UID: \"41b95a38663dd6fe34e183818a475977\") " Dec 04 00:32:01.729099 master-0 kubenswrapper[8678]: I1204 00:32:01.729042 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") pod \"41b95a38663dd6fe34e183818a475977\" (UID: \"41b95a38663dd6fe34e183818a475977\") " Dec 04 00:32:01.729222 master-0 kubenswrapper[8678]: I1204 00:32:01.729132 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir" (OuterVolumeSpecName: "data-dir") pod "41b95a38663dd6fe34e183818a475977" (UID: "41b95a38663dd6fe34e183818a475977"). InnerVolumeSpecName "data-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:32:01.729596 master-0 kubenswrapper[8678]: I1204 00:32:01.729554 8678 reconciler_common.go:293] "Volume detached for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-data-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:32:01.729596 master-0 kubenswrapper[8678]: I1204 00:32:01.729589 8678 reconciler_common.go:293] "Volume detached for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/41b95a38663dd6fe34e183818a475977-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:32:02.480696 master-0 kubenswrapper[8678]: I1204 00:32:02.480630 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0-master-0_41b95a38663dd6fe34e183818a475977/etcdctl/0.log" Dec 04 00:32:02.481730 master-0 kubenswrapper[8678]: I1204 00:32:02.480810 8678 scope.go:117] "RemoveContainer" containerID="c9637097b486453df64c71018abb37b06dfffe6f736dcd239764c377bfc5b3ec" Dec 04 00:32:02.481730 master-0 kubenswrapper[8678]: I1204 00:32:02.480879 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:32:02.484346 master-0 kubenswrapper[8678]: I1204 00:32:02.483894 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="95ba4d49e94c16be82a5ba8e72d99997698c72b8ee596dfbc0232731eaeac613" exitCode=0 Dec 04 00:32:02.484346 master-0 kubenswrapper[8678]: I1204 00:32:02.483999 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerDied","Data":"95ba4d49e94c16be82a5ba8e72d99997698c72b8ee596dfbc0232731eaeac613"} Dec 04 00:32:02.507436 master-0 kubenswrapper[8678]: I1204 00:32:02.507351 8678 scope.go:117] "RemoveContainer" containerID="e06a5b4e4be58273879a0e221f9819c741e49f33730780a29935b023d52dc5fc" Dec 04 00:32:02.858849 master-0 kubenswrapper[8678]: I1204 00:32:02.858762 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b95a38663dd6fe34e183818a475977" path="/var/lib/kubelet/pods/41b95a38663dd6fe34e183818a475977/volumes" Dec 04 00:32:02.859300 master-0 kubenswrapper[8678]: I1204 00:32:02.859257 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:32:04.232798 master-0 kubenswrapper[8678]: I1204 00:32:04.232616 8678 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:05.397318 master-0 kubenswrapper[8678]: E1204 00:32:05.396963 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddbca68fcc944 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Killing,Message:Stopping container etcdctl,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:31:31.39037626 +0000 UTC m=+74.717108816,LastTimestamp:2025-12-04 00:31:31.39037626 +0000 UTC m=+74.717108816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:32:09.444665 master-0 kubenswrapper[8678]: E1204 00:32:09.444523 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:09.536761 master-0 kubenswrapper[8678]: I1204 00:32:09.536550 8678 generic.go:334] "Generic (PLEG): container finished" podID="3e901355-2d0f-46f9-9d64-c4bc900b1839" containerID="1f0462fd5b484033d78467a0da74f979aa85d8b25d9599d8df1e60ead439fb2e" exitCode=0 Dec 04 00:32:09.538832 master-0 kubenswrapper[8678]: I1204 00:32:09.538769 8678 generic.go:334] "Generic (PLEG): container finished" podID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerID="7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9" exitCode=0 Dec 04 00:32:11.704168 master-0 kubenswrapper[8678]: E1204 00:32:11.704014 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:14.232784 master-0 kubenswrapper[8678]: I1204 00:32:14.232629 8678 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:14.570651 master-0 kubenswrapper[8678]: I1204 00:32:14.570506 8678 generic.go:334] "Generic (PLEG): container finished" podID="04f4782e-b152-41c0-870a-08936498d1af" containerID="ef0a1dd8b3b02b9ccc27c7f5e6c342a96866c392b4b7777a54fb8bb661414577" exitCode=0 Dec 04 00:32:15.494702 master-0 kubenswrapper[8678]: E1204 00:32:15.494609 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 00:32:18.574809 master-0 kubenswrapper[8678]: E1204 00:32:18.574736 8678 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0616abbd_748a_4451_96b7_df0178c99e8f.slice/crio-conmon-0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee.scope\": RecentStats: unable to find data in memory cache]" Dec 04 00:32:18.596523 master-0 kubenswrapper[8678]: I1204 00:32:18.596477 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/0.log" Dec 04 00:32:18.596910 master-0 kubenswrapper[8678]: I1204 00:32:18.596833 8678 generic.go:334] "Generic (PLEG): container finished" podID="0616abbd-748a-4451-96b7-df0178c99e8f" containerID="0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee" exitCode=1 Dec 04 00:32:18.598908 master-0 kubenswrapper[8678]: I1204 00:32:18.598829 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-6cbf58c977-vjwnj_aa373a8f-8a9c-4f90-ae62-1d48fd88550b/network-operator/0.log" Dec 04 00:32:18.599092 master-0 kubenswrapper[8678]: I1204 00:32:18.598912 8678 generic.go:334] "Generic (PLEG): container finished" podID="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" containerID="016eb70a46f10bedd7dec24049021571b4b28da368391342d032b50cbe92ce70" exitCode=255 Dec 04 00:32:18.601625 master-0 kubenswrapper[8678]: I1204 00:32:18.601544 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="3ab83d217e29e8499eaf40a7b77ac6911f130d05e9b255651ddaf30e1585c461" exitCode=0 Dec 04 00:32:19.445415 master-0 kubenswrapper[8678]: E1204 00:32:19.445328 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:19.608775 master-0 kubenswrapper[8678]: I1204 00:32:19.608703 8678 generic.go:334] "Generic (PLEG): container finished" podID="26273240-2261-4564-bb64-1aaf774a921f" containerID="f675877019df3cdc18b7aefe49174ba92d0287bca845b45bc2f441207b0fb5fa" exitCode=0 Dec 04 00:32:20.618151 master-0 kubenswrapper[8678]: I1204 00:32:20.618026 8678 generic.go:334] "Generic (PLEG): container finished" podID="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" containerID="fd3589300b36ad6c047594904bec153361e0713f63741a4acf7e0ce1f226f895" exitCode=0 Dec 04 00:32:21.704851 master-0 kubenswrapper[8678]: E1204 00:32:21.704771 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:21.704851 master-0 kubenswrapper[8678]: I1204 00:32:21.704841 8678 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 00:32:24.232040 master-0 kubenswrapper[8678]: I1204 00:32:24.231865 8678 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:24.653449 master-0 kubenswrapper[8678]: I1204 00:32:24.653333 8678 generic.go:334] "Generic (PLEG): container finished" podID="ca8eddb5-4600-4058-94d2-5d0308c32613" containerID="53f3ad5a02fe61d14e3118f30603f785f895999675e16d3f4049dea7bd628227" exitCode=0 Dec 04 00:32:29.446608 master-0 kubenswrapper[8678]: E1204 00:32:29.446121 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:29.446608 master-0 kubenswrapper[8678]: E1204 00:32:29.446194 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:32:31.495429 master-0 kubenswrapper[8678]: I1204 00:32:31.495295 8678 status_manager.go:851] "Failed to get status for pod" podUID="589ef02a-5447-43d6-8758-67916768cb54" pod="openshift-kube-scheduler/installer-3-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods installer-3-master-0)" Dec 04 00:32:31.705714 master-0 kubenswrapper[8678]: E1204 00:32:31.705588 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="200ms" Dec 04 00:32:35.701692 master-0 kubenswrapper[8678]: E1204 00:32:35.701632 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:32:35.701692 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448" Netns:"/var/run/netns/24f5bbc5-a24b-436b-9c26-a3528c12e922" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.701692 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.701692 master-0 kubenswrapper[8678]: > Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: E1204 00:32:35.701749 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448" Netns:"/var/run/netns/24f5bbc5-a24b-436b-9c26-a3528c12e922" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: E1204 00:32:35.701784 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448" Netns:"/var/run/netns/24f5bbc5-a24b-436b-9c26-a3528c12e922" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:32:35.702439 master-0 kubenswrapper[8678]: E1204 00:32:35.701909 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"redhat-marketplace-zc792_openshift-marketplace(7e83f444-49e8-40b5-9a58-3128002f28c9)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"redhat-marketplace-zc792_openshift-marketplace(7e83f444-49e8-40b5-9a58-3128002f28c9)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448\\\" Netns:\\\"/var/run/netns/24f5bbc5-a24b-436b-9c26-a3528c12e922\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=ae6c4e5d0d7400e44f266de3f71f777cce0ca86982a8886fdd34ea7960628448;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/redhat-marketplace-zc792" podUID="7e83f444-49e8-40b5-9a58-3128002f28c9" Dec 04 00:32:35.734286 master-0 kubenswrapper[8678]: I1204 00:32:35.734226 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:32:35.735026 master-0 kubenswrapper[8678]: I1204 00:32:35.734971 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:32:35.910571 master-0 kubenswrapper[8678]: E1204 00:32:35.910508 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:32:35.910571 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4" Netns:"/var/run/netns/0b761a68-95a4-4cc5-a798-a6c51b5e3591" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.910571 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.910571 master-0 kubenswrapper[8678]: > Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: E1204 00:32:35.910593 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4" Netns:"/var/run/netns/0b761a68-95a4-4cc5-a798-a6c51b5e3591" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: E1204 00:32:35.910623 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4" Netns:"/var/run/netns/0b761a68-95a4-4cc5-a798-a6c51b5e3591" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:32:35.910810 master-0 kubenswrapper[8678]: E1204 00:32:35.910713 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-dvxb6_openshift-marketplace(975f6a6f-1fbb-49e1-8a0a-722586355364)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-dvxb6_openshift-marketplace(975f6a6f-1fbb-49e1-8a0a-722586355364)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4\\\" Netns:\\\"/var/run/netns/0b761a68-95a4-4cc5-a798-a6c51b5e3591\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=130d690dc9e6df681b14f8017b8e65c53081007c6a9149c777e9e767954bcba4;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-dvxb6" podUID="975f6a6f-1fbb-49e1-8a0a-722586355364" Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: E1204 00:32:35.939804 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1" Netns:"/var/run/netns/e82132fb-612a-4719-a396-d5d6cc2796ac" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: > Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: E1204 00:32:35.939863 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1" Netns:"/var/run/netns/e82132fb-612a-4719-a396-d5d6cc2796ac" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: E1204 00:32:35.939883 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1" Netns:"/var/run/netns/e82132fb-612a-4719-a396-d5d6cc2796ac" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:32:35.943487 master-0 kubenswrapper[8678]: E1204 00:32:35.939948 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(6b42d014-19a2-4c88-abd6-74b9191d6d16)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(6b42d014-19a2-4c88-abd6-74b9191d6d16)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1\\\" Netns:\\\"/var/run/netns/e82132fb-612a-4719-a396-d5d6cc2796ac\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=1ea36efc7ffbe475f68e133d0625fe937c8d394fec1d4d0107a1e111594927a1;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" Dec 04 00:32:35.944667 master-0 kubenswrapper[8678]: E1204 00:32:35.944616 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:32:35.944667 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c" Netns:"/var/run/netns/7b05cf23-8fac-4342-bfd7-4d90daaff1d9" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.944667 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.944667 master-0 kubenswrapper[8678]: > Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: E1204 00:32:35.944692 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c" Netns:"/var/run/netns/7b05cf23-8fac-4342-bfd7-4d90daaff1d9" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: > pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: E1204 00:32:35.944723 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c" Netns:"/var/run/netns/7b05cf23-8fac-4342-bfd7-4d90daaff1d9" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.944845 master-0 kubenswrapper[8678]: > pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:32:35.945185 master-0 kubenswrapper[8678]: E1204 00:32:35.944807 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api(a6a2308d-6d6f-4e8d-a6db-d931a172ed55)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api(a6a2308d-6d6f-4e8d-a6db-d931a172ed55)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c\\\" Netns:\\\"/var/run/netns/7b05cf23-8fac-4342-bfd7-4d90daaff1d9\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=1429244ef41dd945648a82f1e80bf259ec2c7f0ce876d9eb07c88ec3955beb1c;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" podUID="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Dec 04 00:32:35.966059 master-0 kubenswrapper[8678]: E1204 00:32:35.966012 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:32:35.966059 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82" Netns:"/var/run/netns/b062b7c6-4b8e-4e78-a388-ac9f0e7ede6e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.966059 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.966059 master-0 kubenswrapper[8678]: > Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: E1204 00:32:35.966073 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82" Netns:"/var/run/netns/b062b7c6-4b8e-4e78-a388-ac9f0e7ede6e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: E1204 00:32:35.966094 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82" Netns:"/var/run/netns/b062b7c6-4b8e-4e78-a388-ac9f0e7ede6e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:32:35.966242 master-0 kubenswrapper[8678]: E1204 00:32:35.966162 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(f80e5d69-5170-49df-b5e9-7991f63fd3dc)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(f80e5d69-5170-49df-b5e9-7991f63fd3dc)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82\\\" Netns:\\\"/var/run/netns/b062b7c6-4b8e-4e78-a388-ac9f0e7ede6e\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=f90eff7c1cffc25df50561b0465ce4d8e380e7e1ba3206174d877069c7b09b82;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" Dec 04 00:32:36.740830 master-0 kubenswrapper[8678]: I1204 00:32:36.740696 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:32:36.740830 master-0 kubenswrapper[8678]: I1204 00:32:36.740748 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:32:36.740830 master-0 kubenswrapper[8678]: I1204 00:32:36.740767 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:32:36.742044 master-0 kubenswrapper[8678]: I1204 00:32:36.740704 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:32:36.742044 master-0 kubenswrapper[8678]: I1204 00:32:36.741405 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:32:36.742044 master-0 kubenswrapper[8678]: I1204 00:32:36.741405 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:32:36.742044 master-0 kubenswrapper[8678]: I1204 00:32:36.741790 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:32:36.743103 master-0 kubenswrapper[8678]: I1204 00:32:36.742294 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:32:36.863375 master-0 kubenswrapper[8678]: E1204 00:32:36.863309 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:32:36.863579 master-0 kubenswrapper[8678]: E1204 00:32:36.863534 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.014s" Dec 04 00:32:36.863579 master-0 kubenswrapper[8678]: I1204 00:32:36.863567 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerDied","Data":"1f0462fd5b484033d78467a0da74f979aa85d8b25d9599d8df1e60ead439fb2e"} Dec 04 00:32:36.865006 master-0 kubenswrapper[8678]: I1204 00:32:36.864963 8678 scope.go:117] "RemoveContainer" containerID="1f0462fd5b484033d78467a0da74f979aa85d8b25d9599d8df1e60ead439fb2e" Dec 04 00:32:36.904397 master-0 kubenswrapper[8678]: I1204 00:32:36.904346 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:32:39.401022 master-0 kubenswrapper[8678]: E1204 00:32:39.400729 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0-master-0.187ddbca68ff2bcb openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:41b95a38663dd6fe34e183818a475977,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Killing,Message:Stopping container etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:31:31.390532555 +0000 UTC m=+74.717265111,LastTimestamp:2025-12-04 00:31:31.390532555 +0000 UTC m=+74.717265111,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:32:41.906595 master-0 kubenswrapper[8678]: E1204 00:32:41.906431 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="400ms" Dec 04 00:32:49.704774 master-0 kubenswrapper[8678]: E1204 00:32:49.704520 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:32:39Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:32:39Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:32:39Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:32:39Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a17e9d83aeb6de5f0851aaacd1a9ebddbc8a4ac3ece2e4af8670aa0c33b8fc9c\\\"],\\\"sizeBytes\\\":1631769045},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:98ce2d349f8bc693d76d9a68097b758b987cf17ea3beb66bbd09d12fa78b4d0c\\\"],\\\"sizeBytes\\\":1232076476},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:4281dc4ce2dd0685040e3d669b44cc2fc945c529f1e03e9a1e3948bc04801e98\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:fd045934f63cfcd06ea917296b90880c5b44256817e606d698b5afe226829128\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201545551},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a31af646ce5587c051459a88df413dc30be81e7f15399aa909e19effa7de772a\\\"],\\\"sizeBytes\\\":983731853},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\"],\\\"sizeBytes\\\":938321573},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3c0962dbbad51633a7d97ef253d0249269bfe3bbef3bfe99a99457470e7a682\\\"],\\\"sizeBytes\\\":912736453},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f313372fe49afad871cc56225dcd4d31bed249abeab55fb288e1f854138fbf\\\"],\\\"sizeBytes\\\":870581225},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\\\"],\\\"sizeBytes\\\":857083855},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0e5c0acdd03dc840d7345ae397feaf6147a32a8fef89a0ac2ddc8d14b068c9ff\\\"],\\\"sizeBytes\\\":767313881},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:184239929f74bb7c56c1cf5b94b5f91dd4013a87034fe04b9fa1027d2bb6c5a4\\\"],\\\"sizeBytes\\\":682385666},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d866f93bed16cfebd8019ad6b89a4dd4abedfc20ee5d28d7edad045e7df0fda\\\"],\\\"sizeBytes\\\":677540255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14\\\"],\\\"sizeBytes\\\":672854011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff94e909d3b037c815e8ae67989a7616936e67195b758abac6b5d3f0d59562c8\\\"],\\\"sizeBytes\\\":616123373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da6f62afd2795d1b0af69532a5534c099bbb81d4e7abd2616b374db191552c51\\\"],\\\"sizeBytes\\\":583850203},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51a4c20765f54b6a6b5513f97cf54bb99631c2abe860949293456886a74f87fe\\\"],\\\"sizeBytes\\\":576621883},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc9758be9f0f0a480fb5e119ecb1e1101ef807bdc765a155212a8188d79b9e60\\\"],\\\"sizeBytes\\\":552687886},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e8903affdf29401b9a86b9f58795c9f445f34194960c7b2734f30601c48cbdf\\\"],\\\"sizeBytes\\\":543241813},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\\\"],\\\"sizeBytes\\\":532668041},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ceaa4102b35e54be54e23c8ea73bb0dac4978cffb54105ad00b51393f47595da\\\"],\\\"sizeBytes\\\":532338751},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca4933b9ba55069205ea53970128c4e8c4b46560ef721c8aaee00aaf736664b5\\\"],\\\"sizeBytes\\\":512852463},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:98c80d92a2ef8d44ee625b229b77b7bfdb1b06cbfe0d4df9e2ca2cba904467f7\\\"],\\\"sizeBytes\\\":512468025},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\"],\\\"sizeBytes\\\":509451797},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a2ef63f356c11ba629d8038474ab287797340de1219b4fee97c386975689110\\\"],\\\"sizeBytes\\\":507701628},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\\\"],\\\"sizeBytes\\\":506755373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:492103a8365ef9a1d5f237b4ba90aff87369167ec91db29ff0251ba5aab2b419\\\"],\\\"sizeBytes\\\":505663073},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c2b518cb834a0b6ca50d73eceb5f8e64aefb09094d39e4ba0d8e4632f6cdf908\\\"],\\\"sizeBytes\\\":505642108},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:58ed827ee19ac91b6f860d307797b24b8aec02e671605388c4afe4fa19ddfc36\\\"],\\\"sizeBytes\\\":503354646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefdc67602b8bc3941001b030ab95d82e10432f814634b80eb8ce45bc9ebd3de\\\"],\\\"sizeBytes\\\":503025552},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3051af3343018fecbf3a6edacea69de841fc5211c09e7fb6a2499188dc979395\\\"],\\\"sizeBytes\\\":502450335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cb6ecfb89e53653b69ae494ebc940b9fcf7b7db317b156e186435cc541589d9\\\"],\\\"sizeBytes\\\":500957387},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\\\"],\\\"sizeBytes\\\":500863090},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a6a3308d885301c7718a465f1af2d08a617abbdff23352d5422d1ae4af33cf\\\"],\\\"sizeBytes\\\":499812475},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\\\"],\\\"sizeBytes\\\":499719811},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:93145fd0c004dc4fca21435a32c7e55e962f321aff260d702f387cfdebee92a5\\\"],\\\"sizeBytes\\\":499096673},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0c6de747539dd00ede882fb4f73cead462bf0a7efda7173fd5d443ef7a00251\\\"],\\\"sizeBytes\\\":490470354},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6199be91b821875ba2609cf7fa886b74b9a8b573622fe33cc1bc39cd55acac08\\\"],\\\"sizeBytes\\\":489542560},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ebd79294a663cb38370ae81f9cda91cef7fb1370ec5b495b4bdb95e77272e6a8\\\"],\\\"sizeBytes\\\":481573011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b4e0b20fdb38d516e871ff5d593c4273cc9933cb6a65ec93e727ca4a7777fd20\\\"],\\\"sizeBytes\\\":478931717},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a3e2790bda8898df5e4e9cf1878103ac483ea1633819d76ea68976b0b2062b6\\\"],\\\"sizeBytes\\\":478655954},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:656fe650bac2929182cd0cf7d7e566d089f69e06541b8329c6d40b89346c03ca\\\"],\\\"sizeBytes\\\":462741734},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f4724570795357eb097251a021f20c94c79b3054f3adb3bc0812143ba791dc1\\\"],\\\"sizeBytes\\\":461716546},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\\\"],\\\"sizeBytes\\\":459566623},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:607e31ebb2c85f53775455b38a607a68cb2bdab1e369f03c57e715a4ebb88831\\\"],\\\"sizeBytes\\\":458183681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36fa1378b9c26de6d45187b1e7352f3b1147109427fab3669b107d81fd967601\\\"],\\\"sizeBytes\\\":452603646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eac937aae64688cb47b38ad2cbba5aa7e6d41c691df1f3ca4ff81e5117084d1e\\\"],\\\"sizeBytes\\\":451053419},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7825952834ade266ce08d1a9eb0665e4661dea0a40647d3e1de2cf6266665e9d\\\"],\\\"sizeBytes\\\":443305841},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6dd80564094a262c1bb53c037288c9c69a46b22dc7dd3ee5c52384404ebfdc81\\\"],\\\"sizeBytes\\\":442523452}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:32:52.307399 master-0 kubenswrapper[8678]: E1204 00:32:52.307222 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="800ms" Dec 04 00:32:52.863196 master-0 kubenswrapper[8678]: I1204 00:32:52.863098 8678 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="b61315793344ebcd4455235dcd882405194cc9e5d9bb66073a26fedf6f49f28c" exitCode=1 Dec 04 00:32:59.706059 master-0 kubenswrapper[8678]: E1204 00:32:59.705981 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:03.108669 master-0 kubenswrapper[8678]: E1204 00:33:03.108531 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="1.6s" Dec 04 00:33:05.950203 master-0 kubenswrapper[8678]: I1204 00:33:05.949993 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/1.log" Dec 04 00:33:05.951193 master-0 kubenswrapper[8678]: I1204 00:33:05.950784 8678 generic.go:334] "Generic (PLEG): container finished" podID="655dc370-c0d1-4d03-a317-64bf099aff1b" containerID="04b6797d433194e1224976bde27df7380ac53111703d386c9136d1bdaf11768c" exitCode=255 Dec 04 00:33:06.959242 master-0 kubenswrapper[8678]: I1204 00:33:06.959171 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-56f5898f45-2qvfj_dd621016-f4f2-4839-aae0-a804e6023423/service-ca-operator/1.log" Dec 04 00:33:06.959857 master-0 kubenswrapper[8678]: I1204 00:33:06.959808 8678 generic.go:334] "Generic (PLEG): container finished" podID="dd621016-f4f2-4839-aae0-a804e6023423" containerID="4a833ea2a9a15920b34c9ef6e8f314468e42b929cf904fcaab498c2e48700df5" exitCode=255 Dec 04 00:33:06.961833 master-0 kubenswrapper[8678]: I1204 00:33:06.961788 8678 generic.go:334] "Generic (PLEG): container finished" podID="aa2eaba9-479e-4420-a24f-63530e4da783" containerID="21271674bed5db800ead1d33a02a41079776995c09f1c049ca58e762322ee71d" exitCode=0 Dec 04 00:33:09.707253 master-0 kubenswrapper[8678]: E1204 00:33:09.707082 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:09.909958 master-0 kubenswrapper[8678]: I1204 00:33:09.909850 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:09.910250 master-0 kubenswrapper[8678]: I1204 00:33:09.910004 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:09.910840 master-0 kubenswrapper[8678]: I1204 00:33:09.910793 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:09.910947 master-0 kubenswrapper[8678]: I1204 00:33:09.910845 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:10.906714 master-0 kubenswrapper[8678]: E1204 00:33:10.906651 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:33:10.907454 master-0 kubenswrapper[8678]: E1204 00:33:10.906888 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.043s" Dec 04 00:33:10.907454 master-0 kubenswrapper[8678]: I1204 00:33:10.906919 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerDied","Data":"7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9"} Dec 04 00:33:10.914024 master-0 kubenswrapper[8678]: I1204 00:33:10.913964 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:33:13.404296 master-0 kubenswrapper[8678]: E1204 00:33:13.404079 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{certified-operators-m4q5k.187ddbcb2a049bee openshift-marketplace 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-marketplace,Name:certified-operators-m4q5k,UID:6bf75491-0c03-4e02-9074-c9be808badd4,APIVersion:v1,ResourceVersion:8951,FieldPath:spec.initContainers{extract-utilities},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:31:34.62889163 +0000 UTC m=+77.955624186,LastTimestamp:2025-12-04 00:31:34.62889163 +0000 UTC m=+77.955624186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:33:14.710588 master-0 kubenswrapper[8678]: E1204 00:33:14.710449 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="3.2s" Dec 04 00:33:17.027433 master-0 kubenswrapper[8678]: I1204 00:33:17.027311 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/0.log" Dec 04 00:33:17.027433 master-0 kubenswrapper[8678]: I1204 00:33:17.027432 8678 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="bd570164e4f250f953ddde8e60445d595b3a58298a3711e92e8a9ec240f35d10" exitCode=1 Dec 04 00:33:19.276889 master-0 kubenswrapper[8678]: I1204 00:33:19.276760 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:33:19.277882 master-0 kubenswrapper[8678]: I1204 00:33:19.276892 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:19.707713 master-0 kubenswrapper[8678]: E1204 00:33:19.707627 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:19.909214 master-0 kubenswrapper[8678]: I1204 00:33:19.909102 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:19.909214 master-0 kubenswrapper[8678]: I1204 00:33:19.909146 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:19.909214 master-0 kubenswrapper[8678]: I1204 00:33:19.909229 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:19.909729 master-0 kubenswrapper[8678]: I1204 00:33:19.909271 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:23.068846 master-0 kubenswrapper[8678]: I1204 00:33:23.068753 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/1.log" Dec 04 00:33:23.070039 master-0 kubenswrapper[8678]: I1204 00:33:23.069989 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/0.log" Dec 04 00:33:23.070144 master-0 kubenswrapper[8678]: I1204 00:33:23.070071 8678 generic.go:334] "Generic (PLEG): container finished" podID="8a5721ad-a077-439a-9ec0-57d90dfb5c14" containerID="7f51b557a3ad1653c4152bc3d0fece4c806c2c0777a98f5a35231532d2e85bae" exitCode=255 Dec 04 00:33:26.090916 master-0 kubenswrapper[8678]: I1204 00:33:26.090833 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/0.log" Dec 04 00:33:26.091858 master-0 kubenswrapper[8678]: I1204 00:33:26.091771 8678 generic.go:334] "Generic (PLEG): container finished" podID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerID="f134fa404e41ccccd9a96968aae081a3d4c05ff32e7941607b4075f5497a7ae4" exitCode=1 Dec 04 00:33:26.094898 master-0 kubenswrapper[8678]: I1204 00:33:26.094829 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/0.log" Dec 04 00:33:26.095129 master-0 kubenswrapper[8678]: I1204 00:33:26.094898 8678 generic.go:334] "Generic (PLEG): container finished" podID="47152378-4ef5-4eff-9b30-fd8635982f02" containerID="36a2cab4ca8775c3db41d1bd854a9aa530900e8e907d105b1156a340fd433e8d" exitCode=1 Dec 04 00:33:27.911737 master-0 kubenswrapper[8678]: E1204 00:33:27.911630 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="6.4s" Dec 04 00:33:29.276519 master-0 kubenswrapper[8678]: I1204 00:33:29.276427 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:33:29.276519 master-0 kubenswrapper[8678]: I1204 00:33:29.276497 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:29.708885 master-0 kubenswrapper[8678]: E1204 00:33:29.708779 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:29.708885 master-0 kubenswrapper[8678]: E1204 00:33:29.708852 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:33:29.910313 master-0 kubenswrapper[8678]: I1204 00:33:29.910220 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:29.910645 master-0 kubenswrapper[8678]: I1204 00:33:29.910246 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:29.910645 master-0 kubenswrapper[8678]: I1204 00:33:29.910424 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:29.910645 master-0 kubenswrapper[8678]: I1204 00:33:29.910334 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:31.498079 master-0 kubenswrapper[8678]: I1204 00:33:31.497919 8678 status_manager.go:851] "Failed to get status for pod" podUID="c79edcd7-4399-4ded-9b03-9084ad9e14b4" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods package-server-manager-75b4d49d4c-7s5z5)" Dec 04 00:33:32.131490 master-0 kubenswrapper[8678]: I1204 00:33:32.131428 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/0.log" Dec 04 00:33:32.131490 master-0 kubenswrapper[8678]: I1204 00:33:32.131482 8678 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb" exitCode=1 Dec 04 00:33:33.528184 master-0 kubenswrapper[8678]: I1204 00:33:33.528061 8678 patch_prober.go:28] interesting pod/catalogd-controller-manager-754cfd84-zjpxn container/manager namespace/openshift-catalogd: Readiness probe status=failure output="Get \"http://10.128.0.35:8081/readyz\": dial tcp 10.128.0.35:8081: connect: connection refused" start-of-body= Dec 04 00:33:33.528184 master-0 kubenswrapper[8678]: I1204 00:33:33.528165 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podUID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.35:8081/readyz\": dial tcp 10.128.0.35:8081: connect: connection refused" Dec 04 00:33:35.232797 master-0 kubenswrapper[8678]: I1204 00:33:35.232672 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:33:35.232797 master-0 kubenswrapper[8678]: I1204 00:33:35.232779 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:33:36.562103 master-0 kubenswrapper[8678]: E1204 00:33:36.562045 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:33:36.562103 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569" Netns:"/var/run/netns/c3fa958e-ddd4-4c68-9a51-dff7227e7d62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:36.562103 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:36.562103 master-0 kubenswrapper[8678]: > Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: E1204 00:33:36.562140 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569" Netns:"/var/run/netns/c3fa958e-ddd4-4c68-9a51-dff7227e7d62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: E1204 00:33:36.562169 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569" Netns:"/var/run/netns/c3fa958e-ddd4-4c68-9a51-dff7227e7d62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9" Path:"" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:33:36.562659 master-0 kubenswrapper[8678]: E1204 00:33:36.562254 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"redhat-marketplace-zc792_openshift-marketplace(7e83f444-49e8-40b5-9a58-3128002f28c9)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"redhat-marketplace-zc792_openshift-marketplace(7e83f444-49e8-40b5-9a58-3128002f28c9)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_redhat-marketplace-zc792_openshift-marketplace_7e83f444-49e8-40b5-9a58-3128002f28c9_0(beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569): error adding pod openshift-marketplace_redhat-marketplace-zc792 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569\\\" Netns:\\\"/var/run/netns/c3fa958e-ddd4-4c68-9a51-dff7227e7d62\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=redhat-marketplace-zc792;K8S_POD_INFRA_CONTAINER_ID=beb2b49868e23e129f50a43566e7546728c55ebb0d9f3e1a16ee1d3c8d02d569;K8S_POD_UID=7e83f444-49e8-40b5-9a58-3128002f28c9\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/redhat-marketplace-zc792] networking: Multus: [openshift-marketplace/redhat-marketplace-zc792/7e83f444-49e8-40b5-9a58-3128002f28c9]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: SetNetworkStatus: failed to update the pod redhat-marketplace-zc792 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/redhat-marketplace-zc792?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/redhat-marketplace-zc792" podUID="7e83f444-49e8-40b5-9a58-3128002f28c9" Dec 04 00:33:37.573811 master-0 kubenswrapper[8678]: E1204 00:33:37.573757 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:33:37.573811 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c" Netns:"/var/run/netns/1ed29f45-1857-4aa1-a591-add3f99a771d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.573811 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.573811 master-0 kubenswrapper[8678]: > Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: E1204 00:33:37.573840 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c" Netns:"/var/run/netns/1ed29f45-1857-4aa1-a591-add3f99a771d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: E1204 00:33:37.573863 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c" Netns:"/var/run/netns/1ed29f45-1857-4aa1-a591-add3f99a771d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:33:37.574471 master-0 kubenswrapper[8678]: E1204 00:33:37.573941 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(f80e5d69-5170-49df-b5e9-7991f63fd3dc)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(f80e5d69-5170-49df-b5e9-7991f63fd3dc)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_f80e5d69-5170-49df-b5e9-7991f63fd3dc_0(4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c\\\" Netns:\\\"/var/run/netns/1ed29f45-1857-4aa1-a591-add3f99a771d\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=4eb67c557117bbf5efb57c530d9e13a2a3930b9536c95a5f141dcd27eb544e3c;K8S_POD_UID=f80e5d69-5170-49df-b5e9-7991f63fd3dc\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/f80e5d69-5170-49df-b5e9-7991f63fd3dc]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: E1204 00:33:37.657478 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294" Netns:"/var/run/netns/cccbd0b8-9bdc-4d03-9d54-b38746b1365b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: > Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: E1204 00:33:37.657559 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294" Netns:"/var/run/netns/cccbd0b8-9bdc-4d03-9d54-b38746b1365b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.657562 master-0 kubenswrapper[8678]: > pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:33:37.658150 master-0 kubenswrapper[8678]: E1204 00:33:37.657582 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:33:37.658150 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294" Netns:"/var/run/netns/cccbd0b8-9bdc-4d03-9d54-b38746b1365b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Path:"" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.658150 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.658150 master-0 kubenswrapper[8678]: > pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:33:37.658150 master-0 kubenswrapper[8678]: E1204 00:33:37.657683 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api(a6a2308d-6d6f-4e8d-a6db-d931a172ed55)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api(a6a2308d-6d6f-4e8d-a6db-d931a172ed55)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_control-plane-machine-set-operator-66f4cc99d4-6sv72_openshift-machine-api_a6a2308d-6d6f-4e8d-a6db-d931a172ed55_0(a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294): error adding pod openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294\\\" Netns:\\\"/var/run/netns/cccbd0b8-9bdc-4d03-9d54-b38746b1365b\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=control-plane-machine-set-operator-66f4cc99d4-6sv72;K8S_POD_INFRA_CONTAINER_ID=a09f61f384797066709e5bedbb80f1ce0121afcabab69989b265eb20582b3294;K8S_POD_UID=a6a2308d-6d6f-4e8d-a6db-d931a172ed55\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72] networking: Multus: [openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72/a6a2308d-6d6f-4e8d-a6db-d931a172ed55]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: SetNetworkStatus: failed to update the pod control-plane-machine-set-operator-66f4cc99d4-6sv72 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-66f4cc99d4-6sv72?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" podUID="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" Dec 04 00:33:37.661873 master-0 kubenswrapper[8678]: E1204 00:33:37.661837 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:33:37.661873 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f" Netns:"/var/run/netns/39ab5fdb-ebe3-4622-8e19-b545f7e5d100" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.661873 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.661873 master-0 kubenswrapper[8678]: > Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: E1204 00:33:37.661888 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f" Netns:"/var/run/netns/39ab5fdb-ebe3-4622-8e19-b545f7e5d100" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: E1204 00:33:37.661910 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f" Netns:"/var/run/netns/39ab5fdb-ebe3-4622-8e19-b545f7e5d100" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:33:37.662067 master-0 kubenswrapper[8678]: E1204 00:33:37.661981 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(6b42d014-19a2-4c88-abd6-74b9191d6d16)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(6b42d014-19a2-4c88-abd6-74b9191d6d16)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_6b42d014-19a2-4c88-abd6-74b9191d6d16_0(92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f\\\" Netns:\\\"/var/run/netns/39ab5fdb-ebe3-4622-8e19-b545f7e5d100\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=92344e586eb91fc2c9c6ab79732d200e7fe674a887c894df43dbdd8dd80c8f3f;K8S_POD_UID=6b42d014-19a2-4c88-abd6-74b9191d6d16\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/6b42d014-19a2-4c88-abd6-74b9191d6d16]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" Dec 04 00:33:37.665634 master-0 kubenswrapper[8678]: E1204 00:33:37.665565 8678 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:33:37.665634 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9" Netns:"/var/run/netns/5bd333a9-d0e9-4473-9439-1f5bfaa2e98a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.665634 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.665634 master-0 kubenswrapper[8678]: > Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: E1204 00:33:37.665664 8678 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9" Netns:"/var/run/netns/5bd333a9-d0e9-4473-9439-1f5bfaa2e98a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: E1204 00:33:37.665689 8678 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9" Netns:"/var/run/netns/5bd333a9-d0e9-4473-9439-1f5bfaa2e98a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: > pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:33:37.665806 master-0 kubenswrapper[8678]: E1204 00:33:37.665759 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-dvxb6_openshift-marketplace(975f6a6f-1fbb-49e1-8a0a-722586355364)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-dvxb6_openshift-marketplace(975f6a6f-1fbb-49e1-8a0a-722586355364)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-dvxb6_openshift-marketplace_975f6a6f-1fbb-49e1-8a0a-722586355364_0(1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9): error adding pod openshift-marketplace_community-operators-dvxb6 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9\\\" Netns:\\\"/var/run/netns/5bd333a9-d0e9-4473-9439-1f5bfaa2e98a\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-dvxb6;K8S_POD_INFRA_CONTAINER_ID=1e8f125743e9c0580a225530cd063807a572219e8b5d6ed2cc6cae75da6674e9;K8S_POD_UID=975f6a6f-1fbb-49e1-8a0a-722586355364\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-dvxb6] networking: Multus: [openshift-marketplace/community-operators-dvxb6/975f6a6f-1fbb-49e1-8a0a-722586355364]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-dvxb6 in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-dvxb6 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-dvxb6?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-dvxb6" podUID="975f6a6f-1fbb-49e1-8a0a-722586355364" Dec 04 00:33:39.215378 master-0 kubenswrapper[8678]: I1204 00:33:39.215265 8678 patch_prober.go:28] interesting pod/authentication-operator-7479ffdf48-7jnhr container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.24:8443/healthz\": read tcp 10.128.0.2:57610->10.128.0.24:8443: read: connection reset by peer" start-of-body= Dec 04 00:33:39.215378 master-0 kubenswrapper[8678]: I1204 00:33:39.215366 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" podUID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.24:8443/healthz\": read tcp 10.128.0.2:57610->10.128.0.24:8443: read: connection reset by peer" Dec 04 00:33:39.911557 master-0 kubenswrapper[8678]: I1204 00:33:39.911454 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:33:39.911902 master-0 kubenswrapper[8678]: I1204 00:33:39.911604 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:33:40.188041 master-0 kubenswrapper[8678]: I1204 00:33:40.187892 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/1.log" Dec 04 00:33:40.188747 master-0 kubenswrapper[8678]: I1204 00:33:40.188679 8678 generic.go:334] "Generic (PLEG): container finished" podID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerID="30334a3fa525d9b6061a522d88430ab12379b269164eecaa76fc0069f4a00c26" exitCode=255 Dec 04 00:33:43.527610 master-0 kubenswrapper[8678]: I1204 00:33:43.527510 8678 patch_prober.go:28] interesting pod/catalogd-controller-manager-754cfd84-zjpxn container/manager namespace/openshift-catalogd: Readiness probe status=failure output="Get \"http://10.128.0.35:8081/readyz\": dial tcp 10.128.0.35:8081: connect: connection refused" start-of-body= Dec 04 00:33:43.528733 master-0 kubenswrapper[8678]: I1204 00:33:43.527612 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podUID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.35:8081/readyz\": dial tcp 10.128.0.35:8081: connect: connection refused" Dec 04 00:33:43.528733 master-0 kubenswrapper[8678]: I1204 00:33:43.527510 8678 patch_prober.go:28] interesting pod/catalogd-controller-manager-754cfd84-zjpxn container/manager namespace/openshift-catalogd: Liveness probe status=failure output="Get \"http://10.128.0.35:8081/healthz\": dial tcp 10.128.0.35:8081: connect: connection refused" start-of-body= Dec 04 00:33:43.528733 master-0 kubenswrapper[8678]: I1204 00:33:43.527701 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podUID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.35:8081/healthz\": dial tcp 10.128.0.35:8081: connect: connection refused" Dec 04 00:33:44.313081 master-0 kubenswrapper[8678]: E1204 00:33:44.312917 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:33:44.917426 master-0 kubenswrapper[8678]: E1204 00:33:44.917306 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:33:44.918495 master-0 kubenswrapper[8678]: E1204 00:33:44.917568 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.011s" Dec 04 00:33:44.918495 master-0 kubenswrapper[8678]: I1204 00:33:44.917601 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:33:44.918495 master-0 kubenswrapper[8678]: I1204 00:33:44.917836 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:33:44.919516 master-0 kubenswrapper[8678]: I1204 00:33:44.919449 8678 scope.go:117] "RemoveContainer" containerID="82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb" Dec 04 00:33:44.919785 master-0 kubenswrapper[8678]: I1204 00:33:44.919715 8678 scope.go:117] "RemoveContainer" containerID="21271674bed5db800ead1d33a02a41079776995c09f1c049ca58e762322ee71d" Dec 04 00:33:44.922092 master-0 kubenswrapper[8678]: I1204 00:33:44.921566 8678 scope.go:117] "RemoveContainer" containerID="7f51b557a3ad1653c4152bc3d0fece4c806c2c0777a98f5a35231532d2e85bae" Dec 04 00:33:44.922092 master-0 kubenswrapper[8678]: I1204 00:33:44.921890 8678 scope.go:117] "RemoveContainer" containerID="53f3ad5a02fe61d14e3118f30603f785f895999675e16d3f4049dea7bd628227" Dec 04 00:33:44.922908 master-0 kubenswrapper[8678]: I1204 00:33:44.922593 8678 scope.go:117] "RemoveContainer" containerID="0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee" Dec 04 00:33:44.923201 master-0 kubenswrapper[8678]: I1204 00:33:44.923002 8678 scope.go:117] "RemoveContainer" containerID="04b6797d433194e1224976bde27df7380ac53111703d386c9136d1bdaf11768c" Dec 04 00:33:44.926311 master-0 kubenswrapper[8678]: I1204 00:33:44.924067 8678 scope.go:117] "RemoveContainer" containerID="fd3589300b36ad6c047594904bec153361e0713f63741a4acf7e0ce1f226f895" Dec 04 00:33:44.926311 master-0 kubenswrapper[8678]: I1204 00:33:44.924409 8678 scope.go:117] "RemoveContainer" containerID="bd570164e4f250f953ddde8e60445d595b3a58298a3711e92e8a9ec240f35d10" Dec 04 00:33:44.926311 master-0 kubenswrapper[8678]: I1204 00:33:44.924539 8678 scope.go:117] "RemoveContainer" containerID="016eb70a46f10bedd7dec24049021571b4b28da368391342d032b50cbe92ce70" Dec 04 00:33:44.926311 master-0 kubenswrapper[8678]: I1204 00:33:44.925216 8678 scope.go:117] "RemoveContainer" containerID="b61315793344ebcd4455235dcd882405194cc9e5d9bb66073a26fedf6f49f28c" Dec 04 00:33:44.926311 master-0 kubenswrapper[8678]: I1204 00:33:44.926287 8678 scope.go:117] "RemoveContainer" containerID="4a833ea2a9a15920b34c9ef6e8f314468e42b929cf904fcaab498c2e48700df5" Dec 04 00:33:44.928771 master-0 kubenswrapper[8678]: I1204 00:33:44.926625 8678 scope.go:117] "RemoveContainer" containerID="f675877019df3cdc18b7aefe49174ba92d0287bca845b45bc2f441207b0fb5fa" Dec 04 00:33:44.930462 master-0 kubenswrapper[8678]: I1204 00:33:44.930210 8678 scope.go:117] "RemoveContainer" containerID="f134fa404e41ccccd9a96968aae081a3d4c05ff32e7941607b4075f5497a7ae4" Dec 04 00:33:44.931611 master-0 kubenswrapper[8678]: I1204 00:33:44.930888 8678 scope.go:117] "RemoveContainer" containerID="ef0a1dd8b3b02b9ccc27c7f5e6c342a96866c392b4b7777a54fb8bb661414577" Dec 04 00:33:44.933837 master-0 kubenswrapper[8678]: I1204 00:33:44.933772 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:33:45.232859 master-0 kubenswrapper[8678]: I1204 00:33:45.232716 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:33:45.232859 master-0 kubenswrapper[8678]: I1204 00:33:45.232782 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:33:45.232859 master-0 kubenswrapper[8678]: I1204 00:33:45.232812 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Liveness probe status=failure output="Get \"http://10.128.0.36:8081/healthz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:33:45.233139 master-0 kubenswrapper[8678]: I1204 00:33:45.232918 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/healthz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:33:46.319948 master-0 kubenswrapper[8678]: I1204 00:33:46.319886 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/1.log" Dec 04 00:33:46.321073 master-0 kubenswrapper[8678]: I1204 00:33:46.321026 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/0.log" Dec 04 00:33:46.326541 master-0 kubenswrapper[8678]: I1204 00:33:46.326511 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-6cbf58c977-vjwnj_aa373a8f-8a9c-4f90-ae62-1d48fd88550b/network-operator/0.log" Dec 04 00:33:46.329550 master-0 kubenswrapper[8678]: I1204 00:33:46.329522 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/0.log" Dec 04 00:33:46.335273 master-0 kubenswrapper[8678]: I1204 00:33:46.335229 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/0.log" Dec 04 00:33:46.337528 master-0 kubenswrapper[8678]: I1204 00:33:46.337500 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/0.log" Dec 04 00:33:46.343387 master-0 kubenswrapper[8678]: I1204 00:33:46.343345 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-56f5898f45-2qvfj_dd621016-f4f2-4839-aae0-a804e6023423/service-ca-operator/1.log" Dec 04 00:33:46.346519 master-0 kubenswrapper[8678]: I1204 00:33:46.346470 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/1.log" Dec 04 00:33:46.350227 master-0 kubenswrapper[8678]: I1204 00:33:46.350179 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/0.log" Dec 04 00:33:47.407646 master-0 kubenswrapper[8678]: E1204 00:33:47.407417 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-apiserver-operator-667484ff5-mswdx.187ddbcb2a04fcec openshift-apiserver-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-apiserver-operator,Name:openshift-apiserver-operator-667484ff5-mswdx,UID:655dc370-c0d1-4d03-a317-64bf099aff1b,APIVersion:v1,ResourceVersion:3788,FieldPath:spec.containers{openshift-apiserver-operator},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:31:34.62891646 +0000 UTC m=+77.955649026,LastTimestamp:2025-12-04 00:31:34.62891646 +0000 UTC m=+77.955649026,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:33:49.988551 master-0 kubenswrapper[8678]: E1204 00:33:49.988264 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:33:39Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:33:39Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:33:39Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:33:39Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a17e9d83aeb6de5f0851aaacd1a9ebddbc8a4ac3ece2e4af8670aa0c33b8fc9c\\\"],\\\"sizeBytes\\\":1631769045},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:98ce2d349f8bc693d76d9a68097b758b987cf17ea3beb66bbd09d12fa78b4d0c\\\"],\\\"sizeBytes\\\":1232076476},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:4281dc4ce2dd0685040e3d669b44cc2fc945c529f1e03e9a1e3948bc04801e98\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:fd045934f63cfcd06ea917296b90880c5b44256817e606d698b5afe226829128\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201545551},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a31af646ce5587c051459a88df413dc30be81e7f15399aa909e19effa7de772a\\\"],\\\"sizeBytes\\\":983731853},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\"],\\\"sizeBytes\\\":938321573},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3c0962dbbad51633a7d97ef253d0249269bfe3bbef3bfe99a99457470e7a682\\\"],\\\"sizeBytes\\\":912736453},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f313372fe49afad871cc56225dcd4d31bed249abeab55fb288e1f854138fbf\\\"],\\\"sizeBytes\\\":870581225},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\\\"],\\\"sizeBytes\\\":857083855},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0e5c0acdd03dc840d7345ae397feaf6147a32a8fef89a0ac2ddc8d14b068c9ff\\\"],\\\"sizeBytes\\\":767313881},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:184239929f74bb7c56c1cf5b94b5f91dd4013a87034fe04b9fa1027d2bb6c5a4\\\"],\\\"sizeBytes\\\":682385666},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d866f93bed16cfebd8019ad6b89a4dd4abedfc20ee5d28d7edad045e7df0fda\\\"],\\\"sizeBytes\\\":677540255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14\\\"],\\\"sizeBytes\\\":672854011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff94e909d3b037c815e8ae67989a7616936e67195b758abac6b5d3f0d59562c8\\\"],\\\"sizeBytes\\\":616123373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da6f62afd2795d1b0af69532a5534c099bbb81d4e7abd2616b374db191552c51\\\"],\\\"sizeBytes\\\":583850203},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51a4c20765f54b6a6b5513f97cf54bb99631c2abe860949293456886a74f87fe\\\"],\\\"sizeBytes\\\":576621883},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc9758be9f0f0a480fb5e119ecb1e1101ef807bdc765a155212a8188d79b9e60\\\"],\\\"sizeBytes\\\":552687886},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e8903affdf29401b9a86b9f58795c9f445f34194960c7b2734f30601c48cbdf\\\"],\\\"sizeBytes\\\":543241813},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\\\"],\\\"sizeBytes\\\":532668041},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ceaa4102b35e54be54e23c8ea73bb0dac4978cffb54105ad00b51393f47595da\\\"],\\\"sizeBytes\\\":532338751},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca4933b9ba55069205ea53970128c4e8c4b46560ef721c8aaee00aaf736664b5\\\"],\\\"sizeBytes\\\":512852463},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:98c80d92a2ef8d44ee625b229b77b7bfdb1b06cbfe0d4df9e2ca2cba904467f7\\\"],\\\"sizeBytes\\\":512468025},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\"],\\\"sizeBytes\\\":509451797},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a2ef63f356c11ba629d8038474ab287797340de1219b4fee97c386975689110\\\"],\\\"sizeBytes\\\":507701628},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\\\"],\\\"sizeBytes\\\":506755373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:492103a8365ef9a1d5f237b4ba90aff87369167ec91db29ff0251ba5aab2b419\\\"],\\\"sizeBytes\\\":505663073},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c2b518cb834a0b6ca50d73eceb5f8e64aefb09094d39e4ba0d8e4632f6cdf908\\\"],\\\"sizeBytes\\\":505642108},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:58ed827ee19ac91b6f860d307797b24b8aec02e671605388c4afe4fa19ddfc36\\\"],\\\"sizeBytes\\\":503354646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefdc67602b8bc3941001b030ab95d82e10432f814634b80eb8ce45bc9ebd3de\\\"],\\\"sizeBytes\\\":503025552},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3051af3343018fecbf3a6edacea69de841fc5211c09e7fb6a2499188dc979395\\\"],\\\"sizeBytes\\\":502450335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cb6ecfb89e53653b69ae494ebc940b9fcf7b7db317b156e186435cc541589d9\\\"],\\\"sizeBytes\\\":500957387},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\\\"],\\\"sizeBytes\\\":500863090},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a6a3308d885301c7718a465f1af2d08a617abbdff23352d5422d1ae4af33cf\\\"],\\\"sizeBytes\\\":499812475},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\\\"],\\\"sizeBytes\\\":499719811},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:93145fd0c004dc4fca21435a32c7e55e962f321aff260d702f387cfdebee92a5\\\"],\\\"sizeBytes\\\":499096673},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0c6de747539dd00ede882fb4f73cead462bf0a7efda7173fd5d443ef7a00251\\\"],\\\"sizeBytes\\\":490470354},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6199be91b821875ba2609cf7fa886b74b9a8b573622fe33cc1bc39cd55acac08\\\"],\\\"sizeBytes\\\":489542560},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ebd79294a663cb38370ae81f9cda91cef7fb1370ec5b495b4bdb95e77272e6a8\\\"],\\\"sizeBytes\\\":481573011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b4e0b20fdb38d516e871ff5d593c4273cc9933cb6a65ec93e727ca4a7777fd20\\\"],\\\"sizeBytes\\\":478931717},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a3e2790bda8898df5e4e9cf1878103ac483ea1633819d76ea68976b0b2062b6\\\"],\\\"sizeBytes\\\":478655954},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:656fe650bac2929182cd0cf7d7e566d089f69e06541b8329c6d40b89346c03ca\\\"],\\\"sizeBytes\\\":462741734},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f4724570795357eb097251a021f20c94c79b3054f3adb3bc0812143ba791dc1\\\"],\\\"sizeBytes\\\":461716546},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\\\"],\\\"sizeBytes\\\":459566623},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:607e31ebb2c85f53775455b38a607a68cb2bdab1e369f03c57e715a4ebb88831\\\"],\\\"sizeBytes\\\":458183681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36fa1378b9c26de6d45187b1e7352f3b1147109427fab3669b107d81fd967601\\\"],\\\"sizeBytes\\\":452603646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eac937aae64688cb47b38ad2cbba5aa7e6d41c691df1f3ca4ff81e5117084d1e\\\"],\\\"sizeBytes\\\":451053419},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7825952834ade266ce08d1a9eb0665e4661dea0a40647d3e1de2cf6266665e9d\\\"],\\\"sizeBytes\\\":443305841},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6dd80564094a262c1bb53c037288c9c69a46b22dc7dd3ee5c52384404ebfdc81\\\"],\\\"sizeBytes\\\":442523452}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:33:53.405826 master-0 kubenswrapper[8678]: I1204 00:33:53.405738 8678 generic.go:334] "Generic (PLEG): container finished" podID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerID="db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00" exitCode=0 Dec 04 00:33:54.740493 master-0 kubenswrapper[8678]: I1204 00:33:54.740408 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:33:54.741032 master-0 kubenswrapper[8678]: I1204 00:33:54.740506 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Liveness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:33:54.741032 master-0 kubenswrapper[8678]: I1204 00:33:54.740507 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:33:54.741032 master-0 kubenswrapper[8678]: I1204 00:33:54.740605 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:33:55.232176 master-0 kubenswrapper[8678]: I1204 00:33:55.232057 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:33:55.232510 master-0 kubenswrapper[8678]: I1204 00:33:55.232181 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:33:57.929806 master-0 kubenswrapper[8678]: E1204 00:33:57.929670 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 00:33:59.989636 master-0 kubenswrapper[8678]: E1204 00:33:59.989534 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:01.314362 master-0 kubenswrapper[8678]: E1204 00:34:01.314243 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:34:04.740453 master-0 kubenswrapper[8678]: I1204 00:34:04.740331 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Liveness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:34:04.740453 master-0 kubenswrapper[8678]: I1204 00:34:04.740414 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:34:04.740453 master-0 kubenswrapper[8678]: I1204 00:34:04.740354 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:34:04.742130 master-0 kubenswrapper[8678]: I1204 00:34:04.740557 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:34:05.232718 master-0 kubenswrapper[8678]: I1204 00:34:05.232587 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:34:05.232718 master-0 kubenswrapper[8678]: I1204 00:34:05.232646 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Liveness probe status=failure output="Get \"http://10.128.0.36:8081/healthz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:34:05.232718 master-0 kubenswrapper[8678]: I1204 00:34:05.232706 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:34:05.233225 master-0 kubenswrapper[8678]: I1204 00:34:05.232763 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/healthz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:34:05.556084 master-0 kubenswrapper[8678]: I1204 00:34:05.555852 8678 generic.go:334] "Generic (PLEG): container finished" podID="2ad96246-c53a-4016-b67d-5e9d66f40d5b" containerID="7630ed34c5afaf7ec052397359ddb4e03d2aaa0074ba8d9aa9989ae1eab28f0b" exitCode=0 Dec 04 00:34:07.571162 master-0 kubenswrapper[8678]: I1204 00:34:07.571014 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/1.log" Dec 04 00:34:07.572335 master-0 kubenswrapper[8678]: I1204 00:34:07.571658 8678 generic.go:334] "Generic (PLEG): container finished" podID="3e901355-2d0f-46f9-9d64-c4bc900b1839" containerID="8535d74ae1fe68cf19d4bcff1682688f5b7202742afc467329b215e7d307d732" exitCode=255 Dec 04 00:34:09.990555 master-0 kubenswrapper[8678]: E1204 00:34:09.990464 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:14.739891 master-0 kubenswrapper[8678]: I1204 00:34:14.739783 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:34:14.739891 master-0 kubenswrapper[8678]: I1204 00:34:14.739825 8678 patch_prober.go:28] interesting pod/controller-manager-5bbbf854f-x8c6r container/controller-manager namespace/openshift-controller-manager: Liveness probe status=failure output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" start-of-body= Dec 04 00:34:14.740650 master-0 kubenswrapper[8678]: I1204 00:34:14.739886 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:34:14.740650 master-0 kubenswrapper[8678]: I1204 00:34:14.739961 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.50:8443/healthz\": dial tcp 10.128.0.50:8443: connect: connection refused" Dec 04 00:34:15.233108 master-0 kubenswrapper[8678]: I1204 00:34:15.232914 8678 patch_prober.go:28] interesting pod/operator-controller-controller-manager-5f78c89466-mwkdg container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" start-of-body= Dec 04 00:34:15.233108 master-0 kubenswrapper[8678]: I1204 00:34:15.233076 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.36:8081/readyz\": dial tcp 10.128.0.36:8081: connect: connection refused" Dec 04 00:34:15.626645 master-0 kubenswrapper[8678]: I1204 00:34:15.626531 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/1.log" Dec 04 00:34:15.627194 master-0 kubenswrapper[8678]: I1204 00:34:15.627105 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/0.log" Dec 04 00:34:15.627194 master-0 kubenswrapper[8678]: I1204 00:34:15.627138 8678 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="18136422546c4a147a7c94fb498b0ad89b67c61c8dd61c5af0d85a4eadbfa728" exitCode=1 Dec 04 00:34:18.315376 master-0 kubenswrapper[8678]: E1204 00:34:18.315221 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:34:18.937444 master-0 kubenswrapper[8678]: E1204 00:34:18.937282 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 00:34:18.937857 master-0 kubenswrapper[8678]: E1204 00:34:18.937624 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.02s" Dec 04 00:34:18.937857 master-0 kubenswrapper[8678]: I1204 00:34:18.937781 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:34:18.937857 master-0 kubenswrapper[8678]: I1204 00:34:18.937845 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:34:18.938144 master-0 kubenswrapper[8678]: I1204 00:34:18.937865 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:34:18.938144 master-0 kubenswrapper[8678]: I1204 00:34:18.937889 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:18.938144 master-0 kubenswrapper[8678]: I1204 00:34:18.938026 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:18.938952 master-0 kubenswrapper[8678]: I1204 00:34:18.938862 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:34:18.939076 master-0 kubenswrapper[8678]: I1204 00:34:18.939018 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:18.939174 master-0 kubenswrapper[8678]: I1204 00:34:18.939062 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:34:18.939174 master-0 kubenswrapper[8678]: I1204 00:34:18.939150 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:18.939416 master-0 kubenswrapper[8678]: I1204 00:34:18.939363 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:34:18.940168 master-0 kubenswrapper[8678]: I1204 00:34:18.939727 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:34:18.940467 master-0 kubenswrapper[8678]: I1204 00:34:18.940295 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:34:18.942065 master-0 kubenswrapper[8678]: I1204 00:34:18.941238 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:18.951043 master-0 kubenswrapper[8678]: I1204 00:34:18.950798 8678 scope.go:117] "RemoveContainer" containerID="36a2cab4ca8775c3db41d1bd854a9aa530900e8e907d105b1156a340fd433e8d" Dec 04 00:34:18.958376 master-0 kubenswrapper[8678]: I1204 00:34:18.958289 8678 scope.go:117] "RemoveContainer" containerID="db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00" Dec 04 00:34:18.958623 master-0 kubenswrapper[8678]: I1204 00:34:18.958533 8678 scope.go:117] "RemoveContainer" containerID="30334a3fa525d9b6061a522d88430ab12379b269164eecaa76fc0069f4a00c26" Dec 04 00:34:18.959207 master-0 kubenswrapper[8678]: I1204 00:34:18.959162 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:34:18.962857 master-0 kubenswrapper[8678]: I1204 00:34:18.962805 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:34:19.659977 master-0 kubenswrapper[8678]: I1204 00:34:19.659899 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/1.log" Dec 04 00:34:19.665901 master-0 kubenswrapper[8678]: I1204 00:34:19.665839 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/0.log" Dec 04 00:34:19.991849 master-0 kubenswrapper[8678]: E1204 00:34:19.991665 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:21.410796 master-0 kubenswrapper[8678]: E1204 00:34:21.410605 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{community-operators-9rfw4.187ddbcb33c6974d openshift-marketplace 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-marketplace,Name:community-operators-9rfw4,UID:41f0ae0a-011e-4a4d-8fb6-773afb62f04d,APIVersion:v1,ResourceVersion:7654,FieldPath:spec.initContainers{extract-content},},Reason:Pulled,Message:Successfully pulled image \"registry.redhat.io/redhat/community-operator-index:v4.18\" in 31.007s (31.007s including waiting). Image size: 1201545551 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:31:34.792599373 +0000 UTC m=+78.119331929,LastTimestamp:2025-12-04 00:31:34.792599373 +0000 UTC m=+78.119331929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:34:24.232485 master-0 kubenswrapper[8678]: I1204 00:34:24.232340 8678 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:29.993186 master-0 kubenswrapper[8678]: E1204 00:34:29.993045 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:29.993186 master-0 kubenswrapper[8678]: E1204 00:34:29.993112 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:34:31.499870 master-0 kubenswrapper[8678]: I1204 00:34:31.499757 8678 status_manager.go:851] "Failed to get status for pod" podUID="655dc370-c0d1-4d03-a317-64bf099aff1b" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods openshift-apiserver-operator-667484ff5-mswdx)" Dec 04 00:34:35.316527 master-0 kubenswrapper[8678]: E1204 00:34:35.316404 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:34:36.175738 master-0 kubenswrapper[8678]: E1204 00:34:36.175659 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="17.238s" Dec 04 00:34:36.175738 master-0 kubenswrapper[8678]: I1204 00:34:36.175736 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:36.176337 master-0 kubenswrapper[8678]: I1204 00:34:36.175859 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 00:34:36.176337 master-0 kubenswrapper[8678]: I1204 00:34:36.175887 8678 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-etcd/etcd-master-0-master-0" mirrorPodUID="cd72eaf4-0b41-4af1-9cd3-2aca9faedbfc" Dec 04 00:34:36.176337 master-0 kubenswrapper[8678]: I1204 00:34:36.176044 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:36.176337 master-0 kubenswrapper[8678]: I1204 00:34:36.176065 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:36.176337 master-0 kubenswrapper[8678]: I1204 00:34:36.176113 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72"] Dec 04 00:34:36.186282 master-0 kubenswrapper[8678]: W1204 00:34:36.185530 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975f6a6f_1fbb_49e1_8a0a_722586355364.slice/crio-6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6 WatchSource:0}: Error finding container 6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6: Status 404 returned error can't find the container with id 6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6 Dec 04 00:34:36.191016 master-0 kubenswrapper[8678]: I1204 00:34:36.190919 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 00:34:36.206557 master-0 kubenswrapper[8678]: I1204 00:34:36.206490 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 00:34:36.206557 master-0 kubenswrapper[8678]: I1204 00:34:36.206543 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:34:36.206557 master-0 kubenswrapper[8678]: I1204 00:34:36.206565 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dvxb6"] Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206584 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206598 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerStarted","Data":"30334a3fa525d9b6061a522d88430ab12379b269164eecaa76fc0069f4a00c26"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206624 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206644 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zc792"] Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206659 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" event={"ID":"04f4782e-b152-41c0-870a-08936498d1af","Type":"ContainerDied","Data":"ef0a1dd8b3b02b9ccc27c7f5e6c342a96866c392b4b7777a54fb8bb661414577"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206680 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206691 8678 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-etcd/etcd-master-0-master-0" mirrorPodUID="cd72eaf4-0b41-4af1-9cd3-2aca9faedbfc" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206704 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerDied","Data":"0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206719 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" event={"ID":"aa373a8f-8a9c-4f90-ae62-1d48fd88550b","Type":"ContainerDied","Data":"016eb70a46f10bedd7dec24049021571b4b28da368391342d032b50cbe92ce70"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206734 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206747 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerDied","Data":"3ab83d217e29e8499eaf40a7b77ac6911f130d05e9b255651ddaf30e1585c461"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206764 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" event={"ID":"26273240-2261-4564-bb64-1aaf774a921f","Type":"ContainerDied","Data":"f675877019df3cdc18b7aefe49174ba92d0287bca845b45bc2f441207b0fb5fa"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206778 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" event={"ID":"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a","Type":"ContainerDied","Data":"fd3589300b36ad6c047594904bec153361e0713f63741a4acf7e0ce1f226f895"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206794 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206807 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" event={"ID":"ca8eddb5-4600-4058-94d2-5d0308c32613","Type":"ContainerDied","Data":"53f3ad5a02fe61d14e3118f30603f785f895999675e16d3f4049dea7bd628227"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206843 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206861 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206890 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206902 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206916 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206959 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206978 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerStarted","Data":"8535d74ae1fe68cf19d4bcff1682688f5b7202742afc467329b215e7d307d732"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.206992 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerDied","Data":"b61315793344ebcd4455235dcd882405194cc9e5d9bb66073a26fedf6f49f28c"} Dec 04 00:34:36.206962 master-0 kubenswrapper[8678]: I1204 00:34:36.207009 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerDied","Data":"04b6797d433194e1224976bde27df7380ac53111703d386c9136d1bdaf11768c"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207027 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerDied","Data":"4a833ea2a9a15920b34c9ef6e8f314468e42b929cf904fcaab498c2e48700df5"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207044 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerDied","Data":"21271674bed5db800ead1d33a02a41079776995c09f1c049ca58e762322ee71d"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207057 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerDied","Data":"bd570164e4f250f953ddde8e60445d595b3a58298a3711e92e8a9ec240f35d10"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207073 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerDied","Data":"7f51b557a3ad1653c4152bc3d0fece4c806c2c0777a98f5a35231532d2e85bae"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207096 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerDied","Data":"f134fa404e41ccccd9a96968aae081a3d4c05ff32e7941607b4075f5497a7ae4"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207114 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerDied","Data":"36a2cab4ca8775c3db41d1bd854a9aa530900e8e907d105b1156a340fd433e8d"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207132 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerDied","Data":"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207157 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerDied","Data":"30334a3fa525d9b6061a522d88430ab12379b269164eecaa76fc0069f4a00c26"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207175 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"7bce50c457ac1f4721bc81a570dd238a","Type":"ContainerStarted","Data":"85679bb689d574e7e094084d2cb2e8502ce40e08877635f8db2cd08bbde5c799"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207190 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" event={"ID":"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a","Type":"ContainerStarted","Data":"54937c05ac8c6f1489c45e040c7a8b811cbe1555b9e2143663921e28409b4b9e"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207206 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerStarted","Data":"c152b09b4d8fa529e75f7bbb79145b482cc8f1155d6ff7779131595595f74485"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207221 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" event={"ID":"ca8eddb5-4600-4058-94d2-5d0308c32613","Type":"ContainerStarted","Data":"e009631d791632ba92da9eff3d99b93a772bc8741a4589c95619c1e578d243e3"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207234 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" event={"ID":"aa373a8f-8a9c-4f90-ae62-1d48fd88550b","Type":"ContainerStarted","Data":"600d9c98d35895c2793f3107fb746cd14f131b889bc05d0720959a5d5fdc96d6"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207247 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"18136422546c4a147a7c94fb498b0ad89b67c61c8dd61c5af0d85a4eadbfa728"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207258 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" event={"ID":"04f4782e-b152-41c0-870a-08936498d1af","Type":"ContainerStarted","Data":"3c5ddfe809ad8259406b8a1bc43b7daca5c77cf88e86d585f2961174abb44769"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207270 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207282 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerStarted","Data":"fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207295 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerStarted","Data":"3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207307 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerStarted","Data":"3a39d58bf14a8a0237f78a42a4d77a9a5f5be020fc17c1b7fa5678e3282f18dc"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207320 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerStarted","Data":"b50a746f991e98693c439e07b3494f8b2b88b67b84aa17a2878ffc95b7437489"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207333 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerStarted","Data":"915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207345 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" event={"ID":"26273240-2261-4564-bb64-1aaf774a921f","Type":"ContainerStarted","Data":"4c2009a2bf31938d6c0f5577ab00c65549c51f336b23bc64b9474c66e3b424a4"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207356 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerDied","Data":"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207372 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"bf036457c891374f07b3971f201af28348584fd8bc55d027f138b68845a7f9c5"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207384 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"c6ba48b68ff9ed2a1ef53e045da181c07e856273e5cda13989812c5e51dcbd8f"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207395 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"82ff8e87e5ae91c2dd0d02f9048d75269a6a042664e9b18b5e0da259157ab00c"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207406 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"3de93b93248fc37e1dc44ecdda58bfd5dbe10fdf2a3e5f6252c1f2d6c155905a"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207419 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"ebf07eb54db570834b7c9a90b6b07403","Type":"ContainerStarted","Data":"7ab30ae3e317040e0131f176b2a07b785a6c1bff67d196756458ee2d14c0ccce"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207430 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerDied","Data":"7630ed34c5afaf7ec052397359ddb4e03d2aaa0074ba8d9aa9989ae1eab28f0b"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207445 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerDied","Data":"8535d74ae1fe68cf19d4bcff1682688f5b7202742afc467329b215e7d307d732"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207458 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerDied","Data":"18136422546c4a147a7c94fb498b0ad89b67c61c8dd61c5af0d85a4eadbfa728"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207471 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerStarted","Data":"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207484 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerStarted","Data":"04e9200304854483446720319d72e82a552d8c10ce33bfebf374bd1ca17290f6"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.207497 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerStarted","Data":"f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88"} Dec 04 00:34:36.209044 master-0 kubenswrapper[8678]: I1204 00:34:36.208085 8678 scope.go:117] "RemoveContainer" containerID="7630ed34c5afaf7ec052397359ddb4e03d2aaa0074ba8d9aa9989ae1eab28f0b" Dec 04 00:34:36.212485 master-0 kubenswrapper[8678]: W1204 00:34:36.210146 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf80e5d69_5170_49df_b5e9_7991f63fd3dc.slice/crio-987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f WatchSource:0}: Error finding container 987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f: Status 404 returned error can't find the container with id 987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f Dec 04 00:34:36.212485 master-0 kubenswrapper[8678]: I1204 00:34:36.210570 8678 scope.go:117] "RemoveContainer" containerID="8535d74ae1fe68cf19d4bcff1682688f5b7202742afc467329b215e7d307d732" Dec 04 00:34:36.212485 master-0 kubenswrapper[8678]: I1204 00:34:36.210832 8678 scope.go:117] "RemoveContainer" containerID="0b0c5f018041e5da6709b373519b647b7ef42af9fd4bb25ef0f9e1dbfb47a792" Dec 04 00:34:36.212485 master-0 kubenswrapper[8678]: I1204 00:34:36.212102 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:34:36.212485 master-0 kubenswrapper[8678]: I1204 00:34:36.212133 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:34:36.213469 master-0 kubenswrapper[8678]: I1204 00:34:36.213074 8678 scope.go:117] "RemoveContainer" containerID="18136422546c4a147a7c94fb498b0ad89b67c61c8dd61c5af0d85a4eadbfa728" Dec 04 00:34:36.248997 master-0 kubenswrapper[8678]: I1204 00:34:36.248069 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 00:34:36.248997 master-0 kubenswrapper[8678]: I1204 00:34:36.248204 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:34:36.248997 master-0 kubenswrapper[8678]: I1204 00:34:36.248271 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:34:36.269459 master-0 kubenswrapper[8678]: I1204 00:34:36.267528 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:34:36.281057 master-0 kubenswrapper[8678]: I1204 00:34:36.280969 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 00:34:36.284561 master-0 kubenswrapper[8678]: I1204 00:34:36.282121 8678 scope.go:117] "RemoveContainer" containerID="0db991bc2c684e18f0fe34aa8f75dfa9ac756868127a83baa31a7ad2463083aa" Dec 04 00:34:36.352717 master-0 kubenswrapper[8678]: I1204 00:34:36.352654 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:34:36.353360 master-0 kubenswrapper[8678]: I1204 00:34:36.352998 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 00:34:36.359154 master-0 kubenswrapper[8678]: I1204 00:34:36.359113 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:34:36.374834 master-0 kubenswrapper[8678]: I1204 00:34:36.374787 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-wlmqp"] Dec 04 00:34:36.381072 master-0 kubenswrapper[8678]: I1204 00:34:36.381014 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:34:36.383133 master-0 kubenswrapper[8678]: I1204 00:34:36.383069 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-9rfw4"] Dec 04 00:34:36.390392 master-0 kubenswrapper[8678]: I1204 00:34:36.390069 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" podStartSLOduration=189.805755808 podStartE2EDuration="3m11.390051115s" podCreationTimestamp="2025-12-04 00:31:25 +0000 UTC" firstStartedPulling="2025-12-04 00:31:35.385447127 +0000 UTC m=+78.712179683" lastFinishedPulling="2025-12-04 00:31:36.969742434 +0000 UTC m=+80.296474990" observedRunningTime="2025-12-04 00:34:36.386995185 +0000 UTC m=+259.713727741" watchObservedRunningTime="2025-12-04 00:34:36.390051115 +0000 UTC m=+259.716783671" Dec 04 00:34:36.396977 master-0 kubenswrapper[8678]: I1204 00:34:36.396050 8678 scope.go:117] "RemoveContainer" containerID="72ef57cbc2ab2d91c22b8824c0c1162b62192c4d47fd678a0547242b1b0822b4" Dec 04 00:34:36.475608 master-0 kubenswrapper[8678]: I1204 00:34:36.475568 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:34:36.476579 master-0 kubenswrapper[8678]: I1204 00:34:36.476527 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-g9q5w"] Dec 04 00:34:36.531836 master-0 kubenswrapper[8678]: I1204 00:34:36.529512 8678 scope.go:117] "RemoveContainer" containerID="df73f6fd7772f71c1dc73cb2e3646ba79fbf327a83f244a8d49e3d13bf7bcc50" Dec 04 00:34:36.575133 master-0 kubenswrapper[8678]: I1204 00:34:36.575066 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:34:36.577092 master-0 kubenswrapper[8678]: I1204 00:34:36.577039 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-5mxnd"] Dec 04 00:34:36.598307 master-0 kubenswrapper[8678]: I1204 00:34:36.598253 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-m4q5k" podStartSLOduration=197.486284863 podStartE2EDuration="3m26.598197511s" podCreationTimestamp="2025-12-04 00:31:10 +0000 UTC" firstStartedPulling="2025-12-04 00:31:36.189962253 +0000 UTC m=+79.516694809" lastFinishedPulling="2025-12-04 00:31:45.301874891 +0000 UTC m=+88.628607457" observedRunningTime="2025-12-04 00:34:36.59818287 +0000 UTC m=+259.924915426" watchObservedRunningTime="2025-12-04 00:34:36.598197511 +0000 UTC m=+259.924930067" Dec 04 00:34:36.614827 master-0 kubenswrapper[8678]: I1204 00:34:36.614799 8678 scope.go:117] "RemoveContainer" containerID="82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb" Dec 04 00:34:36.651657 master-0 kubenswrapper[8678]: I1204 00:34:36.650292 8678 scope.go:117] "RemoveContainer" containerID="7460de3bd09f5b15ed46f63bd45fbc2cdf2122495a65d1149a99758b9a9389b9" Dec 04 00:34:36.654186 master-0 kubenswrapper[8678]: I1204 00:34:36.654136 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-cl29d" podStartSLOduration=174.28224599 podStartE2EDuration="3m27.654113816s" podCreationTimestamp="2025-12-04 00:31:09 +0000 UTC" firstStartedPulling="2025-12-04 00:31:11.921616865 +0000 UTC m=+55.248349421" lastFinishedPulling="2025-12-04 00:31:45.293484691 +0000 UTC m=+88.620217247" observedRunningTime="2025-12-04 00:34:36.650702816 +0000 UTC m=+259.977435362" watchObservedRunningTime="2025-12-04 00:34:36.654113816 +0000 UTC m=+259.980846372" Dec 04 00:34:36.681634 master-0 kubenswrapper[8678]: I1204 00:34:36.681601 8678 scope.go:117] "RemoveContainer" containerID="1f0462fd5b484033d78467a0da74f979aa85d8b25d9599d8df1e60ead439fb2e" Dec 04 00:34:36.725804 master-0 kubenswrapper[8678]: I1204 00:34:36.725751 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:34:36.730948 master-0 kubenswrapper[8678]: I1204 00:34:36.730893 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 00:34:36.747557 master-0 kubenswrapper[8678]: I1204 00:34:36.747450 8678 scope.go:117] "RemoveContainer" containerID="82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb" Dec 04 00:34:36.748145 master-0 kubenswrapper[8678]: E1204 00:34:36.748108 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb\": container with ID starting with 82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb not found: ID does not exist" containerID="82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb" Dec 04 00:34:36.748213 master-0 kubenswrapper[8678]: I1204 00:34:36.748149 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb"} err="failed to get container status \"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb\": rpc error: code = NotFound desc = could not find container \"82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb\": container with ID starting with 82232b1cf53954b9bf86c6b3354e4adb7cd66f51fd589d02cf8325a375eef0bb not found: ID does not exist" Dec 04 00:34:36.781058 master-0 kubenswrapper[8678]: I1204 00:34:36.781006 8678 generic.go:334] "Generic (PLEG): container finished" podID="975f6a6f-1fbb-49e1-8a0a-722586355364" containerID="79d9c7dd12437812250729ab6ecd35ebbdf85e465fd2ec2d4125aeda4fd082a4" exitCode=0 Dec 04 00:34:36.781242 master-0 kubenswrapper[8678]: I1204 00:34:36.781069 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvxb6" event={"ID":"975f6a6f-1fbb-49e1-8a0a-722586355364","Type":"ContainerDied","Data":"79d9c7dd12437812250729ab6ecd35ebbdf85e465fd2ec2d4125aeda4fd082a4"} Dec 04 00:34:36.781242 master-0 kubenswrapper[8678]: I1204 00:34:36.781136 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvxb6" event={"ID":"975f6a6f-1fbb-49e1-8a0a-722586355364","Type":"ContainerStarted","Data":"6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6"} Dec 04 00:34:36.782116 master-0 kubenswrapper[8678]: I1204 00:34:36.782074 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"6b42d014-19a2-4c88-abd6-74b9191d6d16","Type":"ContainerStarted","Data":"141db83ebfaa98384885b96b46a0566c73e0126df52aa7b221371a34fa1078d1"} Dec 04 00:34:36.784449 master-0 kubenswrapper[8678]: I1204 00:34:36.784093 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/1.log" Dec 04 00:34:36.788577 master-0 kubenswrapper[8678]: I1204 00:34:36.787608 8678 generic.go:334] "Generic (PLEG): container finished" podID="7e83f444-49e8-40b5-9a58-3128002f28c9" containerID="be6a6b316c4984f8a2b50ae86401f8c00923107cb95d0cd4b15dcef413f3ad38" exitCode=0 Dec 04 00:34:36.788577 master-0 kubenswrapper[8678]: I1204 00:34:36.787690 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zc792" event={"ID":"7e83f444-49e8-40b5-9a58-3128002f28c9","Type":"ContainerDied","Data":"be6a6b316c4984f8a2b50ae86401f8c00923107cb95d0cd4b15dcef413f3ad38"} Dec 04 00:34:36.788577 master-0 kubenswrapper[8678]: I1204 00:34:36.787722 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zc792" event={"ID":"7e83f444-49e8-40b5-9a58-3128002f28c9","Type":"ContainerStarted","Data":"b7107932acd9800ab6a9aa8488d291eca64c4817c02b99a03d6afcb4c6aa5306"} Dec 04 00:34:36.790219 master-0 kubenswrapper[8678]: I1204 00:34:36.790184 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-56f5898f45-2qvfj_dd621016-f4f2-4839-aae0-a804e6023423/service-ca-operator/1.log" Dec 04 00:34:36.792266 master-0 kubenswrapper[8678]: I1204 00:34:36.792162 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"f80e5d69-5170-49df-b5e9-7991f63fd3dc","Type":"ContainerStarted","Data":"987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f"} Dec 04 00:34:36.794514 master-0 kubenswrapper[8678]: I1204 00:34:36.794050 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/1.log" Dec 04 00:34:36.796594 master-0 kubenswrapper[8678]: I1204 00:34:36.796158 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/1.log" Dec 04 00:34:36.797726 master-0 kubenswrapper[8678]: I1204 00:34:36.797685 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/1.log" Dec 04 00:34:36.797791 master-0 kubenswrapper[8678]: I1204 00:34:36.797768 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerStarted","Data":"1390652d357c9660029c7c11251fd012033ccb910a6529103f75fc7a1f1c9652"} Dec 04 00:34:36.801845 master-0 kubenswrapper[8678]: I1204 00:34:36.801801 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerStarted","Data":"8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f"} Dec 04 00:34:36.803022 master-0 kubenswrapper[8678]: I1204 00:34:36.802990 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" event={"ID":"a6a2308d-6d6f-4e8d-a6db-d931a172ed55","Type":"ContainerStarted","Data":"b4d5da9639ac64af8c6b49afd056c92bbfb29caf48793701f25d367ee5d81bc3"} Dec 04 00:34:36.806086 master-0 kubenswrapper[8678]: I1204 00:34:36.806044 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/1.log" Dec 04 00:34:36.806217 master-0 kubenswrapper[8678]: I1204 00:34:36.806120 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1"} Dec 04 00:34:36.860238 master-0 kubenswrapper[8678]: I1204 00:34:36.860170 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" path="/var/lib/kubelet/pods/1568fd73-c51d-43c5-82d0-d938ecdf698f/volumes" Dec 04 00:34:36.861121 master-0 kubenswrapper[8678]: I1204 00:34:36.861079 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" path="/var/lib/kubelet/pods/27c42a3f-b337-4726-b1db-27a3e2092dde/volumes" Dec 04 00:34:36.861957 master-0 kubenswrapper[8678]: I1204 00:34:36.861898 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" path="/var/lib/kubelet/pods/41f0ae0a-011e-4a4d-8fb6-773afb62f04d/volumes" Dec 04 00:34:36.863334 master-0 kubenswrapper[8678]: I1204 00:34:36.863294 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="463d57da-a6b6-40a7-b55b-90b5a187aed4" path="/var/lib/kubelet/pods/463d57da-a6b6-40a7-b55b-90b5a187aed4/volumes" Dec 04 00:34:36.864007 master-0 kubenswrapper[8678]: I1204 00:34:36.863940 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="589ef02a-5447-43d6-8758-67916768cb54" path="/var/lib/kubelet/pods/589ef02a-5447-43d6-8758-67916768cb54/volumes" Dec 04 00:34:36.864737 master-0 kubenswrapper[8678]: I1204 00:34:36.864671 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" path="/var/lib/kubelet/pods/701d4ae9-e905-497b-96a5-0547eaee4073/volumes" Dec 04 00:34:36.866775 master-0 kubenswrapper[8678]: I1204 00:34:36.866687 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7289ceb2-9c01-4216-85c4-8e829f8914e0" path="/var/lib/kubelet/pods/7289ceb2-9c01-4216-85c4-8e829f8914e0/volumes" Dec 04 00:34:37.820335 master-0 kubenswrapper[8678]: I1204 00:34:37.820270 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"f80e5d69-5170-49df-b5e9-7991f63fd3dc","Type":"ContainerStarted","Data":"a4d8df3e3af5b57340a108d211502f9b486e94114c010963789ad8118dc86e5b"} Dec 04 00:34:37.832830 master-0 kubenswrapper[8678]: I1204 00:34:37.832734 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"6b42d014-19a2-4c88-abd6-74b9191d6d16","Type":"ContainerStarted","Data":"370746cda174b3297e4978d445bd103ac2f5c5a7f9f05309706d5946410e739f"} Dec 04 00:34:37.846702 master-0 kubenswrapper[8678]: I1204 00:34:37.846630 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-2-master-0" podStartSLOduration=189.846611032 podStartE2EDuration="3m9.846611032s" podCreationTimestamp="2025-12-04 00:31:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:34:37.845954213 +0000 UTC m=+261.172686769" watchObservedRunningTime="2025-12-04 00:34:37.846611032 +0000 UTC m=+261.173343578" Dec 04 00:34:37.872688 master-0 kubenswrapper[8678]: I1204 00:34:37.872518 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-4-master-0" podStartSLOduration=204.872484029 podStartE2EDuration="3m24.872484029s" podCreationTimestamp="2025-12-04 00:31:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:34:37.870987925 +0000 UTC m=+261.197720581" watchObservedRunningTime="2025-12-04 00:34:37.872484029 +0000 UTC m=+261.199216625" Dec 04 00:34:38.844968 master-0 kubenswrapper[8678]: I1204 00:34:38.844861 8678 generic.go:334] "Generic (PLEG): container finished" podID="975f6a6f-1fbb-49e1-8a0a-722586355364" containerID="e689fbef6d70030a6b0b4a7df461d6fca5d2b1590d1c7473a4818b8d5705082c" exitCode=0 Dec 04 00:34:38.845970 master-0 kubenswrapper[8678]: I1204 00:34:38.844950 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvxb6" event={"ID":"975f6a6f-1fbb-49e1-8a0a-722586355364","Type":"ContainerDied","Data":"e689fbef6d70030a6b0b4a7df461d6fca5d2b1590d1c7473a4818b8d5705082c"} Dec 04 00:34:38.849853 master-0 kubenswrapper[8678]: I1204 00:34:38.849794 8678 generic.go:334] "Generic (PLEG): container finished" podID="7e83f444-49e8-40b5-9a58-3128002f28c9" containerID="1e6348590b5cd61d8f68dbce714358a044d7ae6003c498bcd2a36157fac20e6b" exitCode=0 Dec 04 00:34:38.862474 master-0 kubenswrapper[8678]: I1204 00:34:38.862383 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zc792" event={"ID":"7e83f444-49e8-40b5-9a58-3128002f28c9","Type":"ContainerDied","Data":"1e6348590b5cd61d8f68dbce714358a044d7ae6003c498bcd2a36157fac20e6b"} Dec 04 00:34:39.440504 master-0 kubenswrapper[8678]: I1204 00:34:39.440415 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 00:34:39.860405 master-0 kubenswrapper[8678]: I1204 00:34:39.860235 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zc792" event={"ID":"7e83f444-49e8-40b5-9a58-3128002f28c9","Type":"ContainerStarted","Data":"18ecb555fad6afed50f0bfa8426ed43456e7d4376278bf98c30cfbf7c50dab1e"} Dec 04 00:34:39.863276 master-0 kubenswrapper[8678]: I1204 00:34:39.863162 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvxb6" event={"ID":"975f6a6f-1fbb-49e1-8a0a-722586355364","Type":"ContainerStarted","Data":"4252272b07bf139081db2bd14db4a767a3a87471fdf3b7902c3d2b1c216c552f"} Dec 04 00:34:39.867569 master-0 kubenswrapper[8678]: I1204 00:34:39.866856 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" event={"ID":"a6a2308d-6d6f-4e8d-a6db-d931a172ed55","Type":"ContainerStarted","Data":"e5be4fe727906d907e13052e2f5e4da30f0568dc3c005e899e0bb15bd8847ece"} Dec 04 00:34:39.892310 master-0 kubenswrapper[8678]: I1204 00:34:39.892207 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-zc792" podStartSLOduration=204.355276798 podStartE2EDuration="3m26.892179743s" podCreationTimestamp="2025-12-04 00:31:13 +0000 UTC" firstStartedPulling="2025-12-04 00:34:36.788829415 +0000 UTC m=+260.115561971" lastFinishedPulling="2025-12-04 00:34:39.32573236 +0000 UTC m=+262.652464916" observedRunningTime="2025-12-04 00:34:39.888701111 +0000 UTC m=+263.215433667" watchObservedRunningTime="2025-12-04 00:34:39.892179743 +0000 UTC m=+263.218912329" Dec 04 00:34:39.911531 master-0 kubenswrapper[8678]: I1204 00:34:39.911193 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-dvxb6" podStartSLOduration=206.35609045 podStartE2EDuration="3m28.911166898s" podCreationTimestamp="2025-12-04 00:31:11 +0000 UTC" firstStartedPulling="2025-12-04 00:34:36.782494929 +0000 UTC m=+260.109227485" lastFinishedPulling="2025-12-04 00:34:39.337571337 +0000 UTC m=+262.664303933" observedRunningTime="2025-12-04 00:34:39.910383825 +0000 UTC m=+263.237116411" watchObservedRunningTime="2025-12-04 00:34:39.911166898 +0000 UTC m=+263.237899464" Dec 04 00:34:39.933066 master-0 kubenswrapper[8678]: I1204 00:34:39.932906 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" podStartSLOduration=202.127304932 podStartE2EDuration="3m24.932877253s" podCreationTimestamp="2025-12-04 00:31:15 +0000 UTC" firstStartedPulling="2025-12-04 00:34:36.17750714 +0000 UTC m=+259.504239706" lastFinishedPulling="2025-12-04 00:34:38.983079431 +0000 UTC m=+262.309812027" observedRunningTime="2025-12-04 00:34:39.930536564 +0000 UTC m=+263.257269160" watchObservedRunningTime="2025-12-04 00:34:39.932877253 +0000 UTC m=+263.259609819" Dec 04 00:34:41.866950 master-0 kubenswrapper[8678]: I1204 00:34:41.866840 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:41.866950 master-0 kubenswrapper[8678]: I1204 00:34:41.866918 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:41.929947 master-0 kubenswrapper[8678]: I1204 00:34:41.929876 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:43.867972 master-0 kubenswrapper[8678]: I1204 00:34:43.867869 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:43.867972 master-0 kubenswrapper[8678]: I1204 00:34:43.867955 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:43.901335 master-0 kubenswrapper[8678]: I1204 00:34:43.901251 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:44.440439 master-0 kubenswrapper[8678]: I1204 00:34:44.440356 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 00:34:44.469641 master-0 kubenswrapper[8678]: I1204 00:34:44.469572 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 00:34:44.931432 master-0 kubenswrapper[8678]: E1204 00:34:44.931305 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0\" is forbidden: the server was unable to return a response in the time allotted, but may still be processing the request (get limitranges)" pod="openshift-etcd/etcd-master-0" Dec 04 00:34:44.961315 master-0 kubenswrapper[8678]: I1204 00:34:44.961201 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:34:45.920117 master-0 kubenswrapper[8678]: I1204 00:34:45.920014 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 00:34:47.419201 master-0 kubenswrapper[8678]: I1204 00:34:47.419122 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:34:50.336567 master-0 kubenswrapper[8678]: E1204 00:34:50.336330 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:34:40Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:34:40Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:34:40Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:34:40Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a17e9d83aeb6de5f0851aaacd1a9ebddbc8a4ac3ece2e4af8670aa0c33b8fc9c\\\"],\\\"sizeBytes\\\":1631769045},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:98ce2d349f8bc693d76d9a68097b758b987cf17ea3beb66bbd09d12fa78b4d0c\\\"],\\\"sizeBytes\\\":1232076476},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:4281dc4ce2dd0685040e3d669b44cc2fc945c529f1e03e9a1e3948bc04801e98\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:fd045934f63cfcd06ea917296b90880c5b44256817e606d698b5afe226829128\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201545551},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a31af646ce5587c051459a88df413dc30be81e7f15399aa909e19effa7de772a\\\"],\\\"sizeBytes\\\":983731853},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\"],\\\"sizeBytes\\\":938321573},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3c0962dbbad51633a7d97ef253d0249269bfe3bbef3bfe99a99457470e7a682\\\"],\\\"sizeBytes\\\":912736453},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f313372fe49afad871cc56225dcd4d31bed249abeab55fb288e1f854138fbf\\\"],\\\"sizeBytes\\\":870581225},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\\\"],\\\"sizeBytes\\\":857083855},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0e5c0acdd03dc840d7345ae397feaf6147a32a8fef89a0ac2ddc8d14b068c9ff\\\"],\\\"sizeBytes\\\":767313881},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:184239929f74bb7c56c1cf5b94b5f91dd4013a87034fe04b9fa1027d2bb6c5a4\\\"],\\\"sizeBytes\\\":682385666},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d866f93bed16cfebd8019ad6b89a4dd4abedfc20ee5d28d7edad045e7df0fda\\\"],\\\"sizeBytes\\\":677540255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14\\\"],\\\"sizeBytes\\\":672854011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff94e909d3b037c815e8ae67989a7616936e67195b758abac6b5d3f0d59562c8\\\"],\\\"sizeBytes\\\":616123373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da6f62afd2795d1b0af69532a5534c099bbb81d4e7abd2616b374db191552c51\\\"],\\\"sizeBytes\\\":583850203},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51a4c20765f54b6a6b5513f97cf54bb99631c2abe860949293456886a74f87fe\\\"],\\\"sizeBytes\\\":576621883},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc9758be9f0f0a480fb5e119ecb1e1101ef807bdc765a155212a8188d79b9e60\\\"],\\\"sizeBytes\\\":552687886},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e8903affdf29401b9a86b9f58795c9f445f34194960c7b2734f30601c48cbdf\\\"],\\\"sizeBytes\\\":543241813},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\\\"],\\\"sizeBytes\\\":532668041},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ceaa4102b35e54be54e23c8ea73bb0dac4978cffb54105ad00b51393f47595da\\\"],\\\"sizeBytes\\\":532338751},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca4933b9ba55069205ea53970128c4e8c4b46560ef721c8aaee00aaf736664b5\\\"],\\\"sizeBytes\\\":512852463},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:98c80d92a2ef8d44ee625b229b77b7bfdb1b06cbfe0d4df9e2ca2cba904467f7\\\"],\\\"sizeBytes\\\":512468025},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\"],\\\"sizeBytes\\\":509451797},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a2ef63f356c11ba629d8038474ab287797340de1219b4fee97c386975689110\\\"],\\\"sizeBytes\\\":507701628},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\\\"],\\\"sizeBytes\\\":506755373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:492103a8365ef9a1d5f237b4ba90aff87369167ec91db29ff0251ba5aab2b419\\\"],\\\"sizeBytes\\\":505663073},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c2b518cb834a0b6ca50d73eceb5f8e64aefb09094d39e4ba0d8e4632f6cdf908\\\"],\\\"sizeBytes\\\":505642108},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:58ed827ee19ac91b6f860d307797b24b8aec02e671605388c4afe4fa19ddfc36\\\"],\\\"sizeBytes\\\":503354646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefdc67602b8bc3941001b030ab95d82e10432f814634b80eb8ce45bc9ebd3de\\\"],\\\"sizeBytes\\\":503025552},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3051af3343018fecbf3a6edacea69de841fc5211c09e7fb6a2499188dc979395\\\"],\\\"sizeBytes\\\":502450335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cb6ecfb89e53653b69ae494ebc940b9fcf7b7db317b156e186435cc541589d9\\\"],\\\"sizeBytes\\\":500957387},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\\\"],\\\"sizeBytes\\\":500863090},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a6a3308d885301c7718a465f1af2d08a617abbdff23352d5422d1ae4af33cf\\\"],\\\"sizeBytes\\\":499812475},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\\\"],\\\"sizeBytes\\\":499719811},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:93145fd0c004dc4fca21435a32c7e55e962f321aff260d702f387cfdebee92a5\\\"],\\\"sizeBytes\\\":499096673},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0c6de747539dd00ede882fb4f73cead462bf0a7efda7173fd5d443ef7a00251\\\"],\\\"sizeBytes\\\":490470354},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6199be91b821875ba2609cf7fa886b74b9a8b573622fe33cc1bc39cd55acac08\\\"],\\\"sizeBytes\\\":489542560},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ebd79294a663cb38370ae81f9cda91cef7fb1370ec5b495b4bdb95e77272e6a8\\\"],\\\"sizeBytes\\\":481573011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b4e0b20fdb38d516e871ff5d593c4273cc9933cb6a65ec93e727ca4a7777fd20\\\"],\\\"sizeBytes\\\":478931717},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a3e2790bda8898df5e4e9cf1878103ac483ea1633819d76ea68976b0b2062b6\\\"],\\\"sizeBytes\\\":478655954},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:656fe650bac2929182cd0cf7d7e566d089f69e06541b8329c6d40b89346c03ca\\\"],\\\"sizeBytes\\\":462741734},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f4724570795357eb097251a021f20c94c79b3054f3adb3bc0812143ba791dc1\\\"],\\\"sizeBytes\\\":461716546},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03d2897e7cc0e8d0c306acb68ca3d9396d502882c14942faadfdb16bc40e17d\\\"],\\\"sizeBytes\\\":459566623},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:607e31ebb2c85f53775455b38a607a68cb2bdab1e369f03c57e715a4ebb88831\\\"],\\\"sizeBytes\\\":458183681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36fa1378b9c26de6d45187b1e7352f3b1147109427fab3669b107d81fd967601\\\"],\\\"sizeBytes\\\":452603646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eac937aae64688cb47b38ad2cbba5aa7e6d41c691df1f3ca4ff81e5117084d1e\\\"],\\\"sizeBytes\\\":451053419},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7825952834ade266ce08d1a9eb0665e4661dea0a40647d3e1de2cf6266665e9d\\\"],\\\"sizeBytes\\\":443305841},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6dd80564094a262c1bb53c037288c9c69a46b22dc7dd3ee5c52384404ebfdc81\\\"],\\\"sizeBytes\\\":442523452}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":false},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:34:51.912992 master-0 kubenswrapper[8678]: I1204 00:34:51.912904 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:34:52.079501 master-0 kubenswrapper[8678]: I1204 00:34:52.079405 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=5.079382364 podStartE2EDuration="5.079382364s" podCreationTimestamp="2025-12-04 00:34:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:34:52.076885771 +0000 UTC m=+275.403618377" watchObservedRunningTime="2025-12-04 00:34:52.079382364 +0000 UTC m=+275.406114930" Dec 04 00:35:00.837092 master-0 kubenswrapper[8678]: I1204 00:35:00.836374 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6"] Dec 04 00:35:00.837092 master-0 kubenswrapper[8678]: I1204 00:35:00.836679 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="kube-rbac-proxy" containerID="cri-o://08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" gracePeriod=30 Dec 04 00:35:00.837092 master-0 kubenswrapper[8678]: I1204 00:35:00.836874 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="machine-approver-controller" containerID="cri-o://7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" gracePeriod=30 Dec 04 00:35:00.999409 master-0 kubenswrapper[8678]: I1204 00:35:00.999359 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:35:01.022359 master-0 kubenswrapper[8678]: I1204 00:35:01.022300 8678 generic.go:334] "Generic (PLEG): container finished" podID="fc9c7534-48b5-4a4f-a534-267f33544210" containerID="7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" exitCode=0 Dec 04 00:35:01.022359 master-0 kubenswrapper[8678]: I1204 00:35:01.022341 8678 generic.go:334] "Generic (PLEG): container finished" podID="fc9c7534-48b5-4a4f-a534-267f33544210" containerID="08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" exitCode=0 Dec 04 00:35:01.022595 master-0 kubenswrapper[8678]: I1204 00:35:01.022364 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" Dec 04 00:35:01.022896 master-0 kubenswrapper[8678]: I1204 00:35:01.022365 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerDied","Data":"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4"} Dec 04 00:35:01.022956 master-0 kubenswrapper[8678]: I1204 00:35:01.022907 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerDied","Data":"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4"} Dec 04 00:35:01.022956 master-0 kubenswrapper[8678]: I1204 00:35:01.022942 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6" event={"ID":"fc9c7534-48b5-4a4f-a534-267f33544210","Type":"ContainerDied","Data":"b566db61a8be0af3dfe32b78896da946ada78cbd35b78135d4c1372f66a4fa19"} Dec 04 00:35:01.023036 master-0 kubenswrapper[8678]: I1204 00:35:01.022967 8678 scope.go:117] "RemoveContainer" containerID="7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" Dec 04 00:35:01.034543 master-0 kubenswrapper[8678]: I1204 00:35:01.034512 8678 scope.go:117] "RemoveContainer" containerID="08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" Dec 04 00:35:01.050633 master-0 kubenswrapper[8678]: I1204 00:35:01.050542 8678 scope.go:117] "RemoveContainer" containerID="7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" Dec 04 00:35:01.051056 master-0 kubenswrapper[8678]: E1204 00:35:01.051022 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4\": container with ID starting with 7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4 not found: ID does not exist" containerID="7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" Dec 04 00:35:01.051116 master-0 kubenswrapper[8678]: I1204 00:35:01.051057 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4"} err="failed to get container status \"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4\": rpc error: code = NotFound desc = could not find container \"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4\": container with ID starting with 7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4 not found: ID does not exist" Dec 04 00:35:01.051116 master-0 kubenswrapper[8678]: I1204 00:35:01.051079 8678 scope.go:117] "RemoveContainer" containerID="08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" Dec 04 00:35:01.051407 master-0 kubenswrapper[8678]: E1204 00:35:01.051373 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4\": container with ID starting with 08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4 not found: ID does not exist" containerID="08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" Dec 04 00:35:01.051407 master-0 kubenswrapper[8678]: I1204 00:35:01.051398 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4"} err="failed to get container status \"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4\": rpc error: code = NotFound desc = could not find container \"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4\": container with ID starting with 08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4 not found: ID does not exist" Dec 04 00:35:01.051494 master-0 kubenswrapper[8678]: I1204 00:35:01.051410 8678 scope.go:117] "RemoveContainer" containerID="7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4" Dec 04 00:35:01.051952 master-0 kubenswrapper[8678]: I1204 00:35:01.051899 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4"} err="failed to get container status \"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4\": rpc error: code = NotFound desc = could not find container \"7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4\": container with ID starting with 7ed981e85a6cf91b1903762be2f3921b2f2ea2f05edac002627ee72eca55a1f4 not found: ID does not exist" Dec 04 00:35:01.052020 master-0 kubenswrapper[8678]: I1204 00:35:01.051957 8678 scope.go:117] "RemoveContainer" containerID="08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4" Dec 04 00:35:01.052366 master-0 kubenswrapper[8678]: I1204 00:35:01.052333 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4"} err="failed to get container status \"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4\": rpc error: code = NotFound desc = could not find container \"08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4\": container with ID starting with 08e54dc4a790074540efd5549356dfc6bf57c5ea768c3c6b5b57ed7c8665cfc4 not found: ID does not exist" Dec 04 00:35:01.125166 master-0 kubenswrapper[8678]: I1204 00:35:01.125091 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config\") pod \"fc9c7534-48b5-4a4f-a534-267f33544210\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " Dec 04 00:35:01.125388 master-0 kubenswrapper[8678]: I1204 00:35:01.125201 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls\") pod \"fc9c7534-48b5-4a4f-a534-267f33544210\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " Dec 04 00:35:01.125388 master-0 kubenswrapper[8678]: I1204 00:35:01.125244 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbh9\" (UniqueName: \"kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9\") pod \"fc9c7534-48b5-4a4f-a534-267f33544210\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " Dec 04 00:35:01.125388 master-0 kubenswrapper[8678]: I1204 00:35:01.125290 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config\") pod \"fc9c7534-48b5-4a4f-a534-267f33544210\" (UID: \"fc9c7534-48b5-4a4f-a534-267f33544210\") " Dec 04 00:35:01.126217 master-0 kubenswrapper[8678]: I1204 00:35:01.126161 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "fc9c7534-48b5-4a4f-a534-267f33544210" (UID: "fc9c7534-48b5-4a4f-a534-267f33544210"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:35:01.126294 master-0 kubenswrapper[8678]: I1204 00:35:01.126200 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config" (OuterVolumeSpecName: "config") pod "fc9c7534-48b5-4a4f-a534-267f33544210" (UID: "fc9c7534-48b5-4a4f-a534-267f33544210"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:35:01.128284 master-0 kubenswrapper[8678]: I1204 00:35:01.128228 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls" (OuterVolumeSpecName: "machine-approver-tls") pod "fc9c7534-48b5-4a4f-a534-267f33544210" (UID: "fc9c7534-48b5-4a4f-a534-267f33544210"). InnerVolumeSpecName "machine-approver-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:35:01.129702 master-0 kubenswrapper[8678]: I1204 00:35:01.129657 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9" (OuterVolumeSpecName: "kube-api-access-knbh9") pod "fc9c7534-48b5-4a4f-a534-267f33544210" (UID: "fc9c7534-48b5-4a4f-a534-267f33544210"). InnerVolumeSpecName "kube-api-access-knbh9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:35:01.227359 master-0 kubenswrapper[8678]: I1204 00:35:01.227293 8678 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-auth-proxy-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:01.227359 master-0 kubenswrapper[8678]: I1204 00:35:01.227343 8678 reconciler_common.go:293] "Volume detached for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc9c7534-48b5-4a4f-a534-267f33544210-machine-approver-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:01.227359 master-0 kubenswrapper[8678]: I1204 00:35:01.227355 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-knbh9\" (UniqueName: \"kubernetes.io/projected/fc9c7534-48b5-4a4f-a534-267f33544210-kube-api-access-knbh9\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:01.227359 master-0 kubenswrapper[8678]: I1204 00:35:01.227367 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc9c7534-48b5-4a4f-a534-267f33544210-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:01.363613 master-0 kubenswrapper[8678]: I1204 00:35:01.363535 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6"] Dec 04 00:35:01.365647 master-0 kubenswrapper[8678]: I1204 00:35:01.365613 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cluster-machine-approver/machine-approver-5775bfbf6d-xq2l6"] Dec 04 00:35:02.856341 master-0 kubenswrapper[8678]: I1204 00:35:02.856277 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" path="/var/lib/kubelet/pods/fc9c7534-48b5-4a4f-a534-267f33544210/volumes" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.865699 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/machine-api-operator-7486ff55f-tnhrb"] Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866055 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866075 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866086 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="machine-approver-controller" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866095 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="machine-approver-controller" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866113 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866122 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866143 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866152 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866164 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866172 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerName="extract-utilities" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866185 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="463d57da-a6b6-40a7-b55b-90b5a187aed4" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866194 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="463d57da-a6b6-40a7-b55b-90b5a187aed4" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866205 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="kube-rbac-proxy" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866214 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="kube-rbac-proxy" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866231 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="589ef02a-5447-43d6-8758-67916768cb54" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866242 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="589ef02a-5447-43d6-8758-67916768cb54" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866253 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7289ceb2-9c01-4216-85c4-8e829f8914e0" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866264 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7289ceb2-9c01-4216-85c4-8e829f8914e0" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866277 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866285 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866296 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866331 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866343 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866353 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866363 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: I1204 00:35:03.866375 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerName="extract-content" Dec 04 00:35:03.866274 master-0 kubenswrapper[8678]: E1204 00:35:03.866387 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866396 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: E1204 00:35:03.866409 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" containerName="extract-utilities" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866419 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" containerName="extract-utilities" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866536 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="463d57da-a6b6-40a7-b55b-90b5a187aed4" containerName="installer" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866552 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="machine-approver-controller" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866569 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc9c7534-48b5-4a4f-a534-267f33544210" containerName="kube-rbac-proxy" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866579 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="41f0ae0a-011e-4a4d-8fb6-773afb62f04d" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866588 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866597 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="27c42a3f-b337-4726-b1db-27a3e2092dde" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866608 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866618 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7289ceb2-9c01-4216-85c4-8e829f8914e0" containerName="installer" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866628 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="1568fd73-c51d-43c5-82d0-d938ecdf698f" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866642 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="701d4ae9-e905-497b-96a5-0547eaee4073" containerName="extract-content" Dec 04 00:35:03.868631 master-0 kubenswrapper[8678]: I1204 00:35:03.866654 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="589ef02a-5447-43d6-8758-67916768cb54" containerName="installer" Dec 04 00:35:03.881490 master-0 kubenswrapper[8678]: I1204 00:35:03.881392 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8"] Dec 04 00:35:03.882792 master-0 kubenswrapper[8678]: I1204 00:35:03.882629 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:03.883994 master-0 kubenswrapper[8678]: I1204 00:35:03.883251 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:03.887092 master-0 kubenswrapper[8678]: I1204 00:35:03.884969 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-rjr9s" Dec 04 00:35:03.894965 master-0 kubenswrapper[8678]: I1204 00:35:03.887804 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 00:35:03.894965 master-0 kubenswrapper[8678]: I1204 00:35:03.888239 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 00:35:03.894965 master-0 kubenswrapper[8678]: I1204 00:35:03.888294 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-dockercfg-868vg" Dec 04 00:35:03.894965 master-0 kubenswrapper[8678]: I1204 00:35:03.889053 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 00:35:03.898809 master-0 kubenswrapper[8678]: I1204 00:35:03.897676 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 00:35:03.903961 master-0 kubenswrapper[8678]: I1204 00:35:03.903585 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84"] Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.904458 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl"] Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.904688 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.905392 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.905704 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.905798 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.907118 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs"] Dec 04 00:35:03.909972 master-0 kubenswrapper[8678]: I1204 00:35:03.908664 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:03.910669 master-0 kubenswrapper[8678]: I1204 00:35:03.910634 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 00:35:03.910847 master-0 kubenswrapper[8678]: I1204 00:35:03.910811 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx"] Dec 04 00:35:03.910895 master-0 kubenswrapper[8678]: I1204 00:35:03.910876 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 00:35:03.911208 master-0 kubenswrapper[8678]: I1204 00:35:03.911186 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:35:03.911343 master-0 kubenswrapper[8678]: I1204 00:35:03.911323 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 00:35:03.911459 master-0 kubenswrapper[8678]: I1204 00:35:03.911440 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 00:35:03.911608 master-0 kubenswrapper[8678]: I1204 00:35:03.911588 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 00:35:03.911733 master-0 kubenswrapper[8678]: I1204 00:35:03.911713 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 00:35:03.911835 master-0 kubenswrapper[8678]: I1204 00:35:03.911822 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-8qsb6" Dec 04 00:35:03.911878 master-0 kubenswrapper[8678]: I1204 00:35:03.911848 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:03.911986 master-0 kubenswrapper[8678]: I1204 00:35:03.911972 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:35:03.912040 master-0 kubenswrapper[8678]: I1204 00:35:03.912004 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24"] Dec 04 00:35:03.912086 master-0 kubenswrapper[8678]: I1204 00:35:03.912072 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-cmtsx" Dec 04 00:35:03.912194 master-0 kubenswrapper[8678]: I1204 00:35:03.912181 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 00:35:03.912360 master-0 kubenswrapper[8678]: I1204 00:35:03.912325 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 00:35:03.912407 master-0 kubenswrapper[8678]: I1204 00:35:03.912375 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-p78gv" Dec 04 00:35:03.913240 master-0 kubenswrapper[8678]: I1204 00:35:03.913203 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:03.913240 master-0 kubenswrapper[8678]: I1204 00:35:03.913228 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 00:35:03.913797 master-0 kubenswrapper[8678]: I1204 00:35:03.913773 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 00:35:03.913978 master-0 kubenswrapper[8678]: I1204 00:35:03.913943 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 00:35:03.915328 master-0 kubenswrapper[8678]: I1204 00:35:03.915303 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 00:35:03.916403 master-0 kubenswrapper[8678]: I1204 00:35:03.916385 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 00:35:03.916954 master-0 kubenswrapper[8678]: I1204 00:35:03.916939 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 00:35:03.917023 master-0 kubenswrapper[8678]: I1204 00:35:03.916966 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-mfl95" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.917482 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.917949 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl"] Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918053 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918194 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918673 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918796 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918897 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 00:35:03.920107 master-0 kubenswrapper[8678]: I1204 00:35:03.918974 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:03.920826 master-0 kubenswrapper[8678]: I1204 00:35:03.920788 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 00:35:03.921032 master-0 kubenswrapper[8678]: I1204 00:35:03.920954 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-dnxpd" Dec 04 00:35:03.921129 master-0 kubenswrapper[8678]: I1204 00:35:03.921106 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-dockercfg-pzz8t" Dec 04 00:35:03.924988 master-0 kubenswrapper[8678]: I1204 00:35:03.924896 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-59d99f9b7b-jl84b"] Dec 04 00:35:03.926437 master-0 kubenswrapper[8678]: I1204 00:35:03.926305 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:03.929650 master-0 kubenswrapper[8678]: I1204 00:35:03.929496 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 00:35:03.931423 master-0 kubenswrapper[8678]: I1204 00:35:03.929809 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 00:35:03.931423 master-0 kubenswrapper[8678]: I1204 00:35:03.930159 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 00:35:03.931423 master-0 kubenswrapper[8678]: I1204 00:35:03.930208 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 00:35:03.931423 master-0 kubenswrapper[8678]: I1204 00:35:03.930279 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 00:35:03.931423 master-0 kubenswrapper[8678]: I1204 00:35:03.930292 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-gvp2m" Dec 04 00:35:03.934296 master-0 kubenswrapper[8678]: I1204 00:35:03.934232 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q"] Dec 04 00:35:03.935907 master-0 kubenswrapper[8678]: I1204 00:35:03.935592 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:03.937484 master-0 kubenswrapper[8678]: I1204 00:35:03.937448 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-hkhgp" Dec 04 00:35:03.939187 master-0 kubenswrapper[8678]: I1204 00:35:03.938018 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 00:35:03.939187 master-0 kubenswrapper[8678]: I1204 00:35:03.939087 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q"] Dec 04 00:35:03.941414 master-0 kubenswrapper[8678]: I1204 00:35:03.941380 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:03.943728 master-0 kubenswrapper[8678]: I1204 00:35:03.943670 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 00:35:03.944057 master-0 kubenswrapper[8678]: I1204 00:35:03.944017 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 00:35:03.944165 master-0 kubenswrapper[8678]: I1204 00:35:03.944014 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"cluster-samples-operator-dockercfg-rmj52" Dec 04 00:35:03.944165 master-0 kubenswrapper[8678]: I1204 00:35:03.944111 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 00:35:03.951573 master-0 kubenswrapper[8678]: I1204 00:35:03.951531 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-59d99f9b7b-jl84b"] Dec 04 00:35:03.954136 master-0 kubenswrapper[8678]: I1204 00:35:03.954074 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84"] Dec 04 00:35:03.978033 master-0 kubenswrapper[8678]: I1204 00:35:03.975005 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx"] Dec 04 00:35:03.992213 master-0 kubenswrapper[8678]: I1204 00:35:03.992155 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:03.992427 master-0 kubenswrapper[8678]: I1204 00:35:03.992253 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56gxb\" (UniqueName: \"kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:03.992427 master-0 kubenswrapper[8678]: I1204 00:35:03.992287 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:03.992427 master-0 kubenswrapper[8678]: I1204 00:35:03.992317 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg7nz\" (UniqueName: \"kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:03.992427 master-0 kubenswrapper[8678]: I1204 00:35:03.992356 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:03.992427 master-0 kubenswrapper[8678]: I1204 00:35:03.992380 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:03.992572 master-0 kubenswrapper[8678]: I1204 00:35:03.992432 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:03.994715 master-0 kubenswrapper[8678]: I1204 00:35:03.994685 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs"] Dec 04 00:35:03.997324 master-0 kubenswrapper[8678]: I1204 00:35:03.997291 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8"] Dec 04 00:35:04.012997 master-0 kubenswrapper[8678]: I1204 00:35:04.012848 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-7486ff55f-tnhrb"] Dec 04 00:35:04.014104 master-0 kubenswrapper[8678]: I1204 00:35:04.014069 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q"] Dec 04 00:35:04.016000 master-0 kubenswrapper[8678]: I1204 00:35:04.015981 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q"] Dec 04 00:35:04.030513 master-0 kubenswrapper[8678]: I1204 00:35:04.030458 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl"] Dec 04 00:35:04.093404 master-0 kubenswrapper[8678]: I1204 00:35:04.093348 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.093404 master-0 kubenswrapper[8678]: I1204 00:35:04.093396 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.093404 master-0 kubenswrapper[8678]: I1204 00:35:04.093421 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv8dv\" (UniqueName: \"kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093441 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093462 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093484 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093504 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093525 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfcxz\" (UniqueName: \"kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.093810 master-0 kubenswrapper[8678]: I1204 00:35:04.093707 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.093946 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.093997 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094041 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094085 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094125 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vtf\" (UniqueName: \"kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094142 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6tj6\" (UniqueName: \"kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094162 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.094170 master-0 kubenswrapper[8678]: I1204 00:35:04.094180 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094200 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58w7s\" (UniqueName: \"kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094232 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094266 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094288 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-56gxb\" (UniqueName: \"kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094307 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094324 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094343 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094347 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094392 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094414 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094464 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094496 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094520 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094568 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7nz\" (UniqueName: \"kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.094654 master-0 kubenswrapper[8678]: I1204 00:35:04.094654 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094756 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdwv\" (UniqueName: \"kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094824 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094852 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094883 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8559\" (UniqueName: \"kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094917 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.094981 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76wg7\" (UniqueName: \"kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.095017 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.095047 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.095069 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wd8t\" (UniqueName: \"kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.095103 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.095547 master-0 kubenswrapper[8678]: I1204 00:35:04.095266 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.096707 master-0 kubenswrapper[8678]: I1204 00:35:04.096646 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.096800 master-0 kubenswrapper[8678]: I1204 00:35:04.096781 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.099899 master-0 kubenswrapper[8678]: I1204 00:35:04.099857 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.115000 master-0 kubenswrapper[8678]: I1204 00:35:04.114190 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gxb\" (UniqueName: \"kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.115214 master-0 kubenswrapper[8678]: I1204 00:35:04.115198 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7nz\" (UniqueName: \"kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.196040 master-0 kubenswrapper[8678]: I1204 00:35:04.196000 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.196040 master-0 kubenswrapper[8678]: I1204 00:35:04.196050 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196076 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196103 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vtf\" (UniqueName: \"kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196124 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6tj6\" (UniqueName: \"kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196142 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196159 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196176 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58w7s\" (UniqueName: \"kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196192 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.196213 master-0 kubenswrapper[8678]: I1204 00:35:04.196213 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196230 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196246 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196260 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196275 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196291 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196313 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196329 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196346 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196364 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdwv\" (UniqueName: \"kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196380 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196394 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196409 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8559\" (UniqueName: \"kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.196439 master-0 kubenswrapper[8678]: I1204 00:35:04.196427 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196448 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76wg7\" (UniqueName: \"kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196467 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196483 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196500 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4wd8t\" (UniqueName: \"kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196522 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196542 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pv8dv\" (UniqueName: \"kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196560 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196580 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196599 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196613 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.196860 master-0 kubenswrapper[8678]: I1204 00:35:04.196629 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cfcxz\" (UniqueName: \"kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.197519 master-0 kubenswrapper[8678]: I1204 00:35:04.197484 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.199882 master-0 kubenswrapper[8678]: I1204 00:35:04.199830 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.200074 master-0 kubenswrapper[8678]: I1204 00:35:04.200043 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.201078 master-0 kubenswrapper[8678]: I1204 00:35:04.201043 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.201611 master-0 kubenswrapper[8678]: I1204 00:35:04.201556 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.201710 master-0 kubenswrapper[8678]: I1204 00:35:04.201631 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.201867 master-0 kubenswrapper[8678]: I1204 00:35:04.201843 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.202765 master-0 kubenswrapper[8678]: I1204 00:35:04.202733 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.202839 master-0 kubenswrapper[8678]: I1204 00:35:04.202737 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.202976 master-0 kubenswrapper[8678]: I1204 00:35:04.202900 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.203988 master-0 kubenswrapper[8678]: I1204 00:35:04.203839 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.204119 master-0 kubenswrapper[8678]: I1204 00:35:04.203865 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.204473 master-0 kubenswrapper[8678]: I1204 00:35:04.204439 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.204951 master-0 kubenswrapper[8678]: I1204 00:35:04.204907 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.205227 master-0 kubenswrapper[8678]: I1204 00:35:04.205197 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.206599 master-0 kubenswrapper[8678]: I1204 00:35:04.206446 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.206750 master-0 kubenswrapper[8678]: I1204 00:35:04.206661 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.206808 master-0 kubenswrapper[8678]: I1204 00:35:04.206764 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.207875 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.212790 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.213311 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.214635 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.215710 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.217962 master-0 kubenswrapper[8678]: I1204 00:35:04.215532 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.218235 master-0 kubenswrapper[8678]: I1204 00:35:04.218102 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wd8t\" (UniqueName: \"kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t\") pod \"cluster-cloud-controller-manager-operator-76f56467d7-qhssl\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.218334 master-0 kubenswrapper[8678]: I1204 00:35:04.218248 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.219944 master-0 kubenswrapper[8678]: I1204 00:35:04.219836 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfcxz\" (UniqueName: \"kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.220095 master-0 kubenswrapper[8678]: I1204 00:35:04.220059 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wg7\" (UniqueName: \"kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.220845 master-0 kubenswrapper[8678]: I1204 00:35:04.220813 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8559\" (UniqueName: \"kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.221294 master-0 kubenswrapper[8678]: I1204 00:35:04.221062 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdwv\" (UniqueName: \"kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.221879 master-0 kubenswrapper[8678]: I1204 00:35:04.221843 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vtf\" (UniqueName: \"kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.223500 master-0 kubenswrapper[8678]: I1204 00:35:04.222689 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58w7s\" (UniqueName: \"kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.229204 master-0 kubenswrapper[8678]: I1204 00:35:04.229163 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6tj6\" (UniqueName: \"kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.233963 master-0 kubenswrapper[8678]: I1204 00:35:04.233891 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:35:04.239101 master-0 kubenswrapper[8678]: I1204 00:35:04.239053 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv8dv\" (UniqueName: \"kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.245432 master-0 kubenswrapper[8678]: I1204 00:35:04.245389 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:35:04.292827 master-0 kubenswrapper[8678]: I1204 00:35:04.291878 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:04.341307 master-0 kubenswrapper[8678]: I1204 00:35:04.341256 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:35:04.361520 master-0 kubenswrapper[8678]: I1204 00:35:04.361454 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:35:04.382722 master-0 kubenswrapper[8678]: I1204 00:35:04.382661 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:35:04.393585 master-0 kubenswrapper[8678]: I1204 00:35:04.393514 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:35:04.422791 master-0 kubenswrapper[8678]: W1204 00:35:04.422723 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e34e8d_fd5e_4d7b_81f4_3ad911b3dedb.slice/crio-1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a WatchSource:0}: Error finding container 1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a: Status 404 returned error can't find the container with id 1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a Dec 04 00:35:04.438949 master-0 kubenswrapper[8678]: I1204 00:35:04.438867 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:35:04.461376 master-0 kubenswrapper[8678]: I1204 00:35:04.461331 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:35:04.475836 master-0 kubenswrapper[8678]: I1204 00:35:04.475504 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:04.492735 master-0 kubenswrapper[8678]: I1204 00:35:04.492680 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:35:04.659768 master-0 kubenswrapper[8678]: I1204 00:35:04.659705 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-7486ff55f-tnhrb"] Dec 04 00:35:04.672716 master-0 kubenswrapper[8678]: W1204 00:35:04.672539 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode852069a_82f1_4121_9d86_277b8ca07370.slice/crio-4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78 WatchSource:0}: Error finding container 4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78: Status 404 returned error can't find the container with id 4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78 Dec 04 00:35:04.717571 master-0 kubenswrapper[8678]: I1204 00:35:04.714338 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8"] Dec 04 00:35:04.788657 master-0 kubenswrapper[8678]: I1204 00:35:04.788608 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84"] Dec 04 00:35:04.799763 master-0 kubenswrapper[8678]: W1204 00:35:04.799724 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c52add_1fdc_4227_b1b1_76f3653e3fb0.slice/crio-2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e WatchSource:0}: Error finding container 2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e: Status 404 returned error can't find the container with id 2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e Dec 04 00:35:04.863444 master-0 kubenswrapper[8678]: I1204 00:35:04.863415 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs"] Dec 04 00:35:04.863556 master-0 kubenswrapper[8678]: I1204 00:35:04.863545 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx"] Dec 04 00:35:04.999277 master-0 kubenswrapper[8678]: I1204 00:35:04.999225 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q"] Dec 04 00:35:05.014524 master-0 kubenswrapper[8678]: I1204 00:35:05.013415 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-59d99f9b7b-jl84b"] Dec 04 00:35:05.022198 master-0 kubenswrapper[8678]: I1204 00:35:05.022154 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q"] Dec 04 00:35:05.038005 master-0 kubenswrapper[8678]: I1204 00:35:05.037966 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl"] Dec 04 00:35:05.054185 master-0 kubenswrapper[8678]: I1204 00:35:05.054125 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" event={"ID":"e852069a-82f1-4121-9d86-277b8ca07370","Type":"ContainerStarted","Data":"c2186af104217ae8ff7efa317ed21f9039d889a8b20a8c1dde2955dace5e108f"} Dec 04 00:35:05.054278 master-0 kubenswrapper[8678]: I1204 00:35:05.054200 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" event={"ID":"e852069a-82f1-4121-9d86-277b8ca07370","Type":"ContainerStarted","Data":"4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78"} Dec 04 00:35:05.057508 master-0 kubenswrapper[8678]: I1204 00:35:05.057485 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" event={"ID":"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1","Type":"ContainerStarted","Data":"7f08377e1a18f4116b78ab709398cf6597d11d2f81c0aa15dc9f3bd098622696"} Dec 04 00:35:05.057597 master-0 kubenswrapper[8678]: I1204 00:35:05.057513 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" event={"ID":"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1","Type":"ContainerStarted","Data":"5e77c62a2273f76fc1c8f39342ac07511df3a8595262b77b7ecf8729a4463d81"} Dec 04 00:35:05.059388 master-0 kubenswrapper[8678]: I1204 00:35:05.059053 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerStarted","Data":"2f4f54d5ad66bc601aa47b820f5f56de23be67fce7f68fa5d0459de48c402adf"} Dec 04 00:35:05.063217 master-0 kubenswrapper[8678]: I1204 00:35:05.060302 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerStarted","Data":"4b85650970d13e0eaa60992e9aecaaeb5440711d6216154b4b078601628c8c28"} Dec 04 00:35:05.063217 master-0 kubenswrapper[8678]: I1204 00:35:05.062493 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" event={"ID":"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb","Type":"ContainerStarted","Data":"74dc0ef48d8fe1939f3624a82b33b96968f437acd029a208849d167b8818221f"} Dec 04 00:35:05.063217 master-0 kubenswrapper[8678]: I1204 00:35:05.062540 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" event={"ID":"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb","Type":"ContainerStarted","Data":"81cad02b11b4d95e55ba4c828f4386fb00387ee0d3613ec94bd4bb4c1a9dc17e"} Dec 04 00:35:05.063217 master-0 kubenswrapper[8678]: I1204 00:35:05.062551 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" event={"ID":"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb","Type":"ContainerStarted","Data":"1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a"} Dec 04 00:35:05.065226 master-0 kubenswrapper[8678]: I1204 00:35:05.065195 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" event={"ID":"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c","Type":"ContainerStarted","Data":"f192f85af4cbdeff0073384888cdf9db08a401d3269e978db43452b2b4dfc4b2"} Dec 04 00:35:05.066566 master-0 kubenswrapper[8678]: I1204 00:35:05.066532 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" event={"ID":"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96","Type":"ContainerStarted","Data":"ab43d67160230d77d5752e65115f3ed1e82e1c4d954888ff7c5adb368f621f9b"} Dec 04 00:35:05.066566 master-0 kubenswrapper[8678]: I1204 00:35:05.066560 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" event={"ID":"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96","Type":"ContainerStarted","Data":"96f9ea3b5bc4d360e73058baf8b809abcaa5af378d5ddb713a2a0d58b0fd9a1f"} Dec 04 00:35:05.068070 master-0 kubenswrapper[8678]: I1204 00:35:05.068038 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" event={"ID":"87c52add-1fdc-4227-b1b1-76f3653e3fb0","Type":"ContainerStarted","Data":"901cafaddfb48ad12a48e90f2d27e69834e9c9300ce76bcf5ec911ddb71f0294"} Dec 04 00:35:05.068070 master-0 kubenswrapper[8678]: I1204 00:35:05.068066 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" event={"ID":"87c52add-1fdc-4227-b1b1-76f3653e3fb0","Type":"ContainerStarted","Data":"2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e"} Dec 04 00:35:05.069821 master-0 kubenswrapper[8678]: I1204 00:35:05.069779 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" event={"ID":"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8","Type":"ContainerStarted","Data":"3e0105457378e7432c177589892734a13bb9dfef188b04685e76db7bf4f09429"} Dec 04 00:35:05.088434 master-0 kubenswrapper[8678]: I1204 00:35:05.088367 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" podStartSLOduration=4.088348158 podStartE2EDuration="4.088348158s" podCreationTimestamp="2025-12-04 00:35:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:05.087521304 +0000 UTC m=+288.414253870" watchObservedRunningTime="2025-12-04 00:35:05.088348158 +0000 UTC m=+288.415080714" Dec 04 00:35:06.092037 master-0 kubenswrapper[8678]: I1204 00:35:06.089889 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" event={"ID":"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16","Type":"ContainerStarted","Data":"4c88563b57a2b2f50e432a799c6dad94f7e66dc14230becc3dfc6c5396080ec0"} Dec 04 00:35:06.092037 master-0 kubenswrapper[8678]: I1204 00:35:06.091806 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" event={"ID":"95141f9b-b6b0-40dc-a6e2-b5c84d24caac","Type":"ContainerStarted","Data":"9da438f00be81852193cf6977b4578eadeb8e58d253dc4eeb7ed8920cb7c25d8"} Dec 04 00:35:06.096573 master-0 kubenswrapper[8678]: I1204 00:35:06.096131 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" event={"ID":"87c52add-1fdc-4227-b1b1-76f3653e3fb0","Type":"ContainerStarted","Data":"44891697faa77b126e02b3978a0311d64163e17e23995a1d611d260e63656a54"} Dec 04 00:35:06.101124 master-0 kubenswrapper[8678]: I1204 00:35:06.101076 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" event={"ID":"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8","Type":"ContainerStarted","Data":"fa0959a034b9ca8e1a2149844df49d63a7575293632a288e15c521620f030bbe"} Dec 04 00:35:06.101351 master-0 kubenswrapper[8678]: I1204 00:35:06.101335 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:06.114667 master-0 kubenswrapper[8678]: I1204 00:35:06.108115 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:35:06.122103 master-0 kubenswrapper[8678]: I1204 00:35:06.121795 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" podStartSLOduration=4.121773704 podStartE2EDuration="4.121773704s" podCreationTimestamp="2025-12-04 00:35:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:06.120810256 +0000 UTC m=+289.447542832" watchObservedRunningTime="2025-12-04 00:35:06.121773704 +0000 UTC m=+289.448506260" Dec 04 00:35:06.899216 master-0 kubenswrapper[8678]: I1204 00:35:06.899138 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" podStartSLOduration=3.899120542 podStartE2EDuration="3.899120542s" podCreationTimestamp="2025-12-04 00:35:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:06.150816294 +0000 UTC m=+289.477548850" watchObservedRunningTime="2025-12-04 00:35:06.899120542 +0000 UTC m=+290.225853098" Dec 04 00:35:08.106058 master-0 kubenswrapper[8678]: I1204 00:35:08.105999 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:35:08.106664 master-0 kubenswrapper[8678]: I1204 00:35:08.106249 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-scheduler-master-0" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" containerID="cri-o://4aff4c8c2a743025b7aa9d20fc797e5f60c554bd1c109adee5ee7fd129880d47" gracePeriod=30 Dec 04 00:35:08.107505 master-0 kubenswrapper[8678]: I1204 00:35:08.107420 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:35:08.107797 master-0 kubenswrapper[8678]: E1204 00:35:08.107774 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.107797 master-0 kubenswrapper[8678]: I1204 00:35:08.107796 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.108005 master-0 kubenswrapper[8678]: I1204 00:35:08.107900 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.108078 master-0 kubenswrapper[8678]: E1204 00:35:08.108041 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.108078 master-0 kubenswrapper[8678]: I1204 00:35:08.108051 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.108219 master-0 kubenswrapper[8678]: I1204 00:35:08.108171 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="d78739a7694769882b7e47ea5ac08a10" containerName="kube-scheduler" Dec 04 00:35:08.109383 master-0 kubenswrapper[8678]: I1204 00:35:08.109105 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.143848 master-0 kubenswrapper[8678]: I1204 00:35:08.143793 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:35:08.185286 master-0 kubenswrapper[8678]: I1204 00:35:08.180524 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.185286 master-0 kubenswrapper[8678]: I1204 00:35:08.180649 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.281958 master-0 kubenswrapper[8678]: I1204 00:35:08.281889 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.284048 master-0 kubenswrapper[8678]: I1204 00:35:08.283780 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.284138 master-0 kubenswrapper[8678]: I1204 00:35:08.284045 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.284674 master-0 kubenswrapper[8678]: I1204 00:35:08.284537 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:08.442627 master-0 kubenswrapper[8678]: I1204 00:35:08.442481 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:09.148529 master-0 kubenswrapper[8678]: I1204 00:35:09.144086 8678 generic.go:334] "Generic (PLEG): container finished" podID="d78739a7694769882b7e47ea5ac08a10" containerID="4aff4c8c2a743025b7aa9d20fc797e5f60c554bd1c109adee5ee7fd129880d47" exitCode=0 Dec 04 00:35:09.148529 master-0 kubenswrapper[8678]: I1204 00:35:09.144189 8678 scope.go:117] "RemoveContainer" containerID="c98b01b382832bebdf169fc61718cb69753195c97984b9e58e2cbb2cbae87c48" Dec 04 00:35:09.148529 master-0 kubenswrapper[8678]: I1204 00:35:09.145878 8678 generic.go:334] "Generic (PLEG): container finished" podID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerID="370746cda174b3297e4978d445bd103ac2f5c5a7f9f05309706d5946410e739f" exitCode=0 Dec 04 00:35:09.148529 master-0 kubenswrapper[8678]: I1204 00:35:09.145901 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"6b42d014-19a2-4c88-abd6-74b9191d6d16","Type":"ContainerDied","Data":"370746cda174b3297e4978d445bd103ac2f5c5a7f9f05309706d5946410e739f"} Dec 04 00:35:09.605625 master-0 kubenswrapper[8678]: I1204 00:35:09.605562 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 00:35:09.606007 master-0 kubenswrapper[8678]: I1204 00:35:09.605967 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="cluster-policy-controller" containerID="cri-o://dc41179c1a580bee9c34b2c3240d03c90cf58b6d028827131798a90b8fc42f51" gracePeriod=30 Dec 04 00:35:09.606167 master-0 kubenswrapper[8678]: I1204 00:35:09.606095 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" containerID="cri-o://85679bb689d574e7e094084d2cb2e8502ce40e08877635f8db2cd08bbde5c799" gracePeriod=30 Dec 04 00:35:09.606733 master-0 kubenswrapper[8678]: I1204 00:35:09.606705 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:35:09.607028 master-0 kubenswrapper[8678]: E1204 00:35:09.607007 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: I1204 00:35:09.607029 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: E1204 00:35:09.607046 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: I1204 00:35:09.607058 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: E1204 00:35:09.607067 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: I1204 00:35:09.607074 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607097 master-0 kubenswrapper[8678]: E1204 00:35:09.607097 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="cluster-policy-controller" Dec 04 00:35:09.607343 master-0 kubenswrapper[8678]: I1204 00:35:09.607104 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="cluster-policy-controller" Dec 04 00:35:09.607343 master-0 kubenswrapper[8678]: I1204 00:35:09.607231 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607343 master-0 kubenswrapper[8678]: I1204 00:35:09.607245 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607343 master-0 kubenswrapper[8678]: I1204 00:35:09.607267 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="cluster-policy-controller" Dec 04 00:35:09.607498 master-0 kubenswrapper[8678]: E1204 00:35:09.607396 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607498 master-0 kubenswrapper[8678]: I1204 00:35:09.607409 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.607684 master-0 kubenswrapper[8678]: I1204 00:35:09.607521 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.608024 master-0 kubenswrapper[8678]: I1204 00:35:09.607802 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bce50c457ac1f4721bc81a570dd238a" containerName="kube-controller-manager" Dec 04 00:35:09.609237 master-0 kubenswrapper[8678]: I1204 00:35:09.608801 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.647014 master-0 kubenswrapper[8678]: I1204 00:35:09.646953 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:35:09.710167 master-0 kubenswrapper[8678]: I1204 00:35:09.710118 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.710401 master-0 kubenswrapper[8678]: I1204 00:35:09.710177 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.811864 master-0 kubenswrapper[8678]: I1204 00:35:09.811785 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.812160 master-0 kubenswrapper[8678]: I1204 00:35:09.811899 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.812160 master-0 kubenswrapper[8678]: I1204 00:35:09.811946 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.812160 master-0 kubenswrapper[8678]: I1204 00:35:09.812035 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:09.942830 master-0 kubenswrapper[8678]: I1204 00:35:09.942718 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:10.152697 master-0 kubenswrapper[8678]: I1204 00:35:10.152646 8678 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="85679bb689d574e7e094084d2cb2e8502ce40e08877635f8db2cd08bbde5c799" exitCode=0 Dec 04 00:35:10.152697 master-0 kubenswrapper[8678]: I1204 00:35:10.152681 8678 generic.go:334] "Generic (PLEG): container finished" podID="7bce50c457ac1f4721bc81a570dd238a" containerID="dc41179c1a580bee9c34b2c3240d03c90cf58b6d028827131798a90b8fc42f51" exitCode=0 Dec 04 00:35:10.154700 master-0 kubenswrapper[8678]: I1204 00:35:10.154675 8678 generic.go:334] "Generic (PLEG): container finished" podID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerID="a4d8df3e3af5b57340a108d211502f9b486e94114c010963789ad8118dc86e5b" exitCode=0 Dec 04 00:35:10.154870 master-0 kubenswrapper[8678]: I1204 00:35:10.154844 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"f80e5d69-5170-49df-b5e9-7991f63fd3dc","Type":"ContainerDied","Data":"a4d8df3e3af5b57340a108d211502f9b486e94114c010963789ad8118dc86e5b"} Dec 04 00:35:10.705598 master-0 kubenswrapper[8678]: I1204 00:35:10.704602 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:35:10.826389 master-0 kubenswrapper[8678]: I1204 00:35:10.826297 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock\") pod \"6b42d014-19a2-4c88-abd6-74b9191d6d16\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " Dec 04 00:35:10.826389 master-0 kubenswrapper[8678]: I1204 00:35:10.826353 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir\") pod \"6b42d014-19a2-4c88-abd6-74b9191d6d16\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " Dec 04 00:35:10.826389 master-0 kubenswrapper[8678]: I1204 00:35:10.826389 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access\") pod \"6b42d014-19a2-4c88-abd6-74b9191d6d16\" (UID: \"6b42d014-19a2-4c88-abd6-74b9191d6d16\") " Dec 04 00:35:10.826783 master-0 kubenswrapper[8678]: I1204 00:35:10.826468 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock" (OuterVolumeSpecName: "var-lock") pod "6b42d014-19a2-4c88-abd6-74b9191d6d16" (UID: "6b42d014-19a2-4c88-abd6-74b9191d6d16"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:10.826783 master-0 kubenswrapper[8678]: I1204 00:35:10.826489 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "6b42d014-19a2-4c88-abd6-74b9191d6d16" (UID: "6b42d014-19a2-4c88-abd6-74b9191d6d16"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:10.826783 master-0 kubenswrapper[8678]: I1204 00:35:10.826694 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:10.826783 master-0 kubenswrapper[8678]: I1204 00:35:10.826708 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b42d014-19a2-4c88-abd6-74b9191d6d16-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:10.830309 master-0 kubenswrapper[8678]: I1204 00:35:10.830249 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "6b42d014-19a2-4c88-abd6-74b9191d6d16" (UID: "6b42d014-19a2-4c88-abd6-74b9191d6d16"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:35:10.928307 master-0 kubenswrapper[8678]: I1204 00:35:10.928152 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6b42d014-19a2-4c88-abd6-74b9191d6d16-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:11.162235 master-0 kubenswrapper[8678]: I1204 00:35:11.162176 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:35:11.163567 master-0 kubenswrapper[8678]: I1204 00:35:11.162624 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"6b42d014-19a2-4c88-abd6-74b9191d6d16","Type":"ContainerDied","Data":"141db83ebfaa98384885b96b46a0566c73e0126df52aa7b221371a34fa1078d1"} Dec 04 00:35:11.163567 master-0 kubenswrapper[8678]: I1204 00:35:11.162651 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="141db83ebfaa98384885b96b46a0566c73e0126df52aa7b221371a34fa1078d1" Dec 04 00:35:15.994790 master-0 kubenswrapper[8678]: I1204 00:35:15.994750 8678 scope.go:117] "RemoveContainer" containerID="b61315793344ebcd4455235dcd882405194cc9e5d9bb66073a26fedf6f49f28c" Dec 04 00:35:16.010992 master-0 kubenswrapper[8678]: W1204 00:35:16.010946 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46583dca69d50bb12bc004d7ee3300f.slice/crio-73c4321c3184643e78e996b2b24e658f8fd8a31dc0a9de50c928e0b4ae744fae WatchSource:0}: Error finding container 73c4321c3184643e78e996b2b24e658f8fd8a31dc0a9de50c928e0b4ae744fae: Status 404 returned error can't find the container with id 73c4321c3184643e78e996b2b24e658f8fd8a31dc0a9de50c928e0b4ae744fae Dec 04 00:35:16.016186 master-0 kubenswrapper[8678]: W1204 00:35:16.016151 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b999b2e31764aaaf13d451199f7b0e.slice/crio-a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef WatchSource:0}: Error finding container a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef: Status 404 returned error can't find the container with id a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef Dec 04 00:35:16.160986 master-0 kubenswrapper[8678]: I1204 00:35:16.160948 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:35:16.205831 master-0 kubenswrapper[8678]: I1204 00:35:16.205282 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:35:16.224439 master-0 kubenswrapper[8678]: I1204 00:35:16.224358 8678 scope.go:117] "RemoveContainer" containerID="85679bb689d574e7e094084d2cb2e8502ce40e08877635f8db2cd08bbde5c799" Dec 04 00:35:16.225260 master-0 kubenswrapper[8678]: I1204 00:35:16.225057 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 00:35:16.227400 master-0 kubenswrapper[8678]: I1204 00:35:16.227352 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef"} Dec 04 00:35:16.229367 master-0 kubenswrapper[8678]: I1204 00:35:16.229153 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:35:16.232246 master-0 kubenswrapper[8678]: I1204 00:35:16.232196 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:35:16.232503 master-0 kubenswrapper[8678]: I1204 00:35:16.232440 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"f80e5d69-5170-49df-b5e9-7991f63fd3dc","Type":"ContainerDied","Data":"987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f"} Dec 04 00:35:16.232503 master-0 kubenswrapper[8678]: I1204 00:35:16.232522 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f" Dec 04 00:35:16.233772 master-0 kubenswrapper[8678]: I1204 00:35:16.233717 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c46583dca69d50bb12bc004d7ee3300f","Type":"ContainerStarted","Data":"73c4321c3184643e78e996b2b24e658f8fd8a31dc0a9de50c928e0b4ae744fae"} Dec 04 00:35:16.290691 master-0 kubenswrapper[8678]: I1204 00:35:16.290477 8678 scope.go:117] "RemoveContainer" containerID="dc41179c1a580bee9c34b2c3240d03c90cf58b6d028827131798a90b8fc42f51" Dec 04 00:35:16.307600 master-0 kubenswrapper[8678]: I1204 00:35:16.307529 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") pod \"7bce50c457ac1f4721bc81a570dd238a\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " Dec 04 00:35:16.307835 master-0 kubenswrapper[8678]: I1204 00:35:16.307794 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") pod \"7bce50c457ac1f4721bc81a570dd238a\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " Dec 04 00:35:16.307993 master-0 kubenswrapper[8678]: I1204 00:35:16.307951 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock\") pod \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " Dec 04 00:35:16.308149 master-0 kubenswrapper[8678]: I1204 00:35:16.307975 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") pod \"d78739a7694769882b7e47ea5ac08a10\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " Dec 04 00:35:16.308316 master-0 kubenswrapper[8678]: I1204 00:35:16.308243 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") pod \"7bce50c457ac1f4721bc81a570dd238a\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " Dec 04 00:35:16.308553 master-0 kubenswrapper[8678]: I1204 00:35:16.308475 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") pod \"7bce50c457ac1f4721bc81a570dd238a\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " Dec 04 00:35:16.308900 master-0 kubenswrapper[8678]: I1204 00:35:16.308828 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access\") pod \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " Dec 04 00:35:16.308900 master-0 kubenswrapper[8678]: I1204 00:35:16.308855 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") pod \"7bce50c457ac1f4721bc81a570dd238a\" (UID: \"7bce50c457ac1f4721bc81a570dd238a\") " Dec 04 00:35:16.308900 master-0 kubenswrapper[8678]: I1204 00:35:16.308874 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir\") pod \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\" (UID: \"f80e5d69-5170-49df-b5e9-7991f63fd3dc\") " Dec 04 00:35:16.309195 master-0 kubenswrapper[8678]: I1204 00:35:16.309127 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") pod \"d78739a7694769882b7e47ea5ac08a10\" (UID: \"d78739a7694769882b7e47ea5ac08a10\") " Dec 04 00:35:16.309597 master-0 kubenswrapper[8678]: I1204 00:35:16.309503 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host" (OuterVolumeSpecName: "ssl-certs-host") pod "7bce50c457ac1f4721bc81a570dd238a" (UID: "7bce50c457ac1f4721bc81a570dd238a"). InnerVolumeSpecName "ssl-certs-host". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309597 master-0 kubenswrapper[8678]: I1204 00:35:16.309564 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs" (OuterVolumeSpecName: "logs") pod "d78739a7694769882b7e47ea5ac08a10" (UID: "d78739a7694769882b7e47ea5ac08a10"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309565 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs" (OuterVolumeSpecName: "logs") pod "7bce50c457ac1f4721bc81a570dd238a" (UID: "7bce50c457ac1f4721bc81a570dd238a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309572 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "f80e5d69-5170-49df-b5e9-7991f63fd3dc" (UID: "f80e5d69-5170-49df-b5e9-7991f63fd3dc"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309585 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets" (OuterVolumeSpecName: "secrets") pod "d78739a7694769882b7e47ea5ac08a10" (UID: "d78739a7694769882b7e47ea5ac08a10"). InnerVolumeSpecName "secrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309605 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud" (OuterVolumeSpecName: "etc-kubernetes-cloud") pod "7bce50c457ac1f4721bc81a570dd238a" (UID: "7bce50c457ac1f4721bc81a570dd238a"). InnerVolumeSpecName "etc-kubernetes-cloud". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309599 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config" (OuterVolumeSpecName: "config") pod "7bce50c457ac1f4721bc81a570dd238a" (UID: "7bce50c457ac1f4721bc81a570dd238a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309648 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets" (OuterVolumeSpecName: "secrets") pod "7bce50c457ac1f4721bc81a570dd238a" (UID: "7bce50c457ac1f4721bc81a570dd238a"). InnerVolumeSpecName "secrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.309834 master-0 kubenswrapper[8678]: I1204 00:35:16.309626 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock" (OuterVolumeSpecName: "var-lock") pod "f80e5d69-5170-49df-b5e9-7991f63fd3dc" (UID: "f80e5d69-5170-49df-b5e9-7991f63fd3dc"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:16.323816 master-0 kubenswrapper[8678]: I1204 00:35:16.323731 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f80e5d69-5170-49df-b5e9-7991f63fd3dc" (UID: "f80e5d69-5170-49df-b5e9-7991f63fd3dc"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:35:16.329171 master-0 kubenswrapper[8678]: I1204 00:35:16.328943 8678 scope.go:117] "RemoveContainer" containerID="4aff4c8c2a743025b7aa9d20fc797e5f60c554bd1c109adee5ee7fd129880d47" Dec 04 00:35:16.410748 master-0 kubenswrapper[8678]: I1204 00:35:16.410692 8678 reconciler_common.go:293] "Volume detached for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-secrets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410748 master-0 kubenswrapper[8678]: I1204 00:35:16.410740 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410756 8678 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410767 8678 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410779 8678 reconciler_common.go:293] "Volume detached for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-etc-kubernetes-cloud\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410790 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f80e5d69-5170-49df-b5e9-7991f63fd3dc-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410798 8678 reconciler_common.go:293] "Volume detached for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d78739a7694769882b7e47ea5ac08a10-secrets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410806 8678 reconciler_common.go:293] "Volume detached for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-ssl-certs-host\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410813 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7bce50c457ac1f4721bc81a570dd238a-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.410987 master-0 kubenswrapper[8678]: I1204 00:35:16.410821 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f80e5d69-5170-49df-b5e9-7991f63fd3dc-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:16.859486 master-0 kubenswrapper[8678]: I1204 00:35:16.859432 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bce50c457ac1f4721bc81a570dd238a" path="/var/lib/kubelet/pods/7bce50c457ac1f4721bc81a570dd238a/volumes" Dec 04 00:35:16.860030 master-0 kubenswrapper[8678]: I1204 00:35:16.860006 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78739a7694769882b7e47ea5ac08a10" path="/var/lib/kubelet/pods/d78739a7694769882b7e47ea5ac08a10/volumes" Dec 04 00:35:16.860291 master-0 kubenswrapper[8678]: I1204 00:35:16.860270 8678 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-scheduler-master-0" podUID="" Dec 04 00:35:17.258405 master-0 kubenswrapper[8678]: I1204 00:35:17.258342 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 00:35:17.286273 master-0 kubenswrapper[8678]: I1204 00:35:17.286218 8678 generic.go:334] "Generic (PLEG): container finished" podID="c46583dca69d50bb12bc004d7ee3300f" containerID="ea9fbd8571832394f3e37c90fe6b99d7010e72171a50cd3e139481b9591359c3" exitCode=0 Dec 04 00:35:18.904983 master-0 kubenswrapper[8678]: I1204 00:35:18.904890 8678 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="" Dec 04 00:35:19.145268 master-0 kubenswrapper[8678]: I1204 00:35:19.145170 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" podStartSLOduration=216.934743841 podStartE2EDuration="3m48.145140139s" podCreationTimestamp="2025-12-04 00:31:31 +0000 UTC" firstStartedPulling="2025-12-04 00:35:04.852155952 +0000 UTC m=+288.178888508" lastFinishedPulling="2025-12-04 00:35:16.06255225 +0000 UTC m=+299.389284806" observedRunningTime="2025-12-04 00:35:19.129823183 +0000 UTC m=+302.456555749" watchObservedRunningTime="2025-12-04 00:35:19.145140139 +0000 UTC m=+302.471872695" Dec 04 00:35:19.159982 master-0 kubenswrapper[8678]: E1204 00:35:19.155128 8678 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="2.306s" Dec 04 00:35:19.159982 master-0 kubenswrapper[8678]: I1204 00:35:19.155180 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:35:19.159982 master-0 kubenswrapper[8678]: I1204 00:35:19.155201 8678 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-scheduler-master-0" mirrorPodUID="1b970053-0a34-41d0-8b1a-76739bc28376" Dec 04 00:35:19.179618 master-0 kubenswrapper[8678]: I1204 00:35:19.177776 8678 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-scheduler-master-0" podUID="" Dec 04 00:35:19.181246 master-0 kubenswrapper[8678]: I1204 00:35:19.181178 8678 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="" Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190246 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" event={"ID":"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1","Type":"ContainerStarted","Data":"203d3d55a932e733c65d85ece7c4741f4ed6bb58e8d8f085d0b0ad03cd555713"} Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190352 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190373 8678 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-scheduler-master-0" mirrorPodUID="1b970053-0a34-41d0-8b1a-76739bc28376" Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190396 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190408 8678 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="f7df9e21-d71c-4169-b7f9-67d8d8cc083e" Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190420 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerStarted","Data":"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625"} Dec 04 00:35:19.190419 master-0 kubenswrapper[8678]: I1204 00:35:19.190433 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerStarted","Data":"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190447 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190462 8678 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="f7df9e21-d71c-4169-b7f9-67d8d8cc083e" Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190473 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"b039d39a2371ff5e21f7e918ef96ad96800e7537a564d12b8ab0105917d18f76"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190485 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190497 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" event={"ID":"e852069a-82f1-4121-9d86-277b8ca07370","Type":"ContainerStarted","Data":"cac1a420acb28af33b28f244c49fd2673d1e17a48f3b917cbbd4e2767cc69b94"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190514 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" event={"ID":"95141f9b-b6b0-40dc-a6e2-b5c84d24caac","Type":"ContainerStarted","Data":"7cbd376a461c53f9f8504aae5e51bc78d01b3ac68dfe3fd40f099e142c972b78"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190528 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerStarted","Data":"83e7bcddc967bf2c2eafd91521d3530c325cdd62862a76aad33936d18dd1aafd"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190541 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerStarted","Data":"b24ed2d1ef2791d02d0f1079016d82083723bce74954fc72d43fc7f3fff32d76"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190560 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" event={"ID":"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c","Type":"ContainerStarted","Data":"db7526cecc995de9aa47e11712f24f48a0fa6d835e67f6df7e8519e3c2c40c9f"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190637 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" event={"ID":"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96","Type":"ContainerStarted","Data":"0dfd8857ba31b986ea7faa5328c297f0b3c9f0ea5f465d27f87b850465ce0710"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190652 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c46583dca69d50bb12bc004d7ee3300f","Type":"ContainerDied","Data":"ea9fbd8571832394f3e37c90fe6b99d7010e72171a50cd3e139481b9591359c3"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190669 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" event={"ID":"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16","Type":"ContainerStarted","Data":"808adc7cdbac73d6843328f77232f9619971b4b0f989673ad68d075015a3e9f2"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190680 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" event={"ID":"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16","Type":"ContainerStarted","Data":"b126deb9f7eaf98735c8c4b72589c33c5abfc9944727cb2d6eb3734a5b2eba12"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190702 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerStarted","Data":"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019"} Dec 04 00:35:19.190861 master-0 kubenswrapper[8678]: I1204 00:35:19.190713 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} Dec 04 00:35:19.232315 master-0 kubenswrapper[8678]: I1204 00:35:19.228477 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" podStartSLOduration=6.142584298 podStartE2EDuration="17.228457415s" podCreationTimestamp="2025-12-04 00:35:02 +0000 UTC" firstStartedPulling="2025-12-04 00:35:04.867570612 +0000 UTC m=+288.194303158" lastFinishedPulling="2025-12-04 00:35:15.953443679 +0000 UTC m=+299.280176275" observedRunningTime="2025-12-04 00:35:19.22508797 +0000 UTC m=+302.551820526" watchObservedRunningTime="2025-12-04 00:35:19.228457415 +0000 UTC m=+302.555189971" Dec 04 00:35:19.249951 master-0 kubenswrapper[8678]: I1204 00:35:19.245392 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" podStartSLOduration=8.260975536 podStartE2EDuration="19.245373076s" podCreationTimestamp="2025-12-04 00:35:00 +0000 UTC" firstStartedPulling="2025-12-04 00:35:05.032516395 +0000 UTC m=+288.359248951" lastFinishedPulling="2025-12-04 00:35:16.016913935 +0000 UTC m=+299.343646491" observedRunningTime="2025-12-04 00:35:19.244532742 +0000 UTC m=+302.571265308" watchObservedRunningTime="2025-12-04 00:35:19.245373076 +0000 UTC m=+302.572105632" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.297357 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-daemon-dhr5k"] Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: E1204 00:35:19.297663 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.297677 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: E1204 00:35:19.297690 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.297696 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.297823 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.297836 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:35:19.299972 master-0 kubenswrapper[8678]: I1204 00:35:19.298509 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.300360 master-0 kubenswrapper[8678]: I1204 00:35:19.300092 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-xscpn" Dec 04 00:35:19.300360 master-0 kubenswrapper[8678]: I1204 00:35:19.300289 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 00:35:19.320948 master-0 kubenswrapper[8678]: I1204 00:35:19.320071 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" podStartSLOduration=7.312694346 podStartE2EDuration="18.320050117s" podCreationTimestamp="2025-12-04 00:35:01 +0000 UTC" firstStartedPulling="2025-12-04 00:35:04.959857231 +0000 UTC m=+288.286589787" lastFinishedPulling="2025-12-04 00:35:15.967213002 +0000 UTC m=+299.293945558" observedRunningTime="2025-12-04 00:35:19.317976028 +0000 UTC m=+302.644708584" watchObservedRunningTime="2025-12-04 00:35:19.320050117 +0000 UTC m=+302.646782673" Dec 04 00:35:19.366949 master-0 kubenswrapper[8678]: I1204 00:35:19.366768 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsmd\" (UniqueName: \"kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.366949 master-0 kubenswrapper[8678]: I1204 00:35:19.366846 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.366949 master-0 kubenswrapper[8678]: I1204 00:35:19.366868 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.366949 master-0 kubenswrapper[8678]: I1204 00:35:19.366918 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.379340 master-0 kubenswrapper[8678]: I1204 00:35:19.370946 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" podStartSLOduration=8.483536809 podStartE2EDuration="19.370920152s" podCreationTimestamp="2025-12-04 00:35:00 +0000 UTC" firstStartedPulling="2025-12-04 00:35:05.107470697 +0000 UTC m=+288.434203253" lastFinishedPulling="2025-12-04 00:35:15.99485404 +0000 UTC m=+299.321586596" observedRunningTime="2025-12-04 00:35:19.366494997 +0000 UTC m=+302.693227563" watchObservedRunningTime="2025-12-04 00:35:19.370920152 +0000 UTC m=+302.697652708" Dec 04 00:35:19.382940 master-0 kubenswrapper[8678]: I1204 00:35:19.379676 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} Dec 04 00:35:19.394130 master-0 kubenswrapper[8678]: I1204 00:35:19.394059 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c46583dca69d50bb12bc004d7ee3300f","Type":"ContainerStarted","Data":"1300eec5b13e1deefbf3fca03fc706b8741b7b845c75e9d289332ec08965e0c6"} Dec 04 00:35:19.394130 master-0 kubenswrapper[8678]: I1204 00:35:19.394123 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c46583dca69d50bb12bc004d7ee3300f","Type":"ContainerStarted","Data":"e76c5c944117a73ac8803ecb0df1d95186e0d91b8c04b7625cfb1438afafe09e"} Dec 04 00:35:19.394381 master-0 kubenswrapper[8678]: I1204 00:35:19.394183 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" podStartSLOduration=5.171583078 podStartE2EDuration="16.394162722s" podCreationTimestamp="2025-12-04 00:35:03 +0000 UTC" firstStartedPulling="2025-12-04 00:35:04.848279768 +0000 UTC m=+288.175012324" lastFinishedPulling="2025-12-04 00:35:16.070859412 +0000 UTC m=+299.397591968" observedRunningTime="2025-12-04 00:35:19.391026003 +0000 UTC m=+302.717758559" watchObservedRunningTime="2025-12-04 00:35:19.394162722 +0000 UTC m=+302.720895278" Dec 04 00:35:19.427229 master-0 kubenswrapper[8678]: I1204 00:35:19.425464 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" podStartSLOduration=8.477640991 podStartE2EDuration="19.425430841s" podCreationTimestamp="2025-12-04 00:35:00 +0000 UTC" firstStartedPulling="2025-12-04 00:35:05.047087901 +0000 UTC m=+288.373820457" lastFinishedPulling="2025-12-04 00:35:15.994877751 +0000 UTC m=+299.321610307" observedRunningTime="2025-12-04 00:35:19.422491267 +0000 UTC m=+302.749223823" watchObservedRunningTime="2025-12-04 00:35:19.425430841 +0000 UTC m=+302.752163397" Dec 04 00:35:19.468493 master-0 kubenswrapper[8678]: I1204 00:35:19.468441 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsmd\" (UniqueName: \"kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.468575 master-0 kubenswrapper[8678]: I1204 00:35:19.468552 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.468613 master-0 kubenswrapper[8678]: I1204 00:35:19.468593 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.468809 master-0 kubenswrapper[8678]: I1204 00:35:19.468756 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.475032 master-0 kubenswrapper[8678]: I1204 00:35:19.469277 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.475032 master-0 kubenswrapper[8678]: I1204 00:35:19.470319 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.475032 master-0 kubenswrapper[8678]: I1204 00:35:19.473991 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.491028 master-0 kubenswrapper[8678]: I1204 00:35:19.490981 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsmd\" (UniqueName: \"kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.497535 master-0 kubenswrapper[8678]: I1204 00:35:19.497433 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=10.497406185 podStartE2EDuration="10.497406185s" podCreationTimestamp="2025-12-04 00:35:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:19.465211151 +0000 UTC m=+302.791943707" watchObservedRunningTime="2025-12-04 00:35:19.497406185 +0000 UTC m=+302.824138741" Dec 04 00:35:19.500718 master-0 kubenswrapper[8678]: I1204 00:35:19.500337 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" podStartSLOduration=7.889863463 podStartE2EDuration="19.500305508s" podCreationTimestamp="2025-12-04 00:35:00 +0000 UTC" firstStartedPulling="2025-12-04 00:35:04.35722258 +0000 UTC m=+287.683955136" lastFinishedPulling="2025-12-04 00:35:15.967664585 +0000 UTC m=+299.294397181" observedRunningTime="2025-12-04 00:35:19.49547368 +0000 UTC m=+302.822206226" watchObservedRunningTime="2025-12-04 00:35:19.500305508 +0000 UTC m=+302.827038064" Dec 04 00:35:19.668249 master-0 kubenswrapper[8678]: I1204 00:35:19.668203 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:35:19.690944 master-0 kubenswrapper[8678]: W1204 00:35:19.689878 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb98438b_191c_4957_a9d1_8a64520f7f00.slice/crio-90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875 WatchSource:0}: Error finding container 90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875: Status 404 returned error can't find the container with id 90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875 Dec 04 00:35:19.943718 master-0 kubenswrapper[8678]: I1204 00:35:19.943580 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:19.943718 master-0 kubenswrapper[8678]: I1204 00:35:19.943663 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:19.943718 master-0 kubenswrapper[8678]: I1204 00:35:19.943686 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:19.943718 master-0 kubenswrapper[8678]: I1204 00:35:19.943723 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:19.950483 master-0 kubenswrapper[8678]: I1204 00:35:19.950438 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:19.951676 master-0 kubenswrapper[8678]: I1204 00:35:19.951636 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:20.407259 master-0 kubenswrapper[8678]: I1204 00:35:20.407172 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c46583dca69d50bb12bc004d7ee3300f","Type":"ContainerStarted","Data":"48c67116d49ad7cd921e7ddab5b35648b4c4d5a88ba326ed611b27fed4143751"} Dec 04 00:35:20.407537 master-0 kubenswrapper[8678]: I1204 00:35:20.407343 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:35:20.409419 master-0 kubenswrapper[8678]: I1204 00:35:20.409341 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" event={"ID":"fb98438b-191c-4957-a9d1-8a64520f7f00","Type":"ContainerStarted","Data":"f52777a51b2f21073e72a16e11cec6d6774292a9422ee08e780c5cfeb65a3ce5"} Dec 04 00:35:20.409419 master-0 kubenswrapper[8678]: I1204 00:35:20.409404 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" event={"ID":"fb98438b-191c-4957-a9d1-8a64520f7f00","Type":"ContainerStarted","Data":"2c1ff98c7baf9437eb8fdb090ffdc2ac358c77bdac5bd67378549da10db1c112"} Dec 04 00:35:20.409419 master-0 kubenswrapper[8678]: I1204 00:35:20.409422 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" event={"ID":"fb98438b-191c-4957-a9d1-8a64520f7f00","Type":"ContainerStarted","Data":"90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875"} Dec 04 00:35:20.429844 master-0 kubenswrapper[8678]: I1204 00:35:20.429757 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podStartSLOduration=12.4297336 podStartE2EDuration="12.4297336s" podCreationTimestamp="2025-12-04 00:35:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:20.429515334 +0000 UTC m=+303.756247910" watchObservedRunningTime="2025-12-04 00:35:20.4297336 +0000 UTC m=+303.756466166" Dec 04 00:35:20.447622 master-0 kubenswrapper[8678]: I1204 00:35:20.447522 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" podStartSLOduration=12.447499954 podStartE2EDuration="12.447499954s" podCreationTimestamp="2025-12-04 00:35:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:20.446694832 +0000 UTC m=+303.773427398" watchObservedRunningTime="2025-12-04 00:35:20.447499954 +0000 UTC m=+303.774232510" Dec 04 00:35:28.259853 master-0 kubenswrapper[8678]: I1204 00:35:28.259748 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/1.log" Dec 04 00:35:28.467801 master-0 kubenswrapper[8678]: I1204 00:35:28.467717 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/2.log" Dec 04 00:35:28.857645 master-0 kubenswrapper[8678]: I1204 00:35:28.857562 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-87cd489bc-llsfr_4b5c0b0e-6015-473f-b7b8-0e91900cd82d/fix-audit-permissions/0.log" Dec 04 00:35:29.065380 master-0 kubenswrapper[8678]: I1204 00:35:29.065303 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-87cd489bc-llsfr_4b5c0b0e-6015-473f-b7b8-0e91900cd82d/oauth-apiserver/0.log" Dec 04 00:35:29.257431 master-0 kubenswrapper[8678]: I1204 00:35:29.257256 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/1.log" Dec 04 00:35:29.458668 master-0 kubenswrapper[8678]: I1204 00:35:29.458578 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/2.log" Dec 04 00:35:29.657555 master-0 kubenswrapper[8678]: I1204 00:35:29.657484 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/setup/0.log" Dec 04 00:35:29.857703 master-0 kubenswrapper[8678]: I1204 00:35:29.857618 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-ensure-env-vars/0.log" Dec 04 00:35:29.951171 master-0 kubenswrapper[8678]: I1204 00:35:29.950986 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:29.953417 master-0 kubenswrapper[8678]: I1204 00:35:29.953370 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:35:30.059226 master-0 kubenswrapper[8678]: I1204 00:35:30.059133 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-resources-copy/0.log" Dec 04 00:35:30.258307 master-0 kubenswrapper[8678]: I1204 00:35:30.258143 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcdctl/0.log" Dec 04 00:35:30.467125 master-0 kubenswrapper[8678]: I1204 00:35:30.467013 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd/0.log" Dec 04 00:35:30.662989 master-0 kubenswrapper[8678]: I1204 00:35:30.662893 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-metrics/0.log" Dec 04 00:35:30.859318 master-0 kubenswrapper[8678]: I1204 00:35:30.859112 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-readyz/0.log" Dec 04 00:35:31.057823 master-0 kubenswrapper[8678]: I1204 00:35:31.057721 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-rev/0.log" Dec 04 00:35:31.264775 master-0 kubenswrapper[8678]: I1204 00:35:31.264704 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-1-master-0_af25c964-8d39-457a-9214-6cadfecf3943/installer/0.log" Dec 04 00:35:31.465766 master-0 kubenswrapper[8678]: I1204 00:35:31.465705 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-5b557b5f57-z9mw6_f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/kube-apiserver-operator/0.log" Dec 04 00:35:31.660559 master-0 kubenswrapper[8678]: I1204 00:35:31.660507 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-5b557b5f57-z9mw6_f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/kube-apiserver-operator/1.log" Dec 04 00:35:31.857898 master-0 kubenswrapper[8678]: I1204 00:35:31.857799 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_bootstrap-kube-apiserver-master-0_13238af3704fe583f617f61e755cf4c2/setup/0.log" Dec 04 00:35:32.065567 master-0 kubenswrapper[8678]: I1204 00:35:32.065392 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_bootstrap-kube-apiserver-master-0_13238af3704fe583f617f61e755cf4c2/kube-apiserver/0.log" Dec 04 00:35:32.257163 master-0 kubenswrapper[8678]: I1204 00:35:32.257033 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_bootstrap-kube-apiserver-master-0_13238af3704fe583f617f61e755cf4c2/kube-apiserver-insecure-readyz/0.log" Dec 04 00:35:32.462259 master-0 kubenswrapper[8678]: I1204 00:35:32.462190 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 00:35:32.669672 master-0 kubenswrapper[8678]: I1204 00:35:32.669587 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-2-master-0_f80e5d69-5170-49df-b5e9-7991f63fd3dc/installer/0.log" Dec 04 00:35:32.865502 master-0 kubenswrapper[8678]: I1204 00:35:32.865406 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:35:33.066137 master-0 kubenswrapper[8678]: I1204 00:35:33.065986 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/0.log" Dec 04 00:35:33.259319 master-0 kubenswrapper[8678]: I1204 00:35:33.259239 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:35:33.460208 master-0 kubenswrapper[8678]: I1204 00:35:33.460108 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-recovery-controller/0.log" Dec 04 00:35:33.670276 master-0 kubenswrapper[8678]: I1204 00:35:33.670190 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-b5dddf8f5-2h4wf_ca8eddb5-4600-4058-94d2-5d0308c32613/kube-controller-manager-operator/0.log" Dec 04 00:35:33.860871 master-0 kubenswrapper[8678]: I1204 00:35:33.860766 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-b5dddf8f5-2h4wf_ca8eddb5-4600-4058-94d2-5d0308c32613/kube-controller-manager-operator/1.log" Dec 04 00:35:34.062962 master-0 kubenswrapper[8678]: I1204 00:35:34.062885 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-4-master-0_6b42d014-19a2-4c88-abd6-74b9191d6d16/installer/0.log" Dec 04 00:35:34.259067 master-0 kubenswrapper[8678]: I1204 00:35:34.258844 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/wait-for-host-port/0.log" Dec 04 00:35:34.464512 master-0 kubenswrapper[8678]: I1204 00:35:34.464430 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/kube-scheduler/0.log" Dec 04 00:35:34.657757 master-0 kubenswrapper[8678]: I1204 00:35:34.657685 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/kube-scheduler-cert-syncer/0.log" Dec 04 00:35:34.867050 master-0 kubenswrapper[8678]: I1204 00:35:34.866996 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/kube-scheduler-recovery-controller/0.log" Dec 04 00:35:35.063247 master-0 kubenswrapper[8678]: I1204 00:35:35.063039 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f574c6c79-zbdd7_26273240-2261-4564-bb64-1aaf774a921f/kube-scheduler-operator-container/0.log" Dec 04 00:35:35.117860 master-0 kubenswrapper[8678]: I1204 00:35:35.117771 8678 scope.go:117] "RemoveContainer" containerID="80b056ca713cc669a16b4ed101f0051a28fedc8060007822265803cbfc4e3a86" Dec 04 00:35:35.259367 master-0 kubenswrapper[8678]: I1204 00:35:35.259297 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f574c6c79-zbdd7_26273240-2261-4564-bb64-1aaf774a921f/kube-scheduler-operator-container/1.log" Dec 04 00:35:35.458664 master-0 kubenswrapper[8678]: I1204 00:35:35.458525 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/1.log" Dec 04 00:35:35.669445 master-0 kubenswrapper[8678]: I1204 00:35:35.669334 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/2.log" Dec 04 00:35:35.857140 master-0 kubenswrapper[8678]: I1204 00:35:35.857080 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver_apiserver-56f6ccc758-vsg29_7af17f6f-6bda-4972-a72a-9d9059cd2fa6/fix-audit-permissions/0.log" Dec 04 00:35:36.061141 master-0 kubenswrapper[8678]: I1204 00:35:36.061089 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver_apiserver-56f6ccc758-vsg29_7af17f6f-6bda-4972-a72a-9d9059cd2fa6/openshift-apiserver/0.log" Dec 04 00:35:36.274058 master-0 kubenswrapper[8678]: I1204 00:35:36.271995 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl"] Dec 04 00:35:36.274058 master-0 kubenswrapper[8678]: I1204 00:35:36.272378 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="cluster-cloud-controller-manager" containerID="cri-o://4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" gracePeriod=30 Dec 04 00:35:36.274058 master-0 kubenswrapper[8678]: I1204 00:35:36.272541 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="kube-rbac-proxy" containerID="cri-o://b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" gracePeriod=30 Dec 04 00:35:36.274058 master-0 kubenswrapper[8678]: I1204 00:35:36.272597 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="config-sync-controllers" containerID="cri-o://d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" gracePeriod=30 Dec 04 00:35:36.276595 master-0 kubenswrapper[8678]: I1204 00:35:36.275656 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver_apiserver-56f6ccc758-vsg29_7af17f6f-6bda-4972-a72a-9d9059cd2fa6/openshift-apiserver-check-endpoints/0.log" Dec 04 00:35:36.443616 master-0 kubenswrapper[8678]: I1204 00:35:36.441565 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:36.455541 master-0 kubenswrapper[8678]: I1204 00:35:36.455499 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/1.log" Dec 04 00:35:36.544568 master-0 kubenswrapper[8678]: I1204 00:35:36.544461 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config\") pod \"3806572b-4d73-496c-bf98-e91cb7a1572b\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " Dec 04 00:35:36.544568 master-0 kubenswrapper[8678]: I1204 00:35:36.544546 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images\") pod \"3806572b-4d73-496c-bf98-e91cb7a1572b\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " Dec 04 00:35:36.544782 master-0 kubenswrapper[8678]: I1204 00:35:36.544632 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wd8t\" (UniqueName: \"kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t\") pod \"3806572b-4d73-496c-bf98-e91cb7a1572b\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " Dec 04 00:35:36.544782 master-0 kubenswrapper[8678]: I1204 00:35:36.544659 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls\") pod \"3806572b-4d73-496c-bf98-e91cb7a1572b\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " Dec 04 00:35:36.544782 master-0 kubenswrapper[8678]: I1204 00:35:36.544712 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube\") pod \"3806572b-4d73-496c-bf98-e91cb7a1572b\" (UID: \"3806572b-4d73-496c-bf98-e91cb7a1572b\") " Dec 04 00:35:36.545007 master-0 kubenswrapper[8678]: I1204 00:35:36.544984 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube" (OuterVolumeSpecName: "host-etc-kube") pod "3806572b-4d73-496c-bf98-e91cb7a1572b" (UID: "3806572b-4d73-496c-bf98-e91cb7a1572b"). InnerVolumeSpecName "host-etc-kube". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:35:36.545143 master-0 kubenswrapper[8678]: I1204 00:35:36.545088 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images" (OuterVolumeSpecName: "images") pod "3806572b-4d73-496c-bf98-e91cb7a1572b" (UID: "3806572b-4d73-496c-bf98-e91cb7a1572b"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:35:36.545411 master-0 kubenswrapper[8678]: I1204 00:35:36.545356 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "3806572b-4d73-496c-bf98-e91cb7a1572b" (UID: "3806572b-4d73-496c-bf98-e91cb7a1572b"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:35:36.548147 master-0 kubenswrapper[8678]: I1204 00:35:36.548104 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls" (OuterVolumeSpecName: "cloud-controller-manager-operator-tls") pod "3806572b-4d73-496c-bf98-e91cb7a1572b" (UID: "3806572b-4d73-496c-bf98-e91cb7a1572b"). InnerVolumeSpecName "cloud-controller-manager-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:35:36.548147 master-0 kubenswrapper[8678]: I1204 00:35:36.548121 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t" (OuterVolumeSpecName: "kube-api-access-4wd8t") pod "3806572b-4d73-496c-bf98-e91cb7a1572b" (UID: "3806572b-4d73-496c-bf98-e91cb7a1572b"). InnerVolumeSpecName "kube-api-access-4wd8t". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:35:36.551706 master-0 kubenswrapper[8678]: I1204 00:35:36.551671 8678 generic.go:334] "Generic (PLEG): container finished" podID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" exitCode=0 Dec 04 00:35:36.551706 master-0 kubenswrapper[8678]: I1204 00:35:36.551702 8678 generic.go:334] "Generic (PLEG): container finished" podID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" exitCode=0 Dec 04 00:35:36.551845 master-0 kubenswrapper[8678]: I1204 00:35:36.551715 8678 generic.go:334] "Generic (PLEG): container finished" podID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" exitCode=0 Dec 04 00:35:36.551845 master-0 kubenswrapper[8678]: I1204 00:35:36.551740 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerDied","Data":"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019"} Dec 04 00:35:36.551845 master-0 kubenswrapper[8678]: I1204 00:35:36.551778 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerDied","Data":"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625"} Dec 04 00:35:36.551845 master-0 kubenswrapper[8678]: I1204 00:35:36.551795 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerDied","Data":"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255"} Dec 04 00:35:36.551845 master-0 kubenswrapper[8678]: I1204 00:35:36.551803 8678 scope.go:117] "RemoveContainer" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" Dec 04 00:35:36.552064 master-0 kubenswrapper[8678]: I1204 00:35:36.551808 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" event={"ID":"3806572b-4d73-496c-bf98-e91cb7a1572b","Type":"ContainerDied","Data":"2f4f54d5ad66bc601aa47b820f5f56de23be67fce7f68fa5d0459de48c402adf"} Dec 04 00:35:36.552064 master-0 kubenswrapper[8678]: I1204 00:35:36.551776 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl" Dec 04 00:35:36.585917 master-0 kubenswrapper[8678]: I1204 00:35:36.585844 8678 scope.go:117] "RemoveContainer" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" Dec 04 00:35:36.604484 master-0 kubenswrapper[8678]: I1204 00:35:36.604326 8678 scope.go:117] "RemoveContainer" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" Dec 04 00:35:36.608140 master-0 kubenswrapper[8678]: I1204 00:35:36.608043 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl"] Dec 04 00:35:36.613654 master-0 kubenswrapper[8678]: I1204 00:35:36.613601 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-76f56467d7-qhssl"] Dec 04 00:35:36.622197 master-0 kubenswrapper[8678]: I1204 00:35:36.622154 8678 scope.go:117] "RemoveContainer" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" Dec 04 00:35:36.622917 master-0 kubenswrapper[8678]: E1204 00:35:36.622879 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": container with ID starting with b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019 not found: ID does not exist" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" Dec 04 00:35:36.622917 master-0 kubenswrapper[8678]: I1204 00:35:36.622942 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019"} err="failed to get container status \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": rpc error: code = NotFound desc = could not find container \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": container with ID starting with b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019 not found: ID does not exist" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: I1204 00:35:36.622972 8678 scope.go:117] "RemoveContainer" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: E1204 00:35:36.623529 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": container with ID starting with d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625 not found: ID does not exist" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: I1204 00:35:36.623569 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625"} err="failed to get container status \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": rpc error: code = NotFound desc = could not find container \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": container with ID starting with d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625 not found: ID does not exist" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: I1204 00:35:36.623591 8678 scope.go:117] "RemoveContainer" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: E1204 00:35:36.624004 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": container with ID starting with 4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255 not found: ID does not exist" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: I1204 00:35:36.624032 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255"} err="failed to get container status \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": rpc error: code = NotFound desc = could not find container \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": container with ID starting with 4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255 not found: ID does not exist" Dec 04 00:35:36.624175 master-0 kubenswrapper[8678]: I1204 00:35:36.624045 8678 scope.go:117] "RemoveContainer" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" Dec 04 00:35:36.624465 master-0 kubenswrapper[8678]: I1204 00:35:36.624428 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019"} err="failed to get container status \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": rpc error: code = NotFound desc = could not find container \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": container with ID starting with b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019 not found: ID does not exist" Dec 04 00:35:36.624465 master-0 kubenswrapper[8678]: I1204 00:35:36.624456 8678 scope.go:117] "RemoveContainer" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" Dec 04 00:35:36.624823 master-0 kubenswrapper[8678]: I1204 00:35:36.624795 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625"} err="failed to get container status \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": rpc error: code = NotFound desc = could not find container \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": container with ID starting with d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625 not found: ID does not exist" Dec 04 00:35:36.624823 master-0 kubenswrapper[8678]: I1204 00:35:36.624816 8678 scope.go:117] "RemoveContainer" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" Dec 04 00:35:36.625117 master-0 kubenswrapper[8678]: I1204 00:35:36.625085 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255"} err="failed to get container status \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": rpc error: code = NotFound desc = could not find container \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": container with ID starting with 4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255 not found: ID does not exist" Dec 04 00:35:36.625117 master-0 kubenswrapper[8678]: I1204 00:35:36.625111 8678 scope.go:117] "RemoveContainer" containerID="b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019" Dec 04 00:35:36.626544 master-0 kubenswrapper[8678]: I1204 00:35:36.626509 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019"} err="failed to get container status \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": rpc error: code = NotFound desc = could not find container \"b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019\": container with ID starting with b296924a576f85822ce573e6ff657b66d6f68c851539996b4df4675e43aa9019 not found: ID does not exist" Dec 04 00:35:36.626544 master-0 kubenswrapper[8678]: I1204 00:35:36.626536 8678 scope.go:117] "RemoveContainer" containerID="d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625" Dec 04 00:35:36.627005 master-0 kubenswrapper[8678]: I1204 00:35:36.626976 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625"} err="failed to get container status \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": rpc error: code = NotFound desc = could not find container \"d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625\": container with ID starting with d320a9b34780f0af83dd04fde8ed69e0e6212bec67a791f255764a61a0858625 not found: ID does not exist" Dec 04 00:35:36.627005 master-0 kubenswrapper[8678]: I1204 00:35:36.626998 8678 scope.go:117] "RemoveContainer" containerID="4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255" Dec 04 00:35:36.627279 master-0 kubenswrapper[8678]: I1204 00:35:36.627251 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255"} err="failed to get container status \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": rpc error: code = NotFound desc = could not find container \"4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255\": container with ID starting with 4792ce37890a2b840377de28e0bc2b0e3842adc5008af12071a0b0a95c254255 not found: ID does not exist" Dec 04 00:35:36.646158 master-0 kubenswrapper[8678]: I1204 00:35:36.646076 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4wd8t\" (UniqueName: \"kubernetes.io/projected/3806572b-4d73-496c-bf98-e91cb7a1572b-kube-api-access-4wd8t\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:36.646158 master-0 kubenswrapper[8678]: I1204 00:35:36.646121 8678 reconciler_common.go:293] "Volume detached for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/3806572b-4d73-496c-bf98-e91cb7a1572b-cloud-controller-manager-operator-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:36.646158 master-0 kubenswrapper[8678]: I1204 00:35:36.646138 8678 reconciler_common.go:293] "Volume detached for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/3806572b-4d73-496c-bf98-e91cb7a1572b-host-etc-kube\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:36.646158 master-0 kubenswrapper[8678]: I1204 00:35:36.646153 8678 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-auth-proxy-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:36.646158 master-0 kubenswrapper[8678]: I1204 00:35:36.646170 8678 reconciler_common.go:293] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/3806572b-4d73-496c-bf98-e91cb7a1572b-images\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:36.653584 master-0 kubenswrapper[8678]: I1204 00:35:36.653514 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw"] Dec 04 00:35:36.653844 master-0 kubenswrapper[8678]: E1204 00:35:36.653818 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="kube-rbac-proxy" Dec 04 00:35:36.653844 master-0 kubenswrapper[8678]: I1204 00:35:36.653845 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="kube-rbac-proxy" Dec 04 00:35:36.654039 master-0 kubenswrapper[8678]: E1204 00:35:36.653866 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="cluster-cloud-controller-manager" Dec 04 00:35:36.654039 master-0 kubenswrapper[8678]: I1204 00:35:36.653899 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="cluster-cloud-controller-manager" Dec 04 00:35:36.654039 master-0 kubenswrapper[8678]: E1204 00:35:36.653915 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="config-sync-controllers" Dec 04 00:35:36.654039 master-0 kubenswrapper[8678]: I1204 00:35:36.654021 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="config-sync-controllers" Dec 04 00:35:36.654269 master-0 kubenswrapper[8678]: I1204 00:35:36.654184 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="cluster-cloud-controller-manager" Dec 04 00:35:36.654269 master-0 kubenswrapper[8678]: I1204 00:35:36.654206 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="config-sync-controllers" Dec 04 00:35:36.654269 master-0 kubenswrapper[8678]: I1204 00:35:36.654215 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" containerName="kube-rbac-proxy" Dec 04 00:35:36.655231 master-0 kubenswrapper[8678]: I1204 00:35:36.655201 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.657157 master-0 kubenswrapper[8678]: I1204 00:35:36.657111 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:35:36.657157 master-0 kubenswrapper[8678]: I1204 00:35:36.657145 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 00:35:36.657581 master-0 kubenswrapper[8678]: I1204 00:35:36.657552 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:35:36.657664 master-0 kubenswrapper[8678]: I1204 00:35:36.657585 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 00:35:36.657664 master-0 kubenswrapper[8678]: I1204 00:35:36.657592 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-p78gv" Dec 04 00:35:36.657664 master-0 kubenswrapper[8678]: I1204 00:35:36.657616 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 00:35:36.673606 master-0 kubenswrapper[8678]: I1204 00:35:36.673555 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/2.log" Dec 04 00:35:36.747600 master-0 kubenswrapper[8678]: I1204 00:35:36.747515 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.747600 master-0 kubenswrapper[8678]: I1204 00:35:36.747587 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2zj\" (UniqueName: \"kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.747980 master-0 kubenswrapper[8678]: I1204 00:35:36.747711 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.747980 master-0 kubenswrapper[8678]: I1204 00:35:36.747735 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.747980 master-0 kubenswrapper[8678]: I1204 00:35:36.747754 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849003 master-0 kubenswrapper[8678]: I1204 00:35:36.848945 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849003 master-0 kubenswrapper[8678]: I1204 00:35:36.848994 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849356 master-0 kubenswrapper[8678]: I1204 00:35:36.849021 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849356 master-0 kubenswrapper[8678]: I1204 00:35:36.849045 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849356 master-0 kubenswrapper[8678]: I1204 00:35:36.849075 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2zj\" (UniqueName: \"kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.849356 master-0 kubenswrapper[8678]: I1204 00:35:36.849185 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.850089 master-0 kubenswrapper[8678]: I1204 00:35:36.849861 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.850791 master-0 kubenswrapper[8678]: I1204 00:35:36.850731 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.851876 master-0 kubenswrapper[8678]: I1204 00:35:36.851797 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.857147 master-0 kubenswrapper[8678]: I1204 00:35:36.857098 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/1.log" Dec 04 00:35:36.857283 master-0 kubenswrapper[8678]: I1204 00:35:36.857106 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3806572b-4d73-496c-bf98-e91cb7a1572b" path="/var/lib/kubelet/pods/3806572b-4d73-496c-bf98-e91cb7a1572b/volumes" Dec 04 00:35:36.865713 master-0 kubenswrapper[8678]: I1204 00:35:36.865657 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2zj\" (UniqueName: \"kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:36.979644 master-0 kubenswrapper[8678]: I1204 00:35:36.979574 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:35:37.004957 master-0 kubenswrapper[8678]: W1204 00:35:37.004832 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb900991f_c6ec_45d1_a76b_44aec0f56cde.slice/crio-f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c WatchSource:0}: Error finding container f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c: Status 404 returned error can't find the container with id f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c Dec 04 00:35:37.060539 master-0 kubenswrapper[8678]: I1204 00:35:37.060466 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/2.log" Dec 04 00:35:37.261881 master-0 kubenswrapper[8678]: I1204 00:35:37.261830 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager_controller-manager-5bbbf854f-x8c6r_cad761d1-d42c-4e56-9220-73ea1678eef5/controller-manager/0.log" Dec 04 00:35:37.464048 master-0 kubenswrapper[8678]: I1204 00:35:37.462857 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager_controller-manager-5bbbf854f-x8c6r_cad761d1-d42c-4e56-9220-73ea1678eef5/controller-manager/1.log" Dec 04 00:35:37.564198 master-0 kubenswrapper[8678]: I1204 00:35:37.564108 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"f0c494bde70f37736abe62be0def4b2d933ab52a855d6e1c1ecf0f70379f00c8"} Dec 04 00:35:37.564198 master-0 kubenswrapper[8678]: I1204 00:35:37.564172 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"1fce128595f021cc732e1d1f11e229a1b136cad65889380e6f7c888dae64bf44"} Dec 04 00:35:37.564198 master-0 kubenswrapper[8678]: I1204 00:35:37.564186 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c"} Dec 04 00:35:37.659527 master-0 kubenswrapper[8678]: I1204 00:35:37.659459 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-ccff84fcd-dbncp_187031e5-1d74-4d95-8163-d0c46e8e6734/route-controller-manager/0.log" Dec 04 00:35:37.858200 master-0 kubenswrapper[8678]: I1204 00:35:37.858140 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_catalog-operator-7cf5cf757f-mmb2r_ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/catalog-operator/0.log" Dec 04 00:35:38.259621 master-0 kubenswrapper[8678]: I1204 00:35:38.259558 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_olm-operator-76bd5d69c7-8xfwz_ffe9d26b-34e2-4506-9c38-69b85ab210a1/olm-operator/0.log" Dec 04 00:35:38.457515 master-0 kubenswrapper[8678]: I1204 00:35:38.457433 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-75b4d49d4c-7s5z5_c79edcd7-4399-4ded-9b03-9084ad9e14b4/kube-rbac-proxy/0.log" Dec 04 00:35:38.576042 master-0 kubenswrapper[8678]: I1204 00:35:38.575903 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"0d348318019ba7fcb968b1174d2d08bb3ae38091c2c3e655d4c09c43db71f1c5"} Dec 04 00:35:38.595913 master-0 kubenswrapper[8678]: I1204 00:35:38.595837 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" podStartSLOduration=2.595818056 podStartE2EDuration="2.595818056s" podCreationTimestamp="2025-12-04 00:35:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:38.595656111 +0000 UTC m=+321.922388687" watchObservedRunningTime="2025-12-04 00:35:38.595818056 +0000 UTC m=+321.922550612" Dec 04 00:35:38.659117 master-0 kubenswrapper[8678]: I1204 00:35:38.659065 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-75b4d49d4c-7s5z5_c79edcd7-4399-4ded-9b03-9084ad9e14b4/package-server-manager/0.log" Dec 04 00:35:38.861160 master-0 kubenswrapper[8678]: I1204 00:35:38.861089 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_packageserver-59f876d99-xlc5q_55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/packageserver/0.log" Dec 04 00:35:39.055429 master-0 kubenswrapper[8678]: I1204 00:35:39.055376 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p"] Dec 04 00:35:39.056275 master-0 kubenswrapper[8678]: I1204 00:35:39.056255 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.058110 master-0 kubenswrapper[8678]: I1204 00:35:39.058014 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-68bvv" Dec 04 00:35:39.058699 master-0 kubenswrapper[8678]: I1204 00:35:39.058661 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 00:35:39.069726 master-0 kubenswrapper[8678]: I1204 00:35:39.069546 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p"] Dec 04 00:35:39.188518 master-0 kubenswrapper[8678]: I1204 00:35:39.188310 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vtt\" (UniqueName: \"kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.188518 master-0 kubenswrapper[8678]: I1204 00:35:39.188381 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.188518 master-0 kubenswrapper[8678]: I1204 00:35:39.188422 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.289715 master-0 kubenswrapper[8678]: I1204 00:35:39.289622 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.289715 master-0 kubenswrapper[8678]: I1204 00:35:39.289733 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.290193 master-0 kubenswrapper[8678]: I1204 00:35:39.289830 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vtt\" (UniqueName: \"kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.291116 master-0 kubenswrapper[8678]: I1204 00:35:39.291024 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.293385 master-0 kubenswrapper[8678]: I1204 00:35:39.293338 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.309795 master-0 kubenswrapper[8678]: I1204 00:35:39.309734 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vtt\" (UniqueName: \"kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.382555 master-0 kubenswrapper[8678]: I1204 00:35:39.382462 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:35:39.834005 master-0 kubenswrapper[8678]: I1204 00:35:39.833906 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p"] Dec 04 00:35:40.137424 master-0 kubenswrapper[8678]: I1204 00:35:40.137359 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw"] Dec 04 00:35:40.138591 master-0 kubenswrapper[8678]: I1204 00:35:40.138557 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.142524 master-0 kubenswrapper[8678]: I1204 00:35:40.142487 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 00:35:40.145911 master-0 kubenswrapper[8678]: I1204 00:35:40.145834 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq"] Dec 04 00:35:40.147693 master-0 kubenswrapper[8678]: I1204 00:35:40.147647 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:35:40.157971 master-0 kubenswrapper[8678]: I1204 00:35:40.157916 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f97f57-x27s4"] Dec 04 00:35:40.159040 master-0 kubenswrapper[8678]: I1204 00:35:40.158986 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.164352 master-0 kubenswrapper[8678]: I1204 00:35:40.163909 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 00:35:40.164352 master-0 kubenswrapper[8678]: I1204 00:35:40.164278 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 00:35:40.164547 master-0 kubenswrapper[8678]: I1204 00:35:40.164519 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 00:35:40.166271 master-0 kubenswrapper[8678]: I1204 00:35:40.164758 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 00:35:40.166271 master-0 kubenswrapper[8678]: I1204 00:35:40.165000 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 00:35:40.166271 master-0 kubenswrapper[8678]: I1204 00:35:40.165192 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 00:35:40.166739 master-0 kubenswrapper[8678]: I1204 00:35:40.166698 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc"] Dec 04 00:35:40.168009 master-0 kubenswrapper[8678]: I1204 00:35:40.167845 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:40.169400 master-0 kubenswrapper[8678]: I1204 00:35:40.169373 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 00:35:40.175001 master-0 kubenswrapper[8678]: I1204 00:35:40.174913 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw"] Dec 04 00:35:40.178361 master-0 kubenswrapper[8678]: I1204 00:35:40.178321 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq"] Dec 04 00:35:40.182624 master-0 kubenswrapper[8678]: I1204 00:35:40.182585 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc"] Dec 04 00:35:40.203067 master-0 kubenswrapper[8678]: I1204 00:35:40.202992 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42cq\" (UniqueName: \"kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq\") pod \"network-check-source-6964bb78b7-qzwwq\" (UID: \"3e5012fe-fc48-4b6d-a075-fa94266ba90d\") " pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:35:40.203161 master-0 kubenswrapper[8678]: I1204 00:35:40.203081 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gw2\" (UniqueName: \"kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.203161 master-0 kubenswrapper[8678]: I1204 00:35:40.203152 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.203240 master-0 kubenswrapper[8678]: I1204 00:35:40.203186 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.305290 master-0 kubenswrapper[8678]: I1204 00:35:40.305194 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gw2\" (UniqueName: \"kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.305290 master-0 kubenswrapper[8678]: I1204 00:35:40.305284 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.305675 master-0 kubenswrapper[8678]: I1204 00:35:40.305368 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc\" (UID: \"cd208ca4-eb77-49a9-87a9-e0a617526e5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:40.305675 master-0 kubenswrapper[8678]: I1204 00:35:40.305434 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.305675 master-0 kubenswrapper[8678]: I1204 00:35:40.305490 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.305675 master-0 kubenswrapper[8678]: I1204 00:35:40.305587 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2g6h\" (UniqueName: \"kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.305675 master-0 kubenswrapper[8678]: I1204 00:35:40.305660 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.306303 master-0 kubenswrapper[8678]: I1204 00:35:40.305702 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.306303 master-0 kubenswrapper[8678]: I1204 00:35:40.305727 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.306303 master-0 kubenswrapper[8678]: I1204 00:35:40.305755 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g42cq\" (UniqueName: \"kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq\") pod \"network-check-source-6964bb78b7-qzwwq\" (UID: \"3e5012fe-fc48-4b6d-a075-fa94266ba90d\") " pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:35:40.306756 master-0 kubenswrapper[8678]: I1204 00:35:40.306699 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.309911 master-0 kubenswrapper[8678]: I1204 00:35:40.309849 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.321265 master-0 kubenswrapper[8678]: I1204 00:35:40.321210 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gw2\" (UniqueName: \"kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2\") pod \"collect-profiles-29413470-qskzw\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.321410 master-0 kubenswrapper[8678]: I1204 00:35:40.321285 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42cq\" (UniqueName: \"kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq\") pod \"network-check-source-6964bb78b7-qzwwq\" (UID: \"3e5012fe-fc48-4b6d-a075-fa94266ba90d\") " pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407025 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2g6h\" (UniqueName: \"kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407110 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407153 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407218 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407258 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc\" (UID: \"cd208ca4-eb77-49a9-87a9-e0a617526e5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:40.407659 master-0 kubenswrapper[8678]: I1204 00:35:40.407295 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.408234 master-0 kubenswrapper[8678]: I1204 00:35:40.408192 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.410337 master-0 kubenswrapper[8678]: I1204 00:35:40.410302 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.410654 master-0 kubenswrapper[8678]: I1204 00:35:40.410625 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.410708 master-0 kubenswrapper[8678]: I1204 00:35:40.410660 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc\" (UID: \"cd208ca4-eb77-49a9-87a9-e0a617526e5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:40.411079 master-0 kubenswrapper[8678]: I1204 00:35:40.411025 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.430788 master-0 kubenswrapper[8678]: I1204 00:35:40.430723 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2g6h\" (UniqueName: \"kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.466140 master-0 kubenswrapper[8678]: I1204 00:35:40.466051 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:40.492380 master-0 kubenswrapper[8678]: I1204 00:35:40.492305 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:35:40.519425 master-0 kubenswrapper[8678]: I1204 00:35:40.519365 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:40.535387 master-0 kubenswrapper[8678]: I1204 00:35:40.535324 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:40.571418 master-0 kubenswrapper[8678]: I1204 00:35:40.571375 8678 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:35:40.618172 master-0 kubenswrapper[8678]: I1204 00:35:40.605106 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" event={"ID":"3e104a8c-66dc-4a9a-836f-656e6f4cc923","Type":"ContainerStarted","Data":"6ed575ea762314628dcf9d42e6412d25583bc54743a1338093ca3019e196725d"} Dec 04 00:35:40.618172 master-0 kubenswrapper[8678]: I1204 00:35:40.605190 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" event={"ID":"3e104a8c-66dc-4a9a-836f-656e6f4cc923","Type":"ContainerStarted","Data":"d0c2b162740018e46456402872eb28a1d15f5b59d45bffcefe5f2776b4811d37"} Dec 04 00:35:40.618172 master-0 kubenswrapper[8678]: I1204 00:35:40.605208 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" event={"ID":"3e104a8c-66dc-4a9a-836f-656e6f4cc923","Type":"ContainerStarted","Data":"2dc8ab6f03770ec3fcd4c4d814b86bb98342fbc4e33aae0acbc9f87f7007ddb9"} Dec 04 00:35:40.618172 master-0 kubenswrapper[8678]: I1204 00:35:40.607715 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"a2fd3bdb7364347566a428315934c8eb45e73b343f9ec75b13c63365c3f03f2f"} Dec 04 00:35:40.634270 master-0 kubenswrapper[8678]: I1204 00:35:40.634168 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" podStartSLOduration=1.634148729 podStartE2EDuration="1.634148729s" podCreationTimestamp="2025-12-04 00:35:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:40.6306892 +0000 UTC m=+323.957421776" watchObservedRunningTime="2025-12-04 00:35:40.634148729 +0000 UTC m=+323.960881285" Dec 04 00:35:40.900505 master-0 kubenswrapper[8678]: I1204 00:35:40.900450 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw"] Dec 04 00:35:40.905708 master-0 kubenswrapper[8678]: W1204 00:35:40.905646 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efff267_ba65_4fcf_a442_64439eeb64ee.slice/crio-0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1 WatchSource:0}: Error finding container 0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1: Status 404 returned error can't find the container with id 0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1 Dec 04 00:35:40.966760 master-0 kubenswrapper[8678]: I1204 00:35:40.966710 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq"] Dec 04 00:35:40.972651 master-0 kubenswrapper[8678]: W1204 00:35:40.972616 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5012fe_fc48_4b6d_a075_fa94266ba90d.slice/crio-21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5 WatchSource:0}: Error finding container 21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5: Status 404 returned error can't find the container with id 21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5 Dec 04 00:35:41.030487 master-0 kubenswrapper[8678]: I1204 00:35:41.030421 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc"] Dec 04 00:35:41.040303 master-0 kubenswrapper[8678]: W1204 00:35:41.040236 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd208ca4_eb77_49a9_87a9_e0a617526e5d.slice/crio-45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c WatchSource:0}: Error finding container 45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c: Status 404 returned error can't find the container with id 45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c Dec 04 00:35:41.105814 master-0 kubenswrapper[8678]: I1204 00:35:41.105777 8678 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:35:41.624653 master-0 kubenswrapper[8678]: I1204 00:35:41.623578 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" event={"ID":"4efff267-ba65-4fcf-a442-64439eeb64ee","Type":"ContainerStarted","Data":"fa783d35d4eac378504f1998f5b24825e94944f2ad0fc300c6862451a2e4a6c6"} Dec 04 00:35:41.624653 master-0 kubenswrapper[8678]: I1204 00:35:41.623639 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" event={"ID":"4efff267-ba65-4fcf-a442-64439eeb64ee","Type":"ContainerStarted","Data":"0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1"} Dec 04 00:35:41.627138 master-0 kubenswrapper[8678]: I1204 00:35:41.626524 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" event={"ID":"3e5012fe-fc48-4b6d-a075-fa94266ba90d","Type":"ContainerStarted","Data":"fe0748f933ecd4cb3a37a6e47bbdfbe8cbd3c5f791647afeb8321331ed5c29e9"} Dec 04 00:35:41.627138 master-0 kubenswrapper[8678]: I1204 00:35:41.626573 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" event={"ID":"3e5012fe-fc48-4b6d-a075-fa94266ba90d","Type":"ContainerStarted","Data":"21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5"} Dec 04 00:35:41.629189 master-0 kubenswrapper[8678]: I1204 00:35:41.629158 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" event={"ID":"cd208ca4-eb77-49a9-87a9-e0a617526e5d","Type":"ContainerStarted","Data":"45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c"} Dec 04 00:35:41.668591 master-0 kubenswrapper[8678]: I1204 00:35:41.668509 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" podStartSLOduration=341.668482481 podStartE2EDuration="5m41.668482481s" podCreationTimestamp="2025-12-04 00:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:41.667427931 +0000 UTC m=+324.994160487" watchObservedRunningTime="2025-12-04 00:35:41.668482481 +0000 UTC m=+324.995215037" Dec 04 00:35:41.704711 master-0 kubenswrapper[8678]: I1204 00:35:41.704630 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" podStartSLOduration=384.704602997 podStartE2EDuration="6m24.704602997s" podCreationTimestamp="2025-12-04 00:29:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:41.69591633 +0000 UTC m=+325.022648886" watchObservedRunningTime="2025-12-04 00:35:41.704602997 +0000 UTC m=+325.031335543" Dec 04 00:35:43.549598 master-0 kubenswrapper[8678]: I1204 00:35:43.549472 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-kl9fp"] Dec 04 00:35:43.550843 master-0 kubenswrapper[8678]: I1204 00:35:43.550810 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.553151 master-0 kubenswrapper[8678]: I1204 00:35:43.553109 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 00:35:43.553225 master-0 kubenswrapper[8678]: I1204 00:35:43.553169 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 00:35:43.553424 master-0 kubenswrapper[8678]: I1204 00:35:43.553398 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-lmpqm" Dec 04 00:35:43.642416 master-0 kubenswrapper[8678]: I1204 00:35:43.642301 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba"} Dec 04 00:35:43.646144 master-0 kubenswrapper[8678]: I1204 00:35:43.646088 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" event={"ID":"cd208ca4-eb77-49a9-87a9-e0a617526e5d","Type":"ContainerStarted","Data":"bcd6f7c874b156cf3520e633a380400a996f8ca8eed9376e0a27d46f5d4d38b8"} Dec 04 00:35:43.647015 master-0 kubenswrapper[8678]: I1204 00:35:43.646952 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:43.654179 master-0 kubenswrapper[8678]: I1204 00:35:43.653943 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:35:43.678006 master-0 kubenswrapper[8678]: I1204 00:35:43.677946 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.678006 master-0 kubenswrapper[8678]: I1204 00:35:43.678000 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68d85\" (UniqueName: \"kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.678372 master-0 kubenswrapper[8678]: I1204 00:35:43.678051 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.679278 master-0 kubenswrapper[8678]: I1204 00:35:43.679190 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-54f97f57-x27s4" podStartSLOduration=295.024325303 podStartE2EDuration="4m57.679156367s" podCreationTimestamp="2025-12-04 00:30:46 +0000 UTC" firstStartedPulling="2025-12-04 00:35:40.571323024 +0000 UTC m=+323.898055580" lastFinishedPulling="2025-12-04 00:35:43.226154088 +0000 UTC m=+326.552886644" observedRunningTime="2025-12-04 00:35:43.673873387 +0000 UTC m=+327.000605933" watchObservedRunningTime="2025-12-04 00:35:43.679156367 +0000 UTC m=+327.005888963" Dec 04 00:35:43.692232 master-0 kubenswrapper[8678]: I1204 00:35:43.692129 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" podStartSLOduration=280.552693881 podStartE2EDuration="4m42.692105274s" podCreationTimestamp="2025-12-04 00:31:01 +0000 UTC" firstStartedPulling="2025-12-04 00:35:41.048987483 +0000 UTC m=+324.375720039" lastFinishedPulling="2025-12-04 00:35:43.188398836 +0000 UTC m=+326.515131432" observedRunningTime="2025-12-04 00:35:43.690985653 +0000 UTC m=+327.017718229" watchObservedRunningTime="2025-12-04 00:35:43.692105274 +0000 UTC m=+327.018837830" Dec 04 00:35:43.780123 master-0 kubenswrapper[8678]: I1204 00:35:43.780059 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.780123 master-0 kubenswrapper[8678]: I1204 00:35:43.780133 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68d85\" (UniqueName: \"kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.780407 master-0 kubenswrapper[8678]: I1204 00:35:43.780251 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.796966 master-0 kubenswrapper[8678]: I1204 00:35:43.784910 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.796966 master-0 kubenswrapper[8678]: I1204 00:35:43.786096 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.801887 master-0 kubenswrapper[8678]: I1204 00:35:43.801737 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68d85\" (UniqueName: \"kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:43.887794 master-0 kubenswrapper[8678]: I1204 00:35:43.887682 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:35:44.520688 master-0 kubenswrapper[8678]: I1204 00:35:44.520583 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:44.523915 master-0 kubenswrapper[8678]: I1204 00:35:44.523842 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:44.523915 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:44.523915 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:44.523915 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:44.524159 master-0 kubenswrapper[8678]: I1204 00:35:44.523956 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:44.656809 master-0 kubenswrapper[8678]: I1204 00:35:44.656699 8678 generic.go:334] "Generic (PLEG): container finished" podID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerID="fa783d35d4eac378504f1998f5b24825e94944f2ad0fc300c6862451a2e4a6c6" exitCode=0 Dec 04 00:35:44.657757 master-0 kubenswrapper[8678]: I1204 00:35:44.656856 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" event={"ID":"4efff267-ba65-4fcf-a442-64439eeb64ee","Type":"ContainerDied","Data":"fa783d35d4eac378504f1998f5b24825e94944f2ad0fc300c6862451a2e4a6c6"} Dec 04 00:35:44.659071 master-0 kubenswrapper[8678]: I1204 00:35:44.658915 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-kl9fp" event={"ID":"727020b5-1084-48ac-9aed-549e4eabbf81","Type":"ContainerStarted","Data":"381a2f19c1ba320a8911554ec5f495985b81706330f9147c0fc26ec056c639d4"} Dec 04 00:35:44.659210 master-0 kubenswrapper[8678]: I1204 00:35:44.659092 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-kl9fp" event={"ID":"727020b5-1084-48ac-9aed-549e4eabbf81","Type":"ContainerStarted","Data":"3d1087838ccc2ee2e43fbcfa144379af98284af1351e708a321b3441c8c85b24"} Dec 04 00:35:45.525982 master-0 kubenswrapper[8678]: I1204 00:35:45.525877 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:45.525982 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:45.525982 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:45.525982 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:45.526499 master-0 kubenswrapper[8678]: I1204 00:35:45.526028 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:46.050095 master-0 kubenswrapper[8678]: I1204 00:35:46.046276 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:46.117814 master-0 kubenswrapper[8678]: I1204 00:35:46.117723 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume\") pod \"4efff267-ba65-4fcf-a442-64439eeb64ee\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " Dec 04 00:35:46.118086 master-0 kubenswrapper[8678]: I1204 00:35:46.117949 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2gw2\" (UniqueName: \"kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2\") pod \"4efff267-ba65-4fcf-a442-64439eeb64ee\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " Dec 04 00:35:46.118222 master-0 kubenswrapper[8678]: I1204 00:35:46.118176 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume\") pod \"4efff267-ba65-4fcf-a442-64439eeb64ee\" (UID: \"4efff267-ba65-4fcf-a442-64439eeb64ee\") " Dec 04 00:35:46.118274 master-0 kubenswrapper[8678]: I1204 00:35:46.118220 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume" (OuterVolumeSpecName: "config-volume") pod "4efff267-ba65-4fcf-a442-64439eeb64ee" (UID: "4efff267-ba65-4fcf-a442-64439eeb64ee"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:35:46.118663 master-0 kubenswrapper[8678]: I1204 00:35:46.118614 8678 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4efff267-ba65-4fcf-a442-64439eeb64ee-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:46.121219 master-0 kubenswrapper[8678]: I1204 00:35:46.121151 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2" (OuterVolumeSpecName: "kube-api-access-j2gw2") pod "4efff267-ba65-4fcf-a442-64439eeb64ee" (UID: "4efff267-ba65-4fcf-a442-64439eeb64ee"). InnerVolumeSpecName "kube-api-access-j2gw2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:35:46.121587 master-0 kubenswrapper[8678]: I1204 00:35:46.121539 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "4efff267-ba65-4fcf-a442-64439eeb64ee" (UID: "4efff267-ba65-4fcf-a442-64439eeb64ee"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:35:46.220195 master-0 kubenswrapper[8678]: I1204 00:35:46.220104 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j2gw2\" (UniqueName: \"kubernetes.io/projected/4efff267-ba65-4fcf-a442-64439eeb64ee-kube-api-access-j2gw2\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:46.220195 master-0 kubenswrapper[8678]: I1204 00:35:46.220171 8678 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4efff267-ba65-4fcf-a442-64439eeb64ee-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 00:35:46.523235 master-0 kubenswrapper[8678]: I1204 00:35:46.523101 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:46.523235 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:46.523235 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:46.523235 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:46.523882 master-0 kubenswrapper[8678]: I1204 00:35:46.523200 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:46.675858 master-0 kubenswrapper[8678]: I1204 00:35:46.675781 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" event={"ID":"4efff267-ba65-4fcf-a442-64439eeb64ee","Type":"ContainerDied","Data":"0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1"} Dec 04 00:35:46.675858 master-0 kubenswrapper[8678]: I1204 00:35:46.675839 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1" Dec 04 00:35:46.676282 master-0 kubenswrapper[8678]: I1204 00:35:46.675898 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:35:47.522615 master-0 kubenswrapper[8678]: I1204 00:35:47.522542 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:47.522615 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:47.522615 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:47.522615 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:47.523325 master-0 kubenswrapper[8678]: I1204 00:35:47.522632 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:48.504060 master-0 kubenswrapper[8678]: I1204 00:35:48.503489 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-kl9fp" podStartSLOduration=5.50346407 podStartE2EDuration="5.50346407s" podCreationTimestamp="2025-12-04 00:35:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:35:48.499258971 +0000 UTC m=+331.825991537" watchObservedRunningTime="2025-12-04 00:35:48.50346407 +0000 UTC m=+331.830196646" Dec 04 00:35:48.522838 master-0 kubenswrapper[8678]: I1204 00:35:48.522753 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:48.522838 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:48.522838 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:48.522838 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:48.522838 master-0 kubenswrapper[8678]: I1204 00:35:48.522815 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:48.571086 master-0 kubenswrapper[8678]: I1204 00:35:48.570859 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-565bdcb8-8dcsg"] Dec 04 00:35:48.573214 master-0 kubenswrapper[8678]: E1204 00:35:48.571851 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:35:48.573214 master-0 kubenswrapper[8678]: I1204 00:35:48.571881 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:35:48.573214 master-0 kubenswrapper[8678]: I1204 00:35:48.572160 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:35:48.573214 master-0 kubenswrapper[8678]: I1204 00:35:48.573056 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.575578 master-0 kubenswrapper[8678]: I1204 00:35:48.575432 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 00:35:48.575799 master-0 kubenswrapper[8678]: I1204 00:35:48.575760 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 00:35:48.576117 master-0 kubenswrapper[8678]: I1204 00:35:48.576090 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 00:35:48.576417 master-0 kubenswrapper[8678]: I1204 00:35:48.576385 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-kfhzx" Dec 04 00:35:48.623194 master-0 kubenswrapper[8678]: I1204 00:35:48.623138 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-565bdcb8-8dcsg"] Dec 04 00:35:48.667723 master-0 kubenswrapper[8678]: I1204 00:35:48.667643 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.667979 master-0 kubenswrapper[8678]: I1204 00:35:48.667753 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.667979 master-0 kubenswrapper[8678]: I1204 00:35:48.667818 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.667979 master-0 kubenswrapper[8678]: I1204 00:35:48.667859 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdw4\" (UniqueName: \"kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.769639 master-0 kubenswrapper[8678]: I1204 00:35:48.769477 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.769833 master-0 kubenswrapper[8678]: E1204 00:35:48.769642 8678 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Dec 04 00:35:48.769833 master-0 kubenswrapper[8678]: I1204 00:35:48.769636 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.770032 master-0 kubenswrapper[8678]: E1204 00:35:48.769720 8678 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls podName:8d4d3057-9f71-4b07-b463-51cc49d28bf3 nodeName:}" failed. No retries permitted until 2025-12-04 00:35:49.269697563 +0000 UTC m=+332.596430129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls") pod "prometheus-operator-565bdcb8-8dcsg" (UID: "8d4d3057-9f71-4b07-b463-51cc49d28bf3") : secret "prometheus-operator-tls" not found Dec 04 00:35:48.770032 master-0 kubenswrapper[8678]: I1204 00:35:48.769918 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.770032 master-0 kubenswrapper[8678]: I1204 00:35:48.769992 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdw4\" (UniqueName: \"kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.772393 master-0 kubenswrapper[8678]: I1204 00:35:48.772345 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.776687 master-0 kubenswrapper[8678]: I1204 00:35:48.776619 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:48.789857 master-0 kubenswrapper[8678]: I1204 00:35:48.789798 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdw4\" (UniqueName: \"kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:49.278251 master-0 kubenswrapper[8678]: I1204 00:35:49.278131 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:49.283286 master-0 kubenswrapper[8678]: I1204 00:35:49.283224 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:49.523081 master-0 kubenswrapper[8678]: I1204 00:35:49.522991 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:49.523081 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:49.523081 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:49.523081 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:49.523081 master-0 kubenswrapper[8678]: I1204 00:35:49.523071 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:49.539615 master-0 kubenswrapper[8678]: I1204 00:35:49.539449 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:35:50.034094 master-0 kubenswrapper[8678]: I1204 00:35:50.034037 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-565bdcb8-8dcsg"] Dec 04 00:35:50.043178 master-0 kubenswrapper[8678]: W1204 00:35:50.043122 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4d3057_9f71_4b07_b463_51cc49d28bf3.slice/crio-ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf WatchSource:0}: Error finding container ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf: Status 404 returned error can't find the container with id ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf Dec 04 00:35:50.521263 master-0 kubenswrapper[8678]: I1204 00:35:50.520957 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:35:50.523176 master-0 kubenswrapper[8678]: I1204 00:35:50.523125 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:50.523176 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:50.523176 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:50.523176 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:50.523749 master-0 kubenswrapper[8678]: I1204 00:35:50.523206 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:50.704560 master-0 kubenswrapper[8678]: I1204 00:35:50.704122 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" event={"ID":"8d4d3057-9f71-4b07-b463-51cc49d28bf3","Type":"ContainerStarted","Data":"ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf"} Dec 04 00:35:51.523741 master-0 kubenswrapper[8678]: I1204 00:35:51.523658 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:51.523741 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:51.523741 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:51.523741 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:51.524394 master-0 kubenswrapper[8678]: I1204 00:35:51.523750 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:51.713441 master-0 kubenswrapper[8678]: I1204 00:35:51.713375 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" event={"ID":"8d4d3057-9f71-4b07-b463-51cc49d28bf3","Type":"ContainerStarted","Data":"d8871bc1759e3e7f1b785ca110524cf234234fef814bb16b2941e12d0df98a4a"} Dec 04 00:35:51.713441 master-0 kubenswrapper[8678]: I1204 00:35:51.713440 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" event={"ID":"8d4d3057-9f71-4b07-b463-51cc49d28bf3","Type":"ContainerStarted","Data":"9fa2b1f844a6b0b70ec3ed30ea6f77b3d767e2b86d40ce4fbdeca7356986115d"} Dec 04 00:35:52.524163 master-0 kubenswrapper[8678]: I1204 00:35:52.524079 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:52.524163 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:52.524163 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:52.524163 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:52.525155 master-0 kubenswrapper[8678]: I1204 00:35:52.524177 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:53.525118 master-0 kubenswrapper[8678]: I1204 00:35:53.525015 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:53.525118 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:53.525118 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:53.525118 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:53.526265 master-0 kubenswrapper[8678]: I1204 00:35:53.525143 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:53.961043 master-0 kubenswrapper[8678]: I1204 00:35:53.960914 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" podStartSLOduration=4.657155851 podStartE2EDuration="5.960884616s" podCreationTimestamp="2025-12-04 00:35:48 +0000 UTC" firstStartedPulling="2025-12-04 00:35:50.045067771 +0000 UTC m=+333.371800327" lastFinishedPulling="2025-12-04 00:35:51.348796536 +0000 UTC m=+334.675529092" observedRunningTime="2025-12-04 00:35:51.751573098 +0000 UTC m=+335.078305654" watchObservedRunningTime="2025-12-04 00:35:53.960884616 +0000 UTC m=+337.287617192" Dec 04 00:35:53.961274 master-0 kubenswrapper[8678]: I1204 00:35:53.961217 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn"] Dec 04 00:35:53.963181 master-0 kubenswrapper[8678]: I1204 00:35:53.963113 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:53.965506 master-0 kubenswrapper[8678]: I1204 00:35:53.965469 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-wdzq5" Dec 04 00:35:53.965591 master-0 kubenswrapper[8678]: I1204 00:35:53.965498 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 00:35:53.966332 master-0 kubenswrapper[8678]: I1204 00:35:53.966303 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 00:35:53.979213 master-0 kubenswrapper[8678]: I1204 00:35:53.979164 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pcpjf"] Dec 04 00:35:53.986463 master-0 kubenswrapper[8678]: I1204 00:35:53.986405 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:53.987343 master-0 kubenswrapper[8678]: I1204 00:35:53.987312 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn"] Dec 04 00:35:53.989251 master-0 kubenswrapper[8678]: I1204 00:35:53.989207 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-x6jwn" Dec 04 00:35:53.989805 master-0 kubenswrapper[8678]: I1204 00:35:53.989748 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 00:35:53.990178 master-0 kubenswrapper[8678]: I1204 00:35:53.990153 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 00:35:54.039054 master-0 kubenswrapper[8678]: I1204 00:35:54.038998 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx"] Dec 04 00:35:54.044018 master-0 kubenswrapper[8678]: I1204 00:35:54.043971 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbks2\" (UniqueName: \"kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.044018 master-0 kubenswrapper[8678]: I1204 00:35:54.044014 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044043 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044066 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044093 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044115 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044143 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044168 master-0 kubenswrapper[8678]: I1204 00:35:54.044169 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.044333 master-0 kubenswrapper[8678]: I1204 00:35:54.044192 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044333 master-0 kubenswrapper[8678]: I1204 00:35:54.044206 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nctgw\" (UniqueName: \"kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.044333 master-0 kubenswrapper[8678]: I1204 00:35:54.044221 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.044333 master-0 kubenswrapper[8678]: I1204 00:35:54.044238 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.079018 master-0 kubenswrapper[8678]: I1204 00:35:54.075261 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.083063 master-0 kubenswrapper[8678]: I1204 00:35:54.082991 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx"] Dec 04 00:35:54.085643 master-0 kubenswrapper[8678]: I1204 00:35:54.085587 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 00:35:54.088630 master-0 kubenswrapper[8678]: I1204 00:35:54.088422 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-f6xzw" Dec 04 00:35:54.092430 master-0 kubenswrapper[8678]: I1204 00:35:54.092407 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 00:35:54.092994 master-0 kubenswrapper[8678]: I1204 00:35:54.092980 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 00:35:54.145454 master-0 kubenswrapper[8678]: I1204 00:35:54.145387 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145469 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145501 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145518 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nctgw\" (UniqueName: \"kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145535 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145550 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145586 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145612 master-0 kubenswrapper[8678]: I1204 00:35:54.145610 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xbks2\" (UniqueName: \"kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145632 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145655 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145678 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145699 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145722 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145749 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145771 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9v27\" (UniqueName: \"kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145791 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.145852 master-0 kubenswrapper[8678]: I1204 00:35:54.145841 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.146124 master-0 kubenswrapper[8678]: I1204 00:35:54.145872 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.146124 master-0 kubenswrapper[8678]: I1204 00:35:54.146015 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.146833 master-0 kubenswrapper[8678]: I1204 00:35:54.146792 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.148136 master-0 kubenswrapper[8678]: I1204 00:35:54.147688 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.148843 master-0 kubenswrapper[8678]: I1204 00:35:54.148809 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.150148 master-0 kubenswrapper[8678]: I1204 00:35:54.149645 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.150238 master-0 kubenswrapper[8678]: I1204 00:35:54.150210 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.150723 master-0 kubenswrapper[8678]: I1204 00:35:54.150675 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.150769 master-0 kubenswrapper[8678]: I1204 00:35:54.150724 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.153161 master-0 kubenswrapper[8678]: I1204 00:35:54.153127 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.153697 master-0 kubenswrapper[8678]: I1204 00:35:54.153667 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.165597 master-0 kubenswrapper[8678]: I1204 00:35:54.165571 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctgw\" (UniqueName: \"kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.165840 master-0 kubenswrapper[8678]: I1204 00:35:54.165795 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbks2\" (UniqueName: \"kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247155 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247257 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247284 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247312 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247329 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9v27\" (UniqueName: \"kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.247528 master-0 kubenswrapper[8678]: I1204 00:35:54.247345 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.248807 master-0 kubenswrapper[8678]: I1204 00:35:54.248778 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.249400 master-0 kubenswrapper[8678]: I1204 00:35:54.249343 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.249788 master-0 kubenswrapper[8678]: I1204 00:35:54.249753 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.251274 master-0 kubenswrapper[8678]: I1204 00:35:54.251224 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.252029 master-0 kubenswrapper[8678]: I1204 00:35:54.251965 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.269696 master-0 kubenswrapper[8678]: I1204 00:35:54.269640 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9v27\" (UniqueName: \"kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.284752 master-0 kubenswrapper[8678]: I1204 00:35:54.284701 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:35:54.325986 master-0 kubenswrapper[8678]: I1204 00:35:54.325879 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:35:54.437125 master-0 kubenswrapper[8678]: I1204 00:35:54.408157 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:35:54.524071 master-0 kubenswrapper[8678]: I1204 00:35:54.523998 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:54.524071 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:54.524071 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:54.524071 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:54.524348 master-0 kubenswrapper[8678]: I1204 00:35:54.524064 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:54.736507 master-0 kubenswrapper[8678]: I1204 00:35:54.736380 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpjf" event={"ID":"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2","Type":"ContainerStarted","Data":"d1cc6b47032858a9f23cf1250d8519a8904fc0784c3d5cd13c71b398db1efb64"} Dec 04 00:35:54.798544 master-0 kubenswrapper[8678]: I1204 00:35:54.798466 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn"] Dec 04 00:35:54.801678 master-0 kubenswrapper[8678]: W1204 00:35:54.801630 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1288d627_f7c2_47d5_aa02_2c86d5f82369.slice/crio-0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a WatchSource:0}: Error finding container 0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a: Status 404 returned error can't find the container with id 0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a Dec 04 00:35:54.863053 master-0 kubenswrapper[8678]: I1204 00:35:54.862994 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx"] Dec 04 00:35:54.864437 master-0 kubenswrapper[8678]: W1204 00:35:54.864375 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aabcb3b_483d_419b_98ce_0ffd0ce265e8.slice/crio-666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020 WatchSource:0}: Error finding container 666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020: Status 404 returned error can't find the container with id 666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020 Dec 04 00:35:55.533989 master-0 kubenswrapper[8678]: I1204 00:35:55.529043 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:55.533989 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:55.533989 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:55.533989 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:55.533989 master-0 kubenswrapper[8678]: I1204 00:35:55.529121 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:55.745163 master-0 kubenswrapper[8678]: I1204 00:35:55.745086 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" event={"ID":"1288d627-f7c2-47d5-aa02-2c86d5f82369","Type":"ContainerStarted","Data":"abdf254ba91ccc42aea6d961657881b605b5bc09cea042f7d36322809f1fa820"} Dec 04 00:35:55.745163 master-0 kubenswrapper[8678]: I1204 00:35:55.745145 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" event={"ID":"1288d627-f7c2-47d5-aa02-2c86d5f82369","Type":"ContainerStarted","Data":"28cac813e65eaa821e18a3e6ea9b66a23b22eba79941c23cc32956a9d2da1f01"} Dec 04 00:35:55.745163 master-0 kubenswrapper[8678]: I1204 00:35:55.745158 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" event={"ID":"1288d627-f7c2-47d5-aa02-2c86d5f82369","Type":"ContainerStarted","Data":"0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a"} Dec 04 00:35:55.750122 master-0 kubenswrapper[8678]: I1204 00:35:55.750085 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" event={"ID":"5aabcb3b-483d-419b-98ce-0ffd0ce265e8","Type":"ContainerStarted","Data":"666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020"} Dec 04 00:35:56.523745 master-0 kubenswrapper[8678]: I1204 00:35:56.523653 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:56.523745 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:56.523745 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:56.523745 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:56.524166 master-0 kubenswrapper[8678]: I1204 00:35:56.523777 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:56.766286 master-0 kubenswrapper[8678]: I1204 00:35:56.765133 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" event={"ID":"1288d627-f7c2-47d5-aa02-2c86d5f82369","Type":"ContainerStarted","Data":"e6b38788ae3daf7ca8d172fa70c956d44b7b10d2f681f25f6e0b9568f3343185"} Dec 04 00:35:56.770890 master-0 kubenswrapper[8678]: I1204 00:35:56.769330 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" event={"ID":"5aabcb3b-483d-419b-98ce-0ffd0ce265e8","Type":"ContainerStarted","Data":"56523dc54759186a2a758f0c8ea94a733834881bc42be112e0e86456ca8cdf7f"} Dec 04 00:35:56.771981 master-0 kubenswrapper[8678]: I1204 00:35:56.771618 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpjf" event={"ID":"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2","Type":"ContainerStarted","Data":"41249359c992651f9b40fe7acef8e75583a599ff2b66ec8076f8be460e15df7d"} Dec 04 00:35:56.791967 master-0 kubenswrapper[8678]: I1204 00:35:56.791648 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" podStartSLOduration=2.464199849 podStartE2EDuration="3.791625277s" podCreationTimestamp="2025-12-04 00:35:53 +0000 UTC" firstStartedPulling="2025-12-04 00:35:55.130683716 +0000 UTC m=+338.457416282" lastFinishedPulling="2025-12-04 00:35:56.458109124 +0000 UTC m=+339.784841710" observedRunningTime="2025-12-04 00:35:56.790174436 +0000 UTC m=+340.116907012" watchObservedRunningTime="2025-12-04 00:35:56.791625277 +0000 UTC m=+340.118357833" Dec 04 00:35:57.523860 master-0 kubenswrapper[8678]: I1204 00:35:57.523764 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:57.523860 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:57.523860 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:57.523860 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:57.524329 master-0 kubenswrapper[8678]: I1204 00:35:57.523857 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:57.779629 master-0 kubenswrapper[8678]: I1204 00:35:57.779463 8678 generic.go:334] "Generic (PLEG): container finished" podID="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" containerID="41249359c992651f9b40fe7acef8e75583a599ff2b66ec8076f8be460e15df7d" exitCode=0 Dec 04 00:35:57.779629 master-0 kubenswrapper[8678]: I1204 00:35:57.779572 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpjf" event={"ID":"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2","Type":"ContainerDied","Data":"41249359c992651f9b40fe7acef8e75583a599ff2b66ec8076f8be460e15df7d"} Dec 04 00:35:57.783543 master-0 kubenswrapper[8678]: I1204 00:35:57.783488 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" event={"ID":"5aabcb3b-483d-419b-98ce-0ffd0ce265e8","Type":"ContainerStarted","Data":"0161c601ba35868175b925231e87122db26d15c4868f2343578cfdc221ff8568"} Dec 04 00:35:57.783650 master-0 kubenswrapper[8678]: I1204 00:35:57.783547 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" event={"ID":"5aabcb3b-483d-419b-98ce-0ffd0ce265e8","Type":"ContainerStarted","Data":"d01e946ad8ef49b5ee528d7d827fa74626a3406e99ed09470783a986dc92b193"} Dec 04 00:35:58.522966 master-0 kubenswrapper[8678]: I1204 00:35:58.522871 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:58.522966 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:58.522966 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:58.522966 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:58.523403 master-0 kubenswrapper[8678]: I1204 00:35:58.523010 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:58.797267 master-0 kubenswrapper[8678]: I1204 00:35:58.796976 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpjf" event={"ID":"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2","Type":"ContainerStarted","Data":"5530c77a006f3d2014135a675a36512a182d92a7949dc6ff19dcd84009f60743"} Dec 04 00:35:58.797267 master-0 kubenswrapper[8678]: I1204 00:35:58.797166 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpjf" event={"ID":"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2","Type":"ContainerStarted","Data":"65d372bd55c8f25b9d5684a353f9b6243f01a74abf6b13fdc42ad9008db9b9c8"} Dec 04 00:35:58.832259 master-0 kubenswrapper[8678]: I1204 00:35:58.832124 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" podStartSLOduration=3.248026502 podStartE2EDuration="4.832097531s" podCreationTimestamp="2025-12-04 00:35:54 +0000 UTC" firstStartedPulling="2025-12-04 00:35:54.867017846 +0000 UTC m=+338.193750412" lastFinishedPulling="2025-12-04 00:35:56.451088885 +0000 UTC m=+339.777821441" observedRunningTime="2025-12-04 00:35:57.825803235 +0000 UTC m=+341.152535791" watchObservedRunningTime="2025-12-04 00:35:58.832097531 +0000 UTC m=+342.158830127" Dec 04 00:35:58.834583 master-0 kubenswrapper[8678]: I1204 00:35:58.834508 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pcpjf" podStartSLOduration=3.743598773 podStartE2EDuration="5.834496269s" podCreationTimestamp="2025-12-04 00:35:53 +0000 UTC" firstStartedPulling="2025-12-04 00:35:54.354733024 +0000 UTC m=+337.681465580" lastFinishedPulling="2025-12-04 00:35:56.44563052 +0000 UTC m=+339.772363076" observedRunningTime="2025-12-04 00:35:58.827105679 +0000 UTC m=+342.153838245" watchObservedRunningTime="2025-12-04 00:35:58.834496269 +0000 UTC m=+342.161228865" Dec 04 00:35:59.523236 master-0 kubenswrapper[8678]: I1204 00:35:59.523186 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:35:59.523236 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:35:59.523236 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:35:59.523236 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:35:59.523627 master-0 kubenswrapper[8678]: I1204 00:35:59.523597 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:35:59.613043 master-0 kubenswrapper[8678]: I1204 00:35:59.612983 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:35:59.613908 master-0 kubenswrapper[8678]: I1204 00:35:59.613878 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.615829 master-0 kubenswrapper[8678]: I1204 00:35:59.615797 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-7kmmpv795dabm" Dec 04 00:35:59.616484 master-0 kubenswrapper[8678]: I1204 00:35:59.616452 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 00:35:59.618816 master-0 kubenswrapper[8678]: I1204 00:35:59.618780 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 00:35:59.619004 master-0 kubenswrapper[8678]: I1204 00:35:59.618977 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 00:35:59.619255 master-0 kubenswrapper[8678]: I1204 00:35:59.619231 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 00:35:59.619422 master-0 kubenswrapper[8678]: I1204 00:35:59.619369 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-pvgwv" Dec 04 00:35:59.632542 master-0 kubenswrapper[8678]: I1204 00:35:59.632490 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:35:59.736547 master-0 kubenswrapper[8678]: I1204 00:35:59.736462 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.736547 master-0 kubenswrapper[8678]: I1204 00:35:59.736523 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.736853 master-0 kubenswrapper[8678]: I1204 00:35:59.736574 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.736853 master-0 kubenswrapper[8678]: I1204 00:35:59.736593 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.736853 master-0 kubenswrapper[8678]: I1204 00:35:59.736614 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.737133 master-0 kubenswrapper[8678]: I1204 00:35:59.737094 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.737264 master-0 kubenswrapper[8678]: I1204 00:35:59.737213 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.839697 master-0 kubenswrapper[8678]: I1204 00:35:59.839501 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.839697 master-0 kubenswrapper[8678]: I1204 00:35:59.839587 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.839697 master-0 kubenswrapper[8678]: I1204 00:35:59.839675 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.841229 master-0 kubenswrapper[8678]: I1204 00:35:59.839721 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.841229 master-0 kubenswrapper[8678]: I1204 00:35:59.839755 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.841229 master-0 kubenswrapper[8678]: I1204 00:35:59.839848 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.841229 master-0 kubenswrapper[8678]: I1204 00:35:59.840217 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.841681 master-0 kubenswrapper[8678]: I1204 00:35:59.841608 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.844199 master-0 kubenswrapper[8678]: I1204 00:35:59.844122 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.846735 master-0 kubenswrapper[8678]: I1204 00:35:59.846570 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.846998 master-0 kubenswrapper[8678]: I1204 00:35:59.846784 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.847342 master-0 kubenswrapper[8678]: I1204 00:35:59.847287 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.847509 master-0 kubenswrapper[8678]: I1204 00:35:59.847446 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.876840 master-0 kubenswrapper[8678]: I1204 00:35:59.876756 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:35:59.935008 master-0 kubenswrapper[8678]: I1204 00:35:59.934904 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:36:00.460248 master-0 kubenswrapper[8678]: I1204 00:36:00.460172 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:36:00.466183 master-0 kubenswrapper[8678]: W1204 00:36:00.466124 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c154d51_5e12_4f76_a0ad_6b5d85ba5e0a.slice/crio-b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b WatchSource:0}: Error finding container b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b: Status 404 returned error can't find the container with id b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b Dec 04 00:36:00.523163 master-0 kubenswrapper[8678]: I1204 00:36:00.523079 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:00.523163 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:00.523163 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:00.523163 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:00.523163 master-0 kubenswrapper[8678]: I1204 00:36:00.523147 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:00.815274 master-0 kubenswrapper[8678]: I1204 00:36:00.815088 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" event={"ID":"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a","Type":"ContainerStarted","Data":"b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b"} Dec 04 00:36:01.522195 master-0 kubenswrapper[8678]: I1204 00:36:01.522119 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:01.522195 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:01.522195 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:01.522195 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:01.523878 master-0 kubenswrapper[8678]: I1204 00:36:01.522223 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:02.524051 master-0 kubenswrapper[8678]: I1204 00:36:02.523821 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:02.524051 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:02.524051 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:02.524051 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:02.524051 master-0 kubenswrapper[8678]: I1204 00:36:02.523917 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:02.839550 master-0 kubenswrapper[8678]: I1204 00:36:02.839342 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" event={"ID":"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a","Type":"ContainerStarted","Data":"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432"} Dec 04 00:36:02.871465 master-0 kubenswrapper[8678]: I1204 00:36:02.871358 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" podStartSLOduration=2.223518273 podStartE2EDuration="3.871335152s" podCreationTimestamp="2025-12-04 00:35:59 +0000 UTC" firstStartedPulling="2025-12-04 00:36:00.469490173 +0000 UTC m=+343.796222769" lastFinishedPulling="2025-12-04 00:36:02.117307082 +0000 UTC m=+345.444039648" observedRunningTime="2025-12-04 00:36:02.868045508 +0000 UTC m=+346.194778074" watchObservedRunningTime="2025-12-04 00:36:02.871335152 +0000 UTC m=+346.198067708" Dec 04 00:36:03.524827 master-0 kubenswrapper[8678]: I1204 00:36:03.524705 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:03.524827 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:03.524827 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:03.524827 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:03.524827 master-0 kubenswrapper[8678]: I1204 00:36:03.524807 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:04.522581 master-0 kubenswrapper[8678]: I1204 00:36:04.522492 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:04.522581 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:04.522581 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:04.522581 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:04.522581 master-0 kubenswrapper[8678]: I1204 00:36:04.522582 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:05.523797 master-0 kubenswrapper[8678]: I1204 00:36:05.523664 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:05.523797 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:05.523797 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:05.523797 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:05.523797 master-0 kubenswrapper[8678]: I1204 00:36:05.523776 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:06.523145 master-0 kubenswrapper[8678]: I1204 00:36:06.523003 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:06.523145 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:06.523145 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:06.523145 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:06.523145 master-0 kubenswrapper[8678]: I1204 00:36:06.523106 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:07.523458 master-0 kubenswrapper[8678]: I1204 00:36:07.523360 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:07.523458 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:07.523458 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:07.523458 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:07.525231 master-0 kubenswrapper[8678]: I1204 00:36:07.523472 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:08.451366 master-0 kubenswrapper[8678]: I1204 00:36:08.451283 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:36:08.523651 master-0 kubenswrapper[8678]: I1204 00:36:08.523558 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:08.523651 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:08.523651 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:08.523651 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:08.523651 master-0 kubenswrapper[8678]: I1204 00:36:08.523628 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:09.522746 master-0 kubenswrapper[8678]: I1204 00:36:09.522678 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:09.522746 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:09.522746 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:09.522746 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:09.522746 master-0 kubenswrapper[8678]: I1204 00:36:09.522752 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:10.523880 master-0 kubenswrapper[8678]: I1204 00:36:10.523785 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:10.523880 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:10.523880 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:10.523880 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:10.524599 master-0 kubenswrapper[8678]: I1204 00:36:10.523877 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:11.524560 master-0 kubenswrapper[8678]: I1204 00:36:11.524458 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:11.524560 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:11.524560 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:11.524560 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:11.524560 master-0 kubenswrapper[8678]: I1204 00:36:11.524553 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:12.523677 master-0 kubenswrapper[8678]: I1204 00:36:12.523599 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:12.523677 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:12.523677 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:12.523677 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:12.524003 master-0 kubenswrapper[8678]: I1204 00:36:12.523690 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:13.522889 master-0 kubenswrapper[8678]: I1204 00:36:13.522789 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:13.522889 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:13.522889 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:13.522889 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:13.524093 master-0 kubenswrapper[8678]: I1204 00:36:13.522915 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:14.522365 master-0 kubenswrapper[8678]: I1204 00:36:14.522310 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:14.522365 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:14.522365 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:14.522365 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:14.522802 master-0 kubenswrapper[8678]: I1204 00:36:14.522372 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:15.522966 master-0 kubenswrapper[8678]: I1204 00:36:15.522866 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:15.522966 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:15.522966 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:15.522966 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:15.523667 master-0 kubenswrapper[8678]: I1204 00:36:15.523023 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:16.523077 master-0 kubenswrapper[8678]: I1204 00:36:16.522985 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:16.523077 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:16.523077 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:16.523077 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:16.523077 master-0 kubenswrapper[8678]: I1204 00:36:16.523079 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:17.523501 master-0 kubenswrapper[8678]: I1204 00:36:17.523435 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:17.523501 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:17.523501 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:17.523501 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:17.524633 master-0 kubenswrapper[8678]: I1204 00:36:17.524582 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:18.522401 master-0 kubenswrapper[8678]: I1204 00:36:18.522325 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:18.522401 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:18.522401 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:18.522401 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:18.522810 master-0 kubenswrapper[8678]: I1204 00:36:18.522782 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:19.523037 master-0 kubenswrapper[8678]: I1204 00:36:19.522914 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:19.523037 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:19.523037 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:19.523037 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:19.523902 master-0 kubenswrapper[8678]: I1204 00:36:19.523066 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:19.935236 master-0 kubenswrapper[8678]: I1204 00:36:19.935152 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:36:19.935236 master-0 kubenswrapper[8678]: I1204 00:36:19.935246 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:36:20.525843 master-0 kubenswrapper[8678]: I1204 00:36:20.525657 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:20.525843 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:20.525843 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:20.525843 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:20.525843 master-0 kubenswrapper[8678]: I1204 00:36:20.525780 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:21.523298 master-0 kubenswrapper[8678]: I1204 00:36:21.523187 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:21.523298 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:21.523298 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:21.523298 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:21.523703 master-0 kubenswrapper[8678]: I1204 00:36:21.523313 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:22.522899 master-0 kubenswrapper[8678]: I1204 00:36:22.522828 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:22.522899 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:22.522899 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:22.522899 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:22.524052 master-0 kubenswrapper[8678]: I1204 00:36:22.522904 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:23.524407 master-0 kubenswrapper[8678]: I1204 00:36:23.524294 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:23.524407 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:23.524407 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:23.524407 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:23.525416 master-0 kubenswrapper[8678]: I1204 00:36:23.524415 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:24.524708 master-0 kubenswrapper[8678]: I1204 00:36:24.523511 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:24.524708 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:24.524708 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:24.524708 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:24.524708 master-0 kubenswrapper[8678]: I1204 00:36:24.523611 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:25.523890 master-0 kubenswrapper[8678]: I1204 00:36:25.523784 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:25.523890 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:25.523890 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:25.523890 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:25.524570 master-0 kubenswrapper[8678]: I1204 00:36:25.523893 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:26.523245 master-0 kubenswrapper[8678]: I1204 00:36:26.523180 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:26.523245 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:26.523245 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:26.523245 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:26.524052 master-0 kubenswrapper[8678]: I1204 00:36:26.523270 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:27.524036 master-0 kubenswrapper[8678]: I1204 00:36:27.523897 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:27.524036 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:27.524036 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:27.524036 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:27.526873 master-0 kubenswrapper[8678]: I1204 00:36:27.524043 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:28.526450 master-0 kubenswrapper[8678]: I1204 00:36:28.526382 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:28.526450 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:28.526450 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:28.526450 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:28.527534 master-0 kubenswrapper[8678]: I1204 00:36:28.527495 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:29.524913 master-0 kubenswrapper[8678]: I1204 00:36:29.524790 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:29.524913 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:29.524913 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:29.524913 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:29.525487 master-0 kubenswrapper[8678]: I1204 00:36:29.524917 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:30.522349 master-0 kubenswrapper[8678]: I1204 00:36:30.522236 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:30.522349 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:30.522349 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:30.522349 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:30.522349 master-0 kubenswrapper[8678]: I1204 00:36:30.522347 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:31.523907 master-0 kubenswrapper[8678]: I1204 00:36:31.523821 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:31.523907 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:31.523907 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:31.523907 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:31.524757 master-0 kubenswrapper[8678]: I1204 00:36:31.523919 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:32.286427 master-0 kubenswrapper[8678]: I1204 00:36:32.286350 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rn56p"] Dec 04 00:36:32.287723 master-0 kubenswrapper[8678]: I1204 00:36:32.287679 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.292458 master-0 kubenswrapper[8678]: I1204 00:36:32.292395 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 00:36:32.292840 master-0 kubenswrapper[8678]: I1204 00:36:32.292785 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 00:36:32.293129 master-0 kubenswrapper[8678]: I1204 00:36:32.293100 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-grlj9" Dec 04 00:36:32.293364 master-0 kubenswrapper[8678]: I1204 00:36:32.293333 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 00:36:32.304128 master-0 kubenswrapper[8678]: I1204 00:36:32.304028 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn56p"] Dec 04 00:36:32.430618 master-0 kubenswrapper[8678]: I1204 00:36:32.430524 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.430916 master-0 kubenswrapper[8678]: I1204 00:36:32.430670 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rd8w\" (UniqueName: \"kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.523970 master-0 kubenswrapper[8678]: I1204 00:36:32.523850 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:32.523970 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:32.523970 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:32.523970 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:32.525442 master-0 kubenswrapper[8678]: I1204 00:36:32.523985 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:32.531911 master-0 kubenswrapper[8678]: I1204 00:36:32.531826 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.532061 master-0 kubenswrapper[8678]: I1204 00:36:32.531974 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rd8w\" (UniqueName: \"kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.538667 master-0 kubenswrapper[8678]: I1204 00:36:32.538542 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.559579 master-0 kubenswrapper[8678]: I1204 00:36:32.559486 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rd8w\" (UniqueName: \"kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:32.624983 master-0 kubenswrapper[8678]: I1204 00:36:32.624855 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:36:33.078580 master-0 kubenswrapper[8678]: I1204 00:36:33.078493 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/1.log" Dec 04 00:36:33.080607 master-0 kubenswrapper[8678]: I1204 00:36:33.080547 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/0.log" Dec 04 00:36:33.080726 master-0 kubenswrapper[8678]: I1204 00:36:33.080660 8678 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc" exitCode=1 Dec 04 00:36:33.080806 master-0 kubenswrapper[8678]: I1204 00:36:33.080746 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerDied","Data":"962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc"} Dec 04 00:36:33.080865 master-0 kubenswrapper[8678]: I1204 00:36:33.080823 8678 scope.go:117] "RemoveContainer" containerID="bd570164e4f250f953ddde8e60445d595b3a58298a3711e92e8a9ec240f35d10" Dec 04 00:36:33.081920 master-0 kubenswrapper[8678]: I1204 00:36:33.081856 8678 scope.go:117] "RemoveContainer" containerID="962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc" Dec 04 00:36:33.082436 master-0 kubenswrapper[8678]: E1204 00:36:33.082369 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:36:33.085206 master-0 kubenswrapper[8678]: I1204 00:36:33.084987 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn56p"] Dec 04 00:36:33.097896 master-0 kubenswrapper[8678]: W1204 00:36:33.097798 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf783888_6b82_48e8_aad0_ee77f7167115.slice/crio-bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548 WatchSource:0}: Error finding container bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548: Status 404 returned error can't find the container with id bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548 Dec 04 00:36:33.523380 master-0 kubenswrapper[8678]: I1204 00:36:33.523278 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:33.523380 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:33.523380 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:33.523380 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:33.523821 master-0 kubenswrapper[8678]: I1204 00:36:33.523401 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:34.092684 master-0 kubenswrapper[8678]: I1204 00:36:34.092604 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn56p" event={"ID":"df783888-6b82-48e8-aad0-ee77f7167115","Type":"ContainerStarted","Data":"b9c726f18fb123f6340fa2a98a35153c3c6f66b92aa5f0832d6f6d903680a971"} Dec 04 00:36:34.092684 master-0 kubenswrapper[8678]: I1204 00:36:34.092679 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn56p" event={"ID":"df783888-6b82-48e8-aad0-ee77f7167115","Type":"ContainerStarted","Data":"bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548"} Dec 04 00:36:34.096399 master-0 kubenswrapper[8678]: I1204 00:36:34.096365 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/1.log" Dec 04 00:36:34.123684 master-0 kubenswrapper[8678]: I1204 00:36:34.123514 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rn56p" podStartSLOduration=2.12347361 podStartE2EDuration="2.12347361s" podCreationTimestamp="2025-12-04 00:36:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:36:34.116112948 +0000 UTC m=+377.442845554" watchObservedRunningTime="2025-12-04 00:36:34.12347361 +0000 UTC m=+377.450206206" Dec 04 00:36:34.524545 master-0 kubenswrapper[8678]: I1204 00:36:34.524446 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:34.524545 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:34.524545 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:34.524545 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:34.525067 master-0 kubenswrapper[8678]: I1204 00:36:34.524550 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:35.523420 master-0 kubenswrapper[8678]: I1204 00:36:35.523234 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:35.523420 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:35.523420 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:35.523420 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:35.523420 master-0 kubenswrapper[8678]: I1204 00:36:35.523336 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:36.522995 master-0 kubenswrapper[8678]: I1204 00:36:36.522871 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:36.522995 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:36.522995 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:36.522995 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:36.524037 master-0 kubenswrapper[8678]: I1204 00:36:36.523036 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:37.523356 master-0 kubenswrapper[8678]: I1204 00:36:37.523248 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:37.523356 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:37.523356 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:37.523356 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:37.523356 master-0 kubenswrapper[8678]: I1204 00:36:37.523345 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:38.524081 master-0 kubenswrapper[8678]: I1204 00:36:38.523968 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:38.524081 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:38.524081 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:38.524081 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:38.525124 master-0 kubenswrapper[8678]: I1204 00:36:38.524107 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:39.522849 master-0 kubenswrapper[8678]: I1204 00:36:39.522755 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:39.522849 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:39.522849 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:39.522849 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:39.522849 master-0 kubenswrapper[8678]: I1204 00:36:39.522836 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:39.943798 master-0 kubenswrapper[8678]: I1204 00:36:39.943698 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:36:39.949912 master-0 kubenswrapper[8678]: I1204 00:36:39.949863 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:36:40.523253 master-0 kubenswrapper[8678]: I1204 00:36:40.523152 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:40.523253 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:40.523253 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:40.523253 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:40.523699 master-0 kubenswrapper[8678]: I1204 00:36:40.523281 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:41.523775 master-0 kubenswrapper[8678]: I1204 00:36:41.523693 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:41.523775 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:41.523775 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:41.523775 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:41.524517 master-0 kubenswrapper[8678]: I1204 00:36:41.523806 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:42.523663 master-0 kubenswrapper[8678]: I1204 00:36:42.523503 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:42.523663 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:42.523663 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:42.523663 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:42.525298 master-0 kubenswrapper[8678]: I1204 00:36:42.523667 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:43.523036 master-0 kubenswrapper[8678]: I1204 00:36:43.522897 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:43.523036 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:43.523036 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:43.523036 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:43.523036 master-0 kubenswrapper[8678]: I1204 00:36:43.523024 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:44.522367 master-0 kubenswrapper[8678]: I1204 00:36:44.522253 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:44.522367 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:44.522367 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:44.522367 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:44.522367 master-0 kubenswrapper[8678]: I1204 00:36:44.522349 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:44.850491 master-0 kubenswrapper[8678]: I1204 00:36:44.850408 8678 scope.go:117] "RemoveContainer" containerID="962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc" Dec 04 00:36:45.194168 master-0 kubenswrapper[8678]: I1204 00:36:45.193968 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/1.log" Dec 04 00:36:45.194629 master-0 kubenswrapper[8678]: I1204 00:36:45.194485 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8"} Dec 04 00:36:45.523491 master-0 kubenswrapper[8678]: I1204 00:36:45.523295 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:45.523491 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:45.523491 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:45.523491 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:45.523491 master-0 kubenswrapper[8678]: I1204 00:36:45.523420 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:46.523238 master-0 kubenswrapper[8678]: I1204 00:36:46.523114 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:46.523238 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:46.523238 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:46.523238 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:46.524385 master-0 kubenswrapper[8678]: I1204 00:36:46.523262 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:47.523188 master-0 kubenswrapper[8678]: I1204 00:36:47.523017 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:47.523188 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:47.523188 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:47.523188 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:47.523188 master-0 kubenswrapper[8678]: I1204 00:36:47.523160 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:48.523766 master-0 kubenswrapper[8678]: I1204 00:36:48.523657 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:48.523766 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:48.523766 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:48.523766 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:48.524975 master-0 kubenswrapper[8678]: I1204 00:36:48.523785 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:49.523113 master-0 kubenswrapper[8678]: I1204 00:36:49.523001 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:49.523113 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:49.523113 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:49.523113 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:49.523662 master-0 kubenswrapper[8678]: I1204 00:36:49.523124 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:50.523046 master-0 kubenswrapper[8678]: I1204 00:36:50.522884 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:50.523046 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:50.523046 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:50.523046 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:50.524184 master-0 kubenswrapper[8678]: I1204 00:36:50.523068 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:51.523351 master-0 kubenswrapper[8678]: I1204 00:36:51.523262 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:51.523351 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:51.523351 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:51.523351 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:51.524430 master-0 kubenswrapper[8678]: I1204 00:36:51.523390 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:52.523604 master-0 kubenswrapper[8678]: I1204 00:36:52.523498 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:52.523604 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:52.523604 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:52.523604 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:52.524725 master-0 kubenswrapper[8678]: I1204 00:36:52.523620 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:53.523207 master-0 kubenswrapper[8678]: I1204 00:36:53.523134 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:53.523207 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:53.523207 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:53.523207 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:53.523785 master-0 kubenswrapper[8678]: I1204 00:36:53.523733 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:54.522712 master-0 kubenswrapper[8678]: I1204 00:36:54.522617 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:54.522712 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:54.522712 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:54.522712 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:54.522712 master-0 kubenswrapper[8678]: I1204 00:36:54.522701 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:55.524264 master-0 kubenswrapper[8678]: I1204 00:36:55.524163 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:55.524264 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:55.524264 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:55.524264 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:55.525305 master-0 kubenswrapper[8678]: I1204 00:36:55.524281 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:56.522527 master-0 kubenswrapper[8678]: I1204 00:36:56.522454 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:56.522527 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:56.522527 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:56.522527 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:56.522838 master-0 kubenswrapper[8678]: I1204 00:36:56.522530 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:57.523797 master-0 kubenswrapper[8678]: I1204 00:36:57.523692 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:57.523797 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:57.523797 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:57.523797 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:57.525043 master-0 kubenswrapper[8678]: I1204 00:36:57.523793 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:58.523219 master-0 kubenswrapper[8678]: I1204 00:36:58.523122 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:58.523219 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:58.523219 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:58.523219 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:58.523666 master-0 kubenswrapper[8678]: I1204 00:36:58.523238 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:36:59.524387 master-0 kubenswrapper[8678]: I1204 00:36:59.524291 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:36:59.524387 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:36:59.524387 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:36:59.524387 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:36:59.525130 master-0 kubenswrapper[8678]: I1204 00:36:59.524442 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:00.523760 master-0 kubenswrapper[8678]: I1204 00:37:00.523684 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:00.523760 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:00.523760 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:00.523760 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:00.524435 master-0 kubenswrapper[8678]: I1204 00:37:00.523783 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:01.523951 master-0 kubenswrapper[8678]: I1204 00:37:01.523812 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:01.523951 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:01.523951 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:01.523951 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:01.524475 master-0 kubenswrapper[8678]: I1204 00:37:01.523975 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:02.523757 master-0 kubenswrapper[8678]: I1204 00:37:02.523660 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:02.523757 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:02.523757 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:02.523757 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:02.524372 master-0 kubenswrapper[8678]: I1204 00:37:02.524324 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:03.524037 master-0 kubenswrapper[8678]: I1204 00:37:03.523891 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:03.524037 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:03.524037 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:03.524037 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:03.524037 master-0 kubenswrapper[8678]: I1204 00:37:03.524024 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:04.523077 master-0 kubenswrapper[8678]: I1204 00:37:04.522907 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:04.523077 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:04.523077 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:04.523077 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:04.523525 master-0 kubenswrapper[8678]: I1204 00:37:04.523089 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:05.522891 master-0 kubenswrapper[8678]: I1204 00:37:05.522812 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:05.522891 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:05.522891 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:05.522891 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:05.524025 master-0 kubenswrapper[8678]: I1204 00:37:05.522904 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:06.522882 master-0 kubenswrapper[8678]: I1204 00:37:06.522792 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:06.522882 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:06.522882 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:06.522882 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:06.524232 master-0 kubenswrapper[8678]: I1204 00:37:06.522890 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:07.523233 master-0 kubenswrapper[8678]: I1204 00:37:07.523128 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:07.523233 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:07.523233 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:07.523233 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:07.524205 master-0 kubenswrapper[8678]: I1204 00:37:07.523252 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:08.523276 master-0 kubenswrapper[8678]: I1204 00:37:08.523169 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:08.523276 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:08.523276 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:08.523276 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:08.524339 master-0 kubenswrapper[8678]: I1204 00:37:08.523305 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:09.523691 master-0 kubenswrapper[8678]: I1204 00:37:09.523583 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:09.523691 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:09.523691 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:09.523691 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:09.524419 master-0 kubenswrapper[8678]: I1204 00:37:09.523691 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:10.521910 master-0 kubenswrapper[8678]: I1204 00:37:10.521859 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:10.521910 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:10.521910 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:10.521910 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:10.522178 master-0 kubenswrapper[8678]: I1204 00:37:10.521959 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:11.525248 master-0 kubenswrapper[8678]: I1204 00:37:11.525149 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:11.525248 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:11.525248 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:11.525248 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:11.525946 master-0 kubenswrapper[8678]: I1204 00:37:11.525287 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:12.525004 master-0 kubenswrapper[8678]: I1204 00:37:12.522602 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:12.525004 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:12.525004 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:12.525004 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:12.525004 master-0 kubenswrapper[8678]: I1204 00:37:12.522706 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:13.524169 master-0 kubenswrapper[8678]: I1204 00:37:13.524098 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:13.524169 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:13.524169 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:13.524169 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:13.524766 master-0 kubenswrapper[8678]: I1204 00:37:13.524716 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:14.524067 master-0 kubenswrapper[8678]: I1204 00:37:14.523562 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:14.524067 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:14.524067 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:14.524067 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:14.524067 master-0 kubenswrapper[8678]: I1204 00:37:14.523668 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:15.522444 master-0 kubenswrapper[8678]: I1204 00:37:15.522350 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:15.522444 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:15.522444 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:15.522444 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:15.522444 master-0 kubenswrapper[8678]: I1204 00:37:15.522437 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:16.523257 master-0 kubenswrapper[8678]: I1204 00:37:16.523161 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:16.523257 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:16.523257 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:16.523257 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:16.524095 master-0 kubenswrapper[8678]: I1204 00:37:16.523277 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:17.522104 master-0 kubenswrapper[8678]: I1204 00:37:17.522031 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:17.522104 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:17.522104 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:17.522104 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:17.522480 master-0 kubenswrapper[8678]: I1204 00:37:17.522119 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:18.523867 master-0 kubenswrapper[8678]: I1204 00:37:18.523791 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:18.523867 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:18.523867 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:18.523867 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:18.523867 master-0 kubenswrapper[8678]: I1204 00:37:18.523864 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:19.522910 master-0 kubenswrapper[8678]: I1204 00:37:19.522793 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:19.522910 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:19.522910 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:19.522910 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:19.522910 master-0 kubenswrapper[8678]: I1204 00:37:19.522893 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:19.669316 master-0 kubenswrapper[8678]: I1204 00:37:19.669206 8678 patch_prober.go:28] interesting pod/machine-config-daemon-dhr5k container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Dec 04 00:37:19.670190 master-0 kubenswrapper[8678]: I1204 00:37:19.669345 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" podUID="fb98438b-191c-4957-a9d1-8a64520f7f00" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Dec 04 00:37:20.523049 master-0 kubenswrapper[8678]: I1204 00:37:20.522993 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:20.523049 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:20.523049 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:20.523049 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:20.523524 master-0 kubenswrapper[8678]: I1204 00:37:20.523066 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:21.525378 master-0 kubenswrapper[8678]: I1204 00:37:21.525273 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:21.525378 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:21.525378 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:21.525378 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:21.526079 master-0 kubenswrapper[8678]: I1204 00:37:21.525395 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:22.523332 master-0 kubenswrapper[8678]: I1204 00:37:22.523232 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:22.523332 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:22.523332 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:22.523332 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:22.523691 master-0 kubenswrapper[8678]: I1204 00:37:22.523367 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:23.523422 master-0 kubenswrapper[8678]: I1204 00:37:23.523311 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:23.523422 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:23.523422 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:23.523422 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:23.523422 master-0 kubenswrapper[8678]: I1204 00:37:23.523402 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:24.523480 master-0 kubenswrapper[8678]: I1204 00:37:24.523375 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:24.523480 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:24.523480 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:24.523480 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:24.525222 master-0 kubenswrapper[8678]: I1204 00:37:24.523513 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:25.523407 master-0 kubenswrapper[8678]: I1204 00:37:25.523332 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:25.523407 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:25.523407 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:25.523407 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:25.524178 master-0 kubenswrapper[8678]: I1204 00:37:25.523420 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:26.523380 master-0 kubenswrapper[8678]: I1204 00:37:26.523289 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:26.523380 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:26.523380 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:26.523380 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:26.523657 master-0 kubenswrapper[8678]: I1204 00:37:26.523417 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:27.523521 master-0 kubenswrapper[8678]: I1204 00:37:27.523430 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:27.523521 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:27.523521 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:27.523521 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:27.524262 master-0 kubenswrapper[8678]: I1204 00:37:27.523524 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:28.522043 master-0 kubenswrapper[8678]: I1204 00:37:28.521979 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:28.522043 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:28.522043 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:28.522043 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:28.522572 master-0 kubenswrapper[8678]: I1204 00:37:28.522534 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:29.523294 master-0 kubenswrapper[8678]: I1204 00:37:29.523232 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:29.523294 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:29.523294 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:29.523294 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:29.523954 master-0 kubenswrapper[8678]: I1204 00:37:29.523339 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:30.523287 master-0 kubenswrapper[8678]: I1204 00:37:30.523205 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:30.523287 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:30.523287 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:30.523287 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:30.524092 master-0 kubenswrapper[8678]: I1204 00:37:30.523319 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:31.522953 master-0 kubenswrapper[8678]: I1204 00:37:31.522852 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:31.522953 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:31.522953 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:31.522953 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:31.523529 master-0 kubenswrapper[8678]: I1204 00:37:31.523481 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:32.523991 master-0 kubenswrapper[8678]: I1204 00:37:32.523379 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:32.523991 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:32.523991 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:32.523991 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:32.523991 master-0 kubenswrapper[8678]: I1204 00:37:32.523481 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:33.523905 master-0 kubenswrapper[8678]: I1204 00:37:33.523791 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:33.523905 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:33.523905 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:33.523905 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:33.524973 master-0 kubenswrapper[8678]: I1204 00:37:33.523915 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:34.523860 master-0 kubenswrapper[8678]: I1204 00:37:34.523733 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:34.523860 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:34.523860 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:34.523860 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:34.523860 master-0 kubenswrapper[8678]: I1204 00:37:34.523848 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:35.523599 master-0 kubenswrapper[8678]: I1204 00:37:35.523512 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:35.523599 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:35.523599 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:35.523599 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:35.524167 master-0 kubenswrapper[8678]: I1204 00:37:35.523609 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:36.525404 master-0 kubenswrapper[8678]: I1204 00:37:36.525329 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:36.525404 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:36.525404 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:36.525404 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:36.526290 master-0 kubenswrapper[8678]: I1204 00:37:36.525406 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:37.523516 master-0 kubenswrapper[8678]: I1204 00:37:37.523469 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:37.523516 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:37.523516 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:37.523516 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:37.524012 master-0 kubenswrapper[8678]: I1204 00:37:37.523915 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:38.523732 master-0 kubenswrapper[8678]: I1204 00:37:38.523623 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:38.523732 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:38.523732 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:38.523732 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:38.524995 master-0 kubenswrapper[8678]: I1204 00:37:38.523728 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:39.524234 master-0 kubenswrapper[8678]: I1204 00:37:39.524035 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:39.524234 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:39.524234 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:39.524234 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:39.525577 master-0 kubenswrapper[8678]: I1204 00:37:39.525513 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:40.523175 master-0 kubenswrapper[8678]: I1204 00:37:40.523091 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:40.523175 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:40.523175 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:40.523175 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:40.523529 master-0 kubenswrapper[8678]: I1204 00:37:40.523212 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:41.523515 master-0 kubenswrapper[8678]: I1204 00:37:41.523417 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:41.523515 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:41.523515 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:41.523515 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:41.523515 master-0 kubenswrapper[8678]: I1204 00:37:41.523496 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:42.524165 master-0 kubenswrapper[8678]: I1204 00:37:42.524063 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:42.524165 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:42.524165 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:42.524165 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:42.524165 master-0 kubenswrapper[8678]: I1204 00:37:42.524154 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:43.523846 master-0 kubenswrapper[8678]: I1204 00:37:43.523748 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:37:43.523846 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:37:43.523846 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:37:43.523846 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:37:43.525058 master-0 kubenswrapper[8678]: I1204 00:37:43.523879 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:37:43.525058 master-0 kubenswrapper[8678]: I1204 00:37:43.524012 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:37:43.525412 master-0 kubenswrapper[8678]: I1204 00:37:43.525340 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="router" containerStatusID={"Type":"cri-o","ID":"f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba"} pod="openshift-ingress/router-default-54f97f57-x27s4" containerMessage="Container router failed startup probe, will be restarted" Dec 04 00:37:43.525518 master-0 kubenswrapper[8678]: I1204 00:37:43.525437 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" containerID="cri-o://f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba" gracePeriod=3600 Dec 04 00:38:30.047033 master-0 kubenswrapper[8678]: I1204 00:38:30.046903 8678 generic.go:334] "Generic (PLEG): container finished" podID="83e0d056-186c-4067-b586-14fe2970fcc0" containerID="f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba" exitCode=0 Dec 04 00:38:30.047832 master-0 kubenswrapper[8678]: I1204 00:38:30.047049 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerDied","Data":"f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba"} Dec 04 00:38:30.047832 master-0 kubenswrapper[8678]: I1204 00:38:30.047139 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632"} Dec 04 00:38:30.520301 master-0 kubenswrapper[8678]: I1204 00:38:30.520196 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:38:30.520301 master-0 kubenswrapper[8678]: I1204 00:38:30.520282 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:38:30.524814 master-0 kubenswrapper[8678]: I1204 00:38:30.524753 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:30.524814 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:30.524814 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:30.524814 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:30.525151 master-0 kubenswrapper[8678]: I1204 00:38:30.524848 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:31.523041 master-0 kubenswrapper[8678]: I1204 00:38:31.522909 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:31.523041 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:31.523041 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:31.523041 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:31.523732 master-0 kubenswrapper[8678]: I1204 00:38:31.523062 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:32.524022 master-0 kubenswrapper[8678]: I1204 00:38:32.523912 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:32.524022 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:32.524022 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:32.524022 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:32.524022 master-0 kubenswrapper[8678]: I1204 00:38:32.524011 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:33.524550 master-0 kubenswrapper[8678]: I1204 00:38:33.524455 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:33.524550 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:33.524550 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:33.524550 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:33.524550 master-0 kubenswrapper[8678]: I1204 00:38:33.524553 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:34.523514 master-0 kubenswrapper[8678]: I1204 00:38:34.523432 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:34.523514 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:34.523514 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:34.523514 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:34.524007 master-0 kubenswrapper[8678]: I1204 00:38:34.523521 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:35.523531 master-0 kubenswrapper[8678]: I1204 00:38:35.523443 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:35.523531 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:35.523531 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:35.523531 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:35.524548 master-0 kubenswrapper[8678]: I1204 00:38:35.523547 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:36.523497 master-0 kubenswrapper[8678]: I1204 00:38:36.523432 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:36.523497 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:36.523497 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:36.523497 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:36.524630 master-0 kubenswrapper[8678]: I1204 00:38:36.523508 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:37.524565 master-0 kubenswrapper[8678]: I1204 00:38:37.524287 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:37.524565 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:37.524565 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:37.524565 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:37.524565 master-0 kubenswrapper[8678]: I1204 00:38:37.524482 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:38.524133 master-0 kubenswrapper[8678]: I1204 00:38:38.524066 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:38.524133 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:38.524133 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:38.524133 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:38.525328 master-0 kubenswrapper[8678]: I1204 00:38:38.524167 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:39.523795 master-0 kubenswrapper[8678]: I1204 00:38:39.523701 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:39.523795 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:39.523795 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:39.523795 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:39.524207 master-0 kubenswrapper[8678]: I1204 00:38:39.523819 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:40.523432 master-0 kubenswrapper[8678]: I1204 00:38:40.523350 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:40.523432 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:40.523432 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:40.523432 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:40.523432 master-0 kubenswrapper[8678]: I1204 00:38:40.523419 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:41.524098 master-0 kubenswrapper[8678]: I1204 00:38:41.524007 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:41.524098 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:41.524098 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:41.524098 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:41.525093 master-0 kubenswrapper[8678]: I1204 00:38:41.524117 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:42.523765 master-0 kubenswrapper[8678]: I1204 00:38:42.523672 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:42.523765 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:42.523765 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:42.523765 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:42.524773 master-0 kubenswrapper[8678]: I1204 00:38:42.523769 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:43.523707 master-0 kubenswrapper[8678]: I1204 00:38:43.523605 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:43.523707 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:43.523707 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:43.523707 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:43.523707 master-0 kubenswrapper[8678]: I1204 00:38:43.523692 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:44.523098 master-0 kubenswrapper[8678]: I1204 00:38:44.523015 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:44.523098 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:44.523098 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:44.523098 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:44.523582 master-0 kubenswrapper[8678]: I1204 00:38:44.523139 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:45.523300 master-0 kubenswrapper[8678]: I1204 00:38:45.523165 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:45.523300 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:45.523300 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:45.523300 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:45.524506 master-0 kubenswrapper[8678]: I1204 00:38:45.523412 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:46.185914 master-0 kubenswrapper[8678]: I1204 00:38:46.185841 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/2.log" Dec 04 00:38:46.186914 master-0 kubenswrapper[8678]: I1204 00:38:46.186860 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/1.log" Dec 04 00:38:46.187477 master-0 kubenswrapper[8678]: I1204 00:38:46.187433 8678 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8" exitCode=1 Dec 04 00:38:46.187600 master-0 kubenswrapper[8678]: I1204 00:38:46.187488 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerDied","Data":"0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8"} Dec 04 00:38:46.187600 master-0 kubenswrapper[8678]: I1204 00:38:46.187538 8678 scope.go:117] "RemoveContainer" containerID="962f82a31e710fc4a642d0b048488534d1a059414944550377730d11d84130bc" Dec 04 00:38:46.188406 master-0 kubenswrapper[8678]: I1204 00:38:46.188353 8678 scope.go:117] "RemoveContainer" containerID="0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8" Dec 04 00:38:46.188859 master-0 kubenswrapper[8678]: E1204 00:38:46.188791 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:38:46.524357 master-0 kubenswrapper[8678]: I1204 00:38:46.524126 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:46.524357 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:46.524357 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:46.524357 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:46.524357 master-0 kubenswrapper[8678]: I1204 00:38:46.524302 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:47.196802 master-0 kubenswrapper[8678]: I1204 00:38:47.196701 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/2.log" Dec 04 00:38:47.523543 master-0 kubenswrapper[8678]: I1204 00:38:47.523249 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:47.523543 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:47.523543 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:47.523543 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:47.523543 master-0 kubenswrapper[8678]: I1204 00:38:47.523408 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:48.523607 master-0 kubenswrapper[8678]: I1204 00:38:48.523475 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:48.523607 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:48.523607 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:48.523607 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:48.523607 master-0 kubenswrapper[8678]: I1204 00:38:48.523597 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:49.523004 master-0 kubenswrapper[8678]: I1204 00:38:49.522884 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:49.523004 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:49.523004 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:49.523004 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:49.523470 master-0 kubenswrapper[8678]: I1204 00:38:49.523012 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:50.523374 master-0 kubenswrapper[8678]: I1204 00:38:50.523220 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:50.523374 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:50.523374 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:50.523374 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:50.524599 master-0 kubenswrapper[8678]: I1204 00:38:50.523409 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:51.524616 master-0 kubenswrapper[8678]: I1204 00:38:51.524547 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:51.524616 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:51.524616 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:51.524616 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:51.524616 master-0 kubenswrapper[8678]: I1204 00:38:51.524621 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:52.523558 master-0 kubenswrapper[8678]: I1204 00:38:52.523447 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:52.523558 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:52.523558 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:52.523558 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:52.523897 master-0 kubenswrapper[8678]: I1204 00:38:52.523593 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:53.525529 master-0 kubenswrapper[8678]: I1204 00:38:53.525440 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:53.525529 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:53.525529 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:53.525529 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:53.525529 master-0 kubenswrapper[8678]: I1204 00:38:53.525523 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:54.523723 master-0 kubenswrapper[8678]: I1204 00:38:54.523639 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:54.523723 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:54.523723 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:54.523723 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:54.524201 master-0 kubenswrapper[8678]: I1204 00:38:54.523743 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:55.524985 master-0 kubenswrapper[8678]: I1204 00:38:55.524872 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:55.524985 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:55.524985 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:55.524985 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:55.525972 master-0 kubenswrapper[8678]: I1204 00:38:55.524997 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:56.523621 master-0 kubenswrapper[8678]: I1204 00:38:56.523426 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:56.523621 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:56.523621 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:56.523621 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:56.523621 master-0 kubenswrapper[8678]: I1204 00:38:56.523564 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:57.523413 master-0 kubenswrapper[8678]: I1204 00:38:57.523216 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:57.523413 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:57.523413 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:57.523413 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:57.523413 master-0 kubenswrapper[8678]: I1204 00:38:57.523324 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:58.524109 master-0 kubenswrapper[8678]: I1204 00:38:58.523995 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:58.524109 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:58.524109 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:58.524109 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:58.524982 master-0 kubenswrapper[8678]: I1204 00:38:58.524173 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:38:58.850878 master-0 kubenswrapper[8678]: I1204 00:38:58.850787 8678 scope.go:117] "RemoveContainer" containerID="0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8" Dec 04 00:38:58.851253 master-0 kubenswrapper[8678]: E1204 00:38:58.851086 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:38:59.524033 master-0 kubenswrapper[8678]: I1204 00:38:59.523867 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:38:59.524033 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:38:59.524033 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:38:59.524033 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:38:59.525066 master-0 kubenswrapper[8678]: I1204 00:38:59.524055 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:00.523418 master-0 kubenswrapper[8678]: I1204 00:39:00.523368 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:00.523418 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:00.523418 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:00.523418 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:00.524154 master-0 kubenswrapper[8678]: I1204 00:39:00.524121 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:01.523675 master-0 kubenswrapper[8678]: I1204 00:39:01.523568 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:01.523675 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:01.523675 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:01.523675 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:01.524728 master-0 kubenswrapper[8678]: I1204 00:39:01.523699 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:02.524202 master-0 kubenswrapper[8678]: I1204 00:39:02.524116 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:02.524202 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:02.524202 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:02.524202 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:02.525669 master-0 kubenswrapper[8678]: I1204 00:39:02.524218 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:03.524564 master-0 kubenswrapper[8678]: I1204 00:39:03.524464 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:03.524564 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:03.524564 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:03.524564 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:03.525440 master-0 kubenswrapper[8678]: I1204 00:39:03.524593 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:04.525743 master-0 kubenswrapper[8678]: I1204 00:39:04.525652 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:04.525743 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:04.525743 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:04.525743 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:04.526462 master-0 kubenswrapper[8678]: I1204 00:39:04.525774 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:05.524199 master-0 kubenswrapper[8678]: I1204 00:39:05.524107 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:05.524199 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:05.524199 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:05.524199 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:05.524681 master-0 kubenswrapper[8678]: I1204 00:39:05.524202 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:06.523715 master-0 kubenswrapper[8678]: I1204 00:39:06.523587 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:06.523715 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:06.523715 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:06.523715 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:06.524601 master-0 kubenswrapper[8678]: I1204 00:39:06.523729 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:07.524562 master-0 kubenswrapper[8678]: I1204 00:39:07.524356 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:07.524562 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:07.524562 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:07.524562 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:07.524562 master-0 kubenswrapper[8678]: I1204 00:39:07.524458 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:08.523753 master-0 kubenswrapper[8678]: I1204 00:39:08.523636 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:08.523753 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:08.523753 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:08.523753 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:08.523753 master-0 kubenswrapper[8678]: I1204 00:39:08.523744 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:09.522909 master-0 kubenswrapper[8678]: I1204 00:39:09.522729 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:09.522909 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:09.522909 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:09.522909 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:09.522909 master-0 kubenswrapper[8678]: I1204 00:39:09.522827 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:10.522238 master-0 kubenswrapper[8678]: I1204 00:39:10.522155 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:10.522238 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:10.522238 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:10.522238 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:10.522517 master-0 kubenswrapper[8678]: I1204 00:39:10.522249 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:11.524013 master-0 kubenswrapper[8678]: I1204 00:39:11.523897 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:11.524013 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:11.524013 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:11.524013 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:11.525192 master-0 kubenswrapper[8678]: I1204 00:39:11.524023 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:12.523476 master-0 kubenswrapper[8678]: I1204 00:39:12.523115 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:12.523476 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:12.523476 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:12.523476 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:12.523476 master-0 kubenswrapper[8678]: I1204 00:39:12.523184 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:12.850881 master-0 kubenswrapper[8678]: I1204 00:39:12.850833 8678 scope.go:117] "RemoveContainer" containerID="0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8" Dec 04 00:39:13.411471 master-0 kubenswrapper[8678]: I1204 00:39:13.411356 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/2.log" Dec 04 00:39:13.412134 master-0 kubenswrapper[8678]: I1204 00:39:13.412065 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560"} Dec 04 00:39:13.527735 master-0 kubenswrapper[8678]: I1204 00:39:13.527628 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:13.527735 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:13.527735 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:13.527735 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:13.528118 master-0 kubenswrapper[8678]: I1204 00:39:13.527742 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:14.523982 master-0 kubenswrapper[8678]: I1204 00:39:14.523873 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:14.523982 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:14.523982 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:14.523982 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:14.523982 master-0 kubenswrapper[8678]: I1204 00:39:14.523979 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:15.523424 master-0 kubenswrapper[8678]: I1204 00:39:15.523329 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:15.523424 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:15.523424 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:15.523424 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:15.523424 master-0 kubenswrapper[8678]: I1204 00:39:15.523406 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:16.523218 master-0 kubenswrapper[8678]: I1204 00:39:16.523140 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:16.523218 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:16.523218 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:16.523218 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:16.523911 master-0 kubenswrapper[8678]: I1204 00:39:16.523243 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:17.523837 master-0 kubenswrapper[8678]: I1204 00:39:17.523633 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:17.523837 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:17.523837 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:17.523837 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:17.523837 master-0 kubenswrapper[8678]: I1204 00:39:17.523748 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:18.523747 master-0 kubenswrapper[8678]: I1204 00:39:18.523648 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:18.523747 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:18.523747 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:18.523747 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:18.523747 master-0 kubenswrapper[8678]: I1204 00:39:18.523740 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:19.523217 master-0 kubenswrapper[8678]: I1204 00:39:19.523121 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:19.523217 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:19.523217 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:19.523217 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:19.523558 master-0 kubenswrapper[8678]: I1204 00:39:19.523236 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:20.524680 master-0 kubenswrapper[8678]: I1204 00:39:20.524588 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:20.524680 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:20.524680 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:20.524680 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:20.526002 master-0 kubenswrapper[8678]: I1204 00:39:20.524700 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:21.523280 master-0 kubenswrapper[8678]: I1204 00:39:21.523196 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:21.523280 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:21.523280 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:21.523280 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:21.523719 master-0 kubenswrapper[8678]: I1204 00:39:21.523309 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:22.525227 master-0 kubenswrapper[8678]: I1204 00:39:22.525165 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:22.525227 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:22.525227 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:22.525227 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:22.526456 master-0 kubenswrapper[8678]: I1204 00:39:22.526404 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:23.523666 master-0 kubenswrapper[8678]: I1204 00:39:23.523575 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:23.523666 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:23.523666 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:23.523666 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:23.524190 master-0 kubenswrapper[8678]: I1204 00:39:23.523721 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:24.524618 master-0 kubenswrapper[8678]: I1204 00:39:24.524484 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:24.524618 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:24.524618 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:24.524618 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:24.524618 master-0 kubenswrapper[8678]: I1204 00:39:24.524599 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:25.523862 master-0 kubenswrapper[8678]: I1204 00:39:25.523741 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:25.523862 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:25.523862 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:25.523862 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:25.523862 master-0 kubenswrapper[8678]: I1204 00:39:25.523850 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:26.522984 master-0 kubenswrapper[8678]: I1204 00:39:26.522876 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:26.522984 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:26.522984 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:26.522984 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:26.525058 master-0 kubenswrapper[8678]: I1204 00:39:26.522987 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:27.524866 master-0 kubenswrapper[8678]: I1204 00:39:27.524681 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:27.524866 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:27.524866 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:27.524866 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:27.524866 master-0 kubenswrapper[8678]: I1204 00:39:27.524802 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:28.523788 master-0 kubenswrapper[8678]: I1204 00:39:28.523705 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:28.523788 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:28.523788 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:28.523788 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:28.524434 master-0 kubenswrapper[8678]: I1204 00:39:28.523802 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:29.524166 master-0 kubenswrapper[8678]: I1204 00:39:29.524072 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:29.524166 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:29.524166 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:29.524166 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:29.525358 master-0 kubenswrapper[8678]: I1204 00:39:29.524203 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:30.523118 master-0 kubenswrapper[8678]: I1204 00:39:30.523039 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:30.523118 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:30.523118 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:30.523118 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:30.523744 master-0 kubenswrapper[8678]: I1204 00:39:30.523162 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:31.524690 master-0 kubenswrapper[8678]: I1204 00:39:31.524472 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:31.524690 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:31.524690 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:31.524690 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:31.524690 master-0 kubenswrapper[8678]: I1204 00:39:31.524594 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:32.524997 master-0 kubenswrapper[8678]: I1204 00:39:32.524911 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:32.524997 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:32.524997 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:32.524997 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:32.526397 master-0 kubenswrapper[8678]: I1204 00:39:32.526344 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:33.524153 master-0 kubenswrapper[8678]: I1204 00:39:33.524056 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:33.524153 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:33.524153 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:33.524153 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:33.524548 master-0 kubenswrapper[8678]: I1204 00:39:33.524155 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:34.524461 master-0 kubenswrapper[8678]: I1204 00:39:34.524398 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:34.524461 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:34.524461 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:34.524461 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:34.525568 master-0 kubenswrapper[8678]: I1204 00:39:34.525168 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:35.523686 master-0 kubenswrapper[8678]: I1204 00:39:35.523597 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:35.523686 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:35.523686 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:35.523686 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:35.524164 master-0 kubenswrapper[8678]: I1204 00:39:35.523720 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:36.522953 master-0 kubenswrapper[8678]: I1204 00:39:36.522791 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:36.522953 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:36.522953 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:36.522953 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:36.523885 master-0 kubenswrapper[8678]: I1204 00:39:36.522979 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:37.522692 master-0 kubenswrapper[8678]: I1204 00:39:37.522529 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:37.522692 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:37.522692 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:37.522692 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:37.522692 master-0 kubenswrapper[8678]: I1204 00:39:37.522625 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:38.523343 master-0 kubenswrapper[8678]: I1204 00:39:38.523214 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:38.523343 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:38.523343 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:38.523343 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:38.523343 master-0 kubenswrapper[8678]: I1204 00:39:38.523338 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:39.522513 master-0 kubenswrapper[8678]: I1204 00:39:39.522451 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:39.522513 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:39.522513 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:39.522513 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:39.523156 master-0 kubenswrapper[8678]: I1204 00:39:39.523105 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:40.523434 master-0 kubenswrapper[8678]: I1204 00:39:40.523349 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:40.523434 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:40.523434 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:40.523434 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:40.524617 master-0 kubenswrapper[8678]: I1204 00:39:40.523446 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:41.524104 master-0 kubenswrapper[8678]: I1204 00:39:41.523996 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:41.524104 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:41.524104 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:41.524104 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:41.524104 master-0 kubenswrapper[8678]: I1204 00:39:41.524101 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:42.522797 master-0 kubenswrapper[8678]: I1204 00:39:42.522726 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:42.522797 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:42.522797 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:42.522797 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:42.523302 master-0 kubenswrapper[8678]: I1204 00:39:42.522810 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:43.522851 master-0 kubenswrapper[8678]: I1204 00:39:43.522791 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:43.522851 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:43.522851 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:43.522851 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:43.523506 master-0 kubenswrapper[8678]: I1204 00:39:43.522871 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:44.524182 master-0 kubenswrapper[8678]: I1204 00:39:44.524089 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:44.524182 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:44.524182 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:44.524182 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:44.525116 master-0 kubenswrapper[8678]: I1204 00:39:44.524192 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:45.522495 master-0 kubenswrapper[8678]: I1204 00:39:45.522424 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:45.522495 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:45.522495 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:45.522495 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:45.522495 master-0 kubenswrapper[8678]: I1204 00:39:45.522497 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:46.523070 master-0 kubenswrapper[8678]: I1204 00:39:46.523005 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:46.523070 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:46.523070 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:46.523070 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:46.523621 master-0 kubenswrapper[8678]: I1204 00:39:46.523078 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:47.523706 master-0 kubenswrapper[8678]: I1204 00:39:47.523561 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:47.523706 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:47.523706 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:47.523706 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:47.523706 master-0 kubenswrapper[8678]: I1204 00:39:47.523660 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:48.523410 master-0 kubenswrapper[8678]: I1204 00:39:48.523315 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:48.523410 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:48.523410 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:48.523410 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:48.524173 master-0 kubenswrapper[8678]: I1204 00:39:48.523447 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:48.747278 master-0 kubenswrapper[8678]: I1204 00:39:48.747160 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 00:39:48.748515 master-0 kubenswrapper[8678]: I1204 00:39:48.748464 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.752040 master-0 kubenswrapper[8678]: I1204 00:39:48.751972 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Dec 04 00:39:48.752194 master-0 kubenswrapper[8678]: I1204 00:39:48.752111 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"installer-sa-dockercfg-zcnpq" Dec 04 00:39:48.764604 master-0 kubenswrapper[8678]: I1204 00:39:48.764517 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 00:39:48.873188 master-0 kubenswrapper[8678]: I1204 00:39:48.873115 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.873188 master-0 kubenswrapper[8678]: I1204 00:39:48.873188 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.873580 master-0 kubenswrapper[8678]: I1204 00:39:48.873229 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.975603 master-0 kubenswrapper[8678]: I1204 00:39:48.975490 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.975957 master-0 kubenswrapper[8678]: I1204 00:39:48.975674 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.975957 master-0 kubenswrapper[8678]: I1204 00:39:48.975707 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.976197 master-0 kubenswrapper[8678]: I1204 00:39:48.976008 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:48.976315 master-0 kubenswrapper[8678]: I1204 00:39:48.976228 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:49.009429 master-0 kubenswrapper[8678]: I1204 00:39:49.009340 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access\") pod \"installer-5-master-0\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:49.097853 master-0 kubenswrapper[8678]: I1204 00:39:49.097766 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:39:49.523846 master-0 kubenswrapper[8678]: I1204 00:39:49.523681 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:49.523846 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:49.523846 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:49.523846 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:49.523846 master-0 kubenswrapper[8678]: I1204 00:39:49.523781 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:49.590156 master-0 kubenswrapper[8678]: I1204 00:39:49.590087 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 00:39:49.594368 master-0 kubenswrapper[8678]: W1204 00:39:49.594304 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode19d444a_d0b0_4af1_b570_9520818c5301.slice/crio-b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2 WatchSource:0}: Error finding container b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2: Status 404 returned error can't find the container with id b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2 Dec 04 00:39:49.726818 master-0 kubenswrapper[8678]: I1204 00:39:49.726736 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"e19d444a-d0b0-4af1-b570-9520818c5301","Type":"ContainerStarted","Data":"b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2"} Dec 04 00:39:50.523754 master-0 kubenswrapper[8678]: I1204 00:39:50.523669 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:50.523754 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:50.523754 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:50.523754 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:50.524562 master-0 kubenswrapper[8678]: I1204 00:39:50.523773 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:50.742662 master-0 kubenswrapper[8678]: I1204 00:39:50.742576 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"e19d444a-d0b0-4af1-b570-9520818c5301","Type":"ContainerStarted","Data":"fc6a8239895c17505831104a4cf49245de0e35d1e9d9bb79accb330ffddf2c66"} Dec 04 00:39:50.773593 master-0 kubenswrapper[8678]: I1204 00:39:50.773475 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-5-master-0" podStartSLOduration=2.773443881 podStartE2EDuration="2.773443881s" podCreationTimestamp="2025-12-04 00:39:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:39:50.767807652 +0000 UTC m=+574.094540268" watchObservedRunningTime="2025-12-04 00:39:50.773443881 +0000 UTC m=+574.100176477" Dec 04 00:39:51.523845 master-0 kubenswrapper[8678]: I1204 00:39:51.523733 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:51.523845 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:51.523845 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:51.523845 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:51.524905 master-0 kubenswrapper[8678]: I1204 00:39:51.523845 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:52.523466 master-0 kubenswrapper[8678]: I1204 00:39:52.523361 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:52.523466 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:52.523466 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:52.523466 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:52.523466 master-0 kubenswrapper[8678]: I1204 00:39:52.523444 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:53.523352 master-0 kubenswrapper[8678]: I1204 00:39:53.523073 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:53.523352 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:53.523352 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:53.523352 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:53.524550 master-0 kubenswrapper[8678]: I1204 00:39:53.523366 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:54.523748 master-0 kubenswrapper[8678]: I1204 00:39:54.523643 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:54.523748 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:54.523748 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:54.523748 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:54.524482 master-0 kubenswrapper[8678]: I1204 00:39:54.523771 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:55.522864 master-0 kubenswrapper[8678]: I1204 00:39:55.522752 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:55.522864 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:55.522864 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:55.522864 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:55.523360 master-0 kubenswrapper[8678]: I1204 00:39:55.522872 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:56.523645 master-0 kubenswrapper[8678]: I1204 00:39:56.523457 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:56.523645 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:56.523645 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:56.523645 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:56.524606 master-0 kubenswrapper[8678]: I1204 00:39:56.523638 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:57.523004 master-0 kubenswrapper[8678]: I1204 00:39:57.522800 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:57.523004 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:57.523004 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:57.523004 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:57.523004 master-0 kubenswrapper[8678]: I1204 00:39:57.522909 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:58.524407 master-0 kubenswrapper[8678]: I1204 00:39:58.524301 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:58.524407 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:58.524407 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:58.524407 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:58.525355 master-0 kubenswrapper[8678]: I1204 00:39:58.524408 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:39:59.523425 master-0 kubenswrapper[8678]: I1204 00:39:59.523352 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:39:59.523425 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:39:59.523425 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:39:59.523425 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:39:59.523806 master-0 kubenswrapper[8678]: I1204 00:39:59.523426 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:00.523465 master-0 kubenswrapper[8678]: I1204 00:40:00.523377 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:00.523465 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:00.523465 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:00.523465 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:00.524579 master-0 kubenswrapper[8678]: I1204 00:40:00.523480 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:01.524333 master-0 kubenswrapper[8678]: I1204 00:40:01.524233 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:01.524333 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:01.524333 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:01.524333 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:01.525641 master-0 kubenswrapper[8678]: I1204 00:40:01.524336 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:02.523382 master-0 kubenswrapper[8678]: I1204 00:40:02.523276 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:02.523382 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:02.523382 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:02.523382 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:02.524028 master-0 kubenswrapper[8678]: I1204 00:40:02.523389 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:03.521995 master-0 kubenswrapper[8678]: I1204 00:40:03.521887 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:03.521995 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:03.521995 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:03.521995 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:03.522717 master-0 kubenswrapper[8678]: I1204 00:40:03.522037 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:04.523788 master-0 kubenswrapper[8678]: I1204 00:40:04.523697 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:04.523788 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:04.523788 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:04.523788 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:04.524516 master-0 kubenswrapper[8678]: I1204 00:40:04.523811 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:04.539784 master-0 kubenswrapper[8678]: I1204 00:40:04.539725 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 00:40:04.541172 master-0 kubenswrapper[8678]: I1204 00:40:04.541149 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.542613 master-0 kubenswrapper[8678]: I1204 00:40:04.542540 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.542613 master-0 kubenswrapper[8678]: I1204 00:40:04.542602 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.542758 master-0 kubenswrapper[8678]: I1204 00:40:04.542660 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.543947 master-0 kubenswrapper[8678]: I1204 00:40:04.543877 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-sx5bk" Dec 04 00:40:04.545195 master-0 kubenswrapper[8678]: I1204 00:40:04.545150 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Dec 04 00:40:04.557562 master-0 kubenswrapper[8678]: I1204 00:40:04.557396 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 00:40:04.644729 master-0 kubenswrapper[8678]: I1204 00:40:04.644582 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.644729 master-0 kubenswrapper[8678]: I1204 00:40:04.644705 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.645178 master-0 kubenswrapper[8678]: I1204 00:40:04.644909 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.645178 master-0 kubenswrapper[8678]: I1204 00:40:04.644954 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.645281 master-0 kubenswrapper[8678]: I1204 00:40:04.645016 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.660687 master-0 kubenswrapper[8678]: I1204 00:40:04.660634 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access\") pod \"installer-2-master-0\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:04.869463 master-0 kubenswrapper[8678]: I1204 00:40:04.869357 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:05.315584 master-0 kubenswrapper[8678]: I1204 00:40:05.315538 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 00:40:05.323290 master-0 kubenswrapper[8678]: W1204 00:40:05.323235 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19deb5f6_135d_4a17_8eb8_7b996f4f2e9f.slice/crio-6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa WatchSource:0}: Error finding container 6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa: Status 404 returned error can't find the container with id 6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa Dec 04 00:40:05.522207 master-0 kubenswrapper[8678]: I1204 00:40:05.522139 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:05.522207 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:05.522207 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:05.522207 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:05.522506 master-0 kubenswrapper[8678]: I1204 00:40:05.522266 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:05.865724 master-0 kubenswrapper[8678]: I1204 00:40:05.865327 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f","Type":"ContainerStarted","Data":"4118fa7c7b8720a6318c70d78a37012ba48f750c5f42e27c8bad625646cee34f"} Dec 04 00:40:05.866690 master-0 kubenswrapper[8678]: I1204 00:40:05.866651 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f","Type":"ContainerStarted","Data":"6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa"} Dec 04 00:40:05.893813 master-0 kubenswrapper[8678]: I1204 00:40:05.893520 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-2-master-0" podStartSLOduration=1.893423194 podStartE2EDuration="1.893423194s" podCreationTimestamp="2025-12-04 00:40:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:40:05.890909513 +0000 UTC m=+589.217642109" watchObservedRunningTime="2025-12-04 00:40:05.893423194 +0000 UTC m=+589.220155810" Dec 04 00:40:06.522897 master-0 kubenswrapper[8678]: I1204 00:40:06.522801 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:06.522897 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:06.522897 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:06.522897 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:06.522897 master-0 kubenswrapper[8678]: I1204 00:40:06.522897 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:07.523379 master-0 kubenswrapper[8678]: I1204 00:40:07.523193 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:07.523379 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:07.523379 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:07.523379 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:07.523379 master-0 kubenswrapper[8678]: I1204 00:40:07.523274 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:08.523995 master-0 kubenswrapper[8678]: I1204 00:40:08.523887 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:08.523995 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:08.523995 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:08.523995 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:08.524822 master-0 kubenswrapper[8678]: I1204 00:40:08.524032 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:09.524023 master-0 kubenswrapper[8678]: I1204 00:40:09.523878 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:09.524023 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:09.524023 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:09.524023 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:09.525059 master-0 kubenswrapper[8678]: I1204 00:40:09.524103 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:10.522641 master-0 kubenswrapper[8678]: I1204 00:40:10.522531 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:10.522641 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:10.522641 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:10.522641 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:10.522966 master-0 kubenswrapper[8678]: I1204 00:40:10.522655 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:11.523921 master-0 kubenswrapper[8678]: I1204 00:40:11.523832 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:11.523921 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:11.523921 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:11.523921 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:11.524684 master-0 kubenswrapper[8678]: I1204 00:40:11.523966 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:12.523567 master-0 kubenswrapper[8678]: I1204 00:40:12.523505 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:12.523567 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:12.523567 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:12.523567 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:12.524778 master-0 kubenswrapper[8678]: I1204 00:40:12.524513 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:13.523117 master-0 kubenswrapper[8678]: I1204 00:40:13.523017 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:13.523117 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:13.523117 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:13.523117 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:13.523117 master-0 kubenswrapper[8678]: I1204 00:40:13.523083 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:14.532151 master-0 kubenswrapper[8678]: I1204 00:40:14.532066 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:14.532151 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:14.532151 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:14.532151 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:14.532916 master-0 kubenswrapper[8678]: I1204 00:40:14.532174 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:15.523429 master-0 kubenswrapper[8678]: I1204 00:40:15.523356 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:15.523429 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:15.523429 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:15.523429 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:15.523800 master-0 kubenswrapper[8678]: I1204 00:40:15.523441 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:16.523396 master-0 kubenswrapper[8678]: I1204 00:40:16.523304 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:16.523396 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:16.523396 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:16.523396 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:16.524610 master-0 kubenswrapper[8678]: I1204 00:40:16.523417 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:17.524443 master-0 kubenswrapper[8678]: I1204 00:40:17.524310 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:17.524443 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:17.524443 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:17.524443 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:17.524443 master-0 kubenswrapper[8678]: I1204 00:40:17.524392 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:18.524696 master-0 kubenswrapper[8678]: I1204 00:40:18.524589 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:18.524696 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:18.524696 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:18.524696 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:18.526299 master-0 kubenswrapper[8678]: I1204 00:40:18.524705 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:19.530507 master-0 kubenswrapper[8678]: I1204 00:40:19.530382 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:19.530507 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:19.530507 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:19.530507 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:19.530507 master-0 kubenswrapper[8678]: I1204 00:40:19.530493 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:20.524370 master-0 kubenswrapper[8678]: I1204 00:40:20.524282 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:20.524370 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:20.524370 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:20.524370 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:20.524813 master-0 kubenswrapper[8678]: I1204 00:40:20.524406 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:21.482526 master-0 kubenswrapper[8678]: E1204 00:40:21.482441 8678 file.go:109] "Unable to process watch event" err="can't process config file \"/etc/kubernetes/manifests/kube-scheduler-pod.yaml\": /etc/kubernetes/manifests/kube-scheduler-pod.yaml: couldn't parse as pod(Object 'Kind' is missing in 'null'), please check config file" Dec 04 00:40:21.483681 master-0 kubenswrapper[8678]: I1204 00:40:21.483629 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:40:21.484332 master-0 kubenswrapper[8678]: I1204 00:40:21.484266 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler" containerID="cri-o://e76c5c944117a73ac8803ecb0df1d95186e0d91b8c04b7625cfb1438afafe09e" gracePeriod=30 Dec 04 00:40:21.484568 master-0 kubenswrapper[8678]: I1204 00:40:21.484439 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-cert-syncer" containerID="cri-o://1300eec5b13e1deefbf3fca03fc706b8741b7b845c75e9d289332ec08965e0c6" gracePeriod=30 Dec 04 00:40:21.484675 master-0 kubenswrapper[8678]: I1204 00:40:21.484321 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-recovery-controller" containerID="cri-o://48c67116d49ad7cd921e7ddab5b35648b4c4d5a88ba326ed611b27fed4143751" gracePeriod=30 Dec 04 00:40:21.485081 master-0 kubenswrapper[8678]: I1204 00:40:21.485023 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: E1204 00:40:21.485460 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485485 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: E1204 00:40:21.485513 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-recovery-controller" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485528 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-recovery-controller" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: E1204 00:40:21.485548 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="wait-for-host-port" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485561 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="wait-for-host-port" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: E1204 00:40:21.485582 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-cert-syncer" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485595 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-cert-syncer" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485795 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-cert-syncer" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485831 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler-recovery-controller" Dec 04 00:40:21.486246 master-0 kubenswrapper[8678]: I1204 00:40:21.485854 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46583dca69d50bb12bc004d7ee3300f" containerName="kube-scheduler" Dec 04 00:40:21.523694 master-0 kubenswrapper[8678]: I1204 00:40:21.523609 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:21.523694 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:21.523694 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:21.523694 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:21.524133 master-0 kubenswrapper[8678]: I1204 00:40:21.523723 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:21.623061 master-0 kubenswrapper[8678]: I1204 00:40:21.623004 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:21.623480 master-0 kubenswrapper[8678]: I1204 00:40:21.623458 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:21.725973 master-0 kubenswrapper[8678]: I1204 00:40:21.725840 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:21.726236 master-0 kubenswrapper[8678]: I1204 00:40:21.725988 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:21.726236 master-0 kubenswrapper[8678]: I1204 00:40:21.726060 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:21.726323 master-0 kubenswrapper[8678]: I1204 00:40:21.726227 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:22.031014 master-0 kubenswrapper[8678]: I1204 00:40:22.030857 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/kube-scheduler-cert-syncer/0.log" Dec 04 00:40:22.032156 master-0 kubenswrapper[8678]: I1204 00:40:22.032071 8678 generic.go:334] "Generic (PLEG): container finished" podID="c46583dca69d50bb12bc004d7ee3300f" containerID="48c67116d49ad7cd921e7ddab5b35648b4c4d5a88ba326ed611b27fed4143751" exitCode=0 Dec 04 00:40:22.032156 master-0 kubenswrapper[8678]: I1204 00:40:22.032129 8678 generic.go:334] "Generic (PLEG): container finished" podID="c46583dca69d50bb12bc004d7ee3300f" containerID="1300eec5b13e1deefbf3fca03fc706b8741b7b845c75e9d289332ec08965e0c6" exitCode=2 Dec 04 00:40:22.032156 master-0 kubenswrapper[8678]: I1204 00:40:22.032142 8678 generic.go:334] "Generic (PLEG): container finished" podID="c46583dca69d50bb12bc004d7ee3300f" containerID="e76c5c944117a73ac8803ecb0df1d95186e0d91b8c04b7625cfb1438afafe09e" exitCode=0 Dec 04 00:40:22.032495 master-0 kubenswrapper[8678]: I1204 00:40:22.032256 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73c4321c3184643e78e996b2b24e658f8fd8a31dc0a9de50c928e0b4ae744fae" Dec 04 00:40:22.034547 master-0 kubenswrapper[8678]: I1204 00:40:22.034496 8678 generic.go:334] "Generic (PLEG): container finished" podID="e19d444a-d0b0-4af1-b570-9520818c5301" containerID="fc6a8239895c17505831104a4cf49245de0e35d1e9d9bb79accb330ffddf2c66" exitCode=0 Dec 04 00:40:22.034547 master-0 kubenswrapper[8678]: I1204 00:40:22.034530 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"e19d444a-d0b0-4af1-b570-9520818c5301","Type":"ContainerDied","Data":"fc6a8239895c17505831104a4cf49245de0e35d1e9d9bb79accb330ffddf2c66"} Dec 04 00:40:22.038620 master-0 kubenswrapper[8678]: I1204 00:40:22.038548 8678 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="c46583dca69d50bb12bc004d7ee3300f" podUID="fd2fa610bb2a39c39fcdd00db03a511a" Dec 04 00:40:22.109075 master-0 kubenswrapper[8678]: I1204 00:40:22.109014 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_c46583dca69d50bb12bc004d7ee3300f/kube-scheduler-cert-syncer/0.log" Dec 04 00:40:22.110857 master-0 kubenswrapper[8678]: I1204 00:40:22.110808 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:22.193657 master-0 kubenswrapper[8678]: I1204 00:40:22.193580 8678 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="c46583dca69d50bb12bc004d7ee3300f" podUID="fd2fa610bb2a39c39fcdd00db03a511a" Dec 04 00:40:22.233484 master-0 kubenswrapper[8678]: I1204 00:40:22.233079 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir\") pod \"c46583dca69d50bb12bc004d7ee3300f\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " Dec 04 00:40:22.233801 master-0 kubenswrapper[8678]: I1204 00:40:22.233499 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir\") pod \"c46583dca69d50bb12bc004d7ee3300f\" (UID: \"c46583dca69d50bb12bc004d7ee3300f\") " Dec 04 00:40:22.234052 master-0 kubenswrapper[8678]: I1204 00:40:22.233989 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "c46583dca69d50bb12bc004d7ee3300f" (UID: "c46583dca69d50bb12bc004d7ee3300f"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:22.234194 master-0 kubenswrapper[8678]: I1204 00:40:22.234056 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "c46583dca69d50bb12bc004d7ee3300f" (UID: "c46583dca69d50bb12bc004d7ee3300f"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:22.336054 master-0 kubenswrapper[8678]: I1204 00:40:22.335995 8678 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:22.336354 master-0 kubenswrapper[8678]: I1204 00:40:22.336339 8678 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c46583dca69d50bb12bc004d7ee3300f-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:22.525155 master-0 kubenswrapper[8678]: I1204 00:40:22.525009 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:22.525155 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:22.525155 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:22.525155 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:22.526232 master-0 kubenswrapper[8678]: I1204 00:40:22.526155 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:22.863362 master-0 kubenswrapper[8678]: I1204 00:40:22.863222 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46583dca69d50bb12bc004d7ee3300f" path="/var/lib/kubelet/pods/c46583dca69d50bb12bc004d7ee3300f/volumes" Dec 04 00:40:23.041306 master-0 kubenswrapper[8678]: I1204 00:40:23.041240 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:23.060480 master-0 kubenswrapper[8678]: I1204 00:40:23.060429 8678 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="c46583dca69d50bb12bc004d7ee3300f" podUID="fd2fa610bb2a39c39fcdd00db03a511a" Dec 04 00:40:23.364695 master-0 kubenswrapper[8678]: I1204 00:40:23.364597 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:40:23.453065 master-0 kubenswrapper[8678]: I1204 00:40:23.452818 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock\") pod \"e19d444a-d0b0-4af1-b570-9520818c5301\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " Dec 04 00:40:23.453065 master-0 kubenswrapper[8678]: I1204 00:40:23.452908 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir\") pod \"e19d444a-d0b0-4af1-b570-9520818c5301\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " Dec 04 00:40:23.453471 master-0 kubenswrapper[8678]: I1204 00:40:23.453069 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock" (OuterVolumeSpecName: "var-lock") pod "e19d444a-d0b0-4af1-b570-9520818c5301" (UID: "e19d444a-d0b0-4af1-b570-9520818c5301"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:23.453471 master-0 kubenswrapper[8678]: I1204 00:40:23.453124 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access\") pod \"e19d444a-d0b0-4af1-b570-9520818c5301\" (UID: \"e19d444a-d0b0-4af1-b570-9520818c5301\") " Dec 04 00:40:23.453471 master-0 kubenswrapper[8678]: I1204 00:40:23.453178 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "e19d444a-d0b0-4af1-b570-9520818c5301" (UID: "e19d444a-d0b0-4af1-b570-9520818c5301"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:23.454289 master-0 kubenswrapper[8678]: I1204 00:40:23.454234 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:23.454289 master-0 kubenswrapper[8678]: I1204 00:40:23.454269 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e19d444a-d0b0-4af1-b570-9520818c5301-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:23.457279 master-0 kubenswrapper[8678]: I1204 00:40:23.457219 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "e19d444a-d0b0-4af1-b570-9520818c5301" (UID: "e19d444a-d0b0-4af1-b570-9520818c5301"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:40:23.506435 master-0 kubenswrapper[8678]: I1204 00:40:23.506381 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:40:23.506989 master-0 kubenswrapper[8678]: I1204 00:40:23.506633 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" containerID="cri-o://df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b" gracePeriod=30 Dec 04 00:40:23.524286 master-0 kubenswrapper[8678]: I1204 00:40:23.524189 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:23.524286 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:23.524286 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:23.524286 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:23.524286 master-0 kubenswrapper[8678]: I1204 00:40:23.524262 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:23.556133 master-0 kubenswrapper[8678]: I1204 00:40:23.556050 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e19d444a-d0b0-4af1-b570-9520818c5301-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:23.682514 master-0 kubenswrapper[8678]: I1204 00:40:23.682437 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:40:23.682766 master-0 kubenswrapper[8678]: I1204 00:40:23.682731 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" podUID="187031e5-1d74-4d95-8163-d0c46e8e6734" containerName="route-controller-manager" containerID="cri-o://b8e242238e9bbc63620508dabeaccc004f016f449e6a4a22f8f976464721a60c" gracePeriod=30 Dec 04 00:40:23.941458 master-0 kubenswrapper[8678]: I1204 00:40:23.941426 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:40:24.058507 master-0 kubenswrapper[8678]: I1204 00:40:24.058377 8678 generic.go:334] "Generic (PLEG): container finished" podID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerID="df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b" exitCode=0 Dec 04 00:40:24.058507 master-0 kubenswrapper[8678]: I1204 00:40:24.058461 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerDied","Data":"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b"} Dec 04 00:40:24.058507 master-0 kubenswrapper[8678]: I1204 00:40:24.058496 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" event={"ID":"cad761d1-d42c-4e56-9220-73ea1678eef5","Type":"ContainerDied","Data":"e66b9d70cab55e01eb0fe4b058f0e6e54c3713e0eb6e4eb2664bc7df24d12174"} Dec 04 00:40:24.058797 master-0 kubenswrapper[8678]: I1204 00:40:24.058519 8678 scope.go:117] "RemoveContainer" containerID="df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b" Dec 04 00:40:24.058797 master-0 kubenswrapper[8678]: I1204 00:40:24.058672 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5bbbf854f-x8c6r" Dec 04 00:40:24.061573 master-0 kubenswrapper[8678]: I1204 00:40:24.061536 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"e19d444a-d0b0-4af1-b570-9520818c5301","Type":"ContainerDied","Data":"b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2"} Dec 04 00:40:24.061573 master-0 kubenswrapper[8678]: I1204 00:40:24.061571 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2" Dec 04 00:40:24.061654 master-0 kubenswrapper[8678]: I1204 00:40:24.061617 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:40:24.064712 master-0 kubenswrapper[8678]: I1204 00:40:24.064663 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5rcl\" (UniqueName: \"kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl\") pod \"cad761d1-d42c-4e56-9220-73ea1678eef5\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " Dec 04 00:40:24.064786 master-0 kubenswrapper[8678]: I1204 00:40:24.064739 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config\") pod \"cad761d1-d42c-4e56-9220-73ea1678eef5\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " Dec 04 00:40:24.064938 master-0 kubenswrapper[8678]: I1204 00:40:24.064789 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles\") pod \"cad761d1-d42c-4e56-9220-73ea1678eef5\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " Dec 04 00:40:24.065145 master-0 kubenswrapper[8678]: I1204 00:40:24.065017 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca\") pod \"cad761d1-d42c-4e56-9220-73ea1678eef5\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " Dec 04 00:40:24.065145 master-0 kubenswrapper[8678]: I1204 00:40:24.065104 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert\") pod \"cad761d1-d42c-4e56-9220-73ea1678eef5\" (UID: \"cad761d1-d42c-4e56-9220-73ea1678eef5\") " Dec 04 00:40:24.065901 master-0 kubenswrapper[8678]: I1204 00:40:24.065735 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "cad761d1-d42c-4e56-9220-73ea1678eef5" (UID: "cad761d1-d42c-4e56-9220-73ea1678eef5"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:40:24.065977 master-0 kubenswrapper[8678]: I1204 00:40:24.065946 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config" (OuterVolumeSpecName: "config") pod "cad761d1-d42c-4e56-9220-73ea1678eef5" (UID: "cad761d1-d42c-4e56-9220-73ea1678eef5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:40:24.066104 master-0 kubenswrapper[8678]: I1204 00:40:24.066058 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca" (OuterVolumeSpecName: "client-ca") pod "cad761d1-d42c-4e56-9220-73ea1678eef5" (UID: "cad761d1-d42c-4e56-9220-73ea1678eef5"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:40:24.066658 master-0 kubenswrapper[8678]: I1204 00:40:24.066621 8678 generic.go:334] "Generic (PLEG): container finished" podID="187031e5-1d74-4d95-8163-d0c46e8e6734" containerID="b8e242238e9bbc63620508dabeaccc004f016f449e6a4a22f8f976464721a60c" exitCode=0 Dec 04 00:40:24.066726 master-0 kubenswrapper[8678]: I1204 00:40:24.066673 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" event={"ID":"187031e5-1d74-4d95-8163-d0c46e8e6734","Type":"ContainerDied","Data":"b8e242238e9bbc63620508dabeaccc004f016f449e6a4a22f8f976464721a60c"} Dec 04 00:40:24.068364 master-0 kubenswrapper[8678]: I1204 00:40:24.068327 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "cad761d1-d42c-4e56-9220-73ea1678eef5" (UID: "cad761d1-d42c-4e56-9220-73ea1678eef5"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:40:24.074543 master-0 kubenswrapper[8678]: I1204 00:40:24.074494 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl" (OuterVolumeSpecName: "kube-api-access-c5rcl") pod "cad761d1-d42c-4e56-9220-73ea1678eef5" (UID: "cad761d1-d42c-4e56-9220-73ea1678eef5"). InnerVolumeSpecName "kube-api-access-c5rcl". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:40:24.077642 master-0 kubenswrapper[8678]: I1204 00:40:24.077611 8678 scope.go:117] "RemoveContainer" containerID="db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00" Dec 04 00:40:24.093504 master-0 kubenswrapper[8678]: I1204 00:40:24.093456 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:40:24.095144 master-0 kubenswrapper[8678]: I1204 00:40:24.095115 8678 scope.go:117] "RemoveContainer" containerID="df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b" Dec 04 00:40:24.095552 master-0 kubenswrapper[8678]: E1204 00:40:24.095521 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b\": container with ID starting with df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b not found: ID does not exist" containerID="df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b" Dec 04 00:40:24.095654 master-0 kubenswrapper[8678]: I1204 00:40:24.095556 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b"} err="failed to get container status \"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b\": rpc error: code = NotFound desc = could not find container \"df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b\": container with ID starting with df2e1e4a88142b5907647b5afdaf98ea5569aa4ccc9de4093680e6e537ec400b not found: ID does not exist" Dec 04 00:40:24.095654 master-0 kubenswrapper[8678]: I1204 00:40:24.095580 8678 scope.go:117] "RemoveContainer" containerID="db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00" Dec 04 00:40:24.096135 master-0 kubenswrapper[8678]: E1204 00:40:24.096021 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00\": container with ID starting with db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00 not found: ID does not exist" containerID="db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00" Dec 04 00:40:24.096135 master-0 kubenswrapper[8678]: I1204 00:40:24.096072 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00"} err="failed to get container status \"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00\": rpc error: code = NotFound desc = could not find container \"db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00\": container with ID starting with db43faae7a207bc2d962f1e8b3be1023647133b51579ed002879cbef11202f00 not found: ID does not exist" Dec 04 00:40:24.166242 master-0 kubenswrapper[8678]: I1204 00:40:24.166171 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-569fm\" (UniqueName: \"kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm\") pod \"187031e5-1d74-4d95-8163-d0c46e8e6734\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " Dec 04 00:40:24.166515 master-0 kubenswrapper[8678]: I1204 00:40:24.166305 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca\") pod \"187031e5-1d74-4d95-8163-d0c46e8e6734\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " Dec 04 00:40:24.166515 master-0 kubenswrapper[8678]: I1204 00:40:24.166478 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert\") pod \"187031e5-1d74-4d95-8163-d0c46e8e6734\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " Dec 04 00:40:24.166604 master-0 kubenswrapper[8678]: I1204 00:40:24.166531 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config\") pod \"187031e5-1d74-4d95-8163-d0c46e8e6734\" (UID: \"187031e5-1d74-4d95-8163-d0c46e8e6734\") " Dec 04 00:40:24.167051 master-0 kubenswrapper[8678]: I1204 00:40:24.167010 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c5rcl\" (UniqueName: \"kubernetes.io/projected/cad761d1-d42c-4e56-9220-73ea1678eef5-kube-api-access-c5rcl\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.167102 master-0 kubenswrapper[8678]: I1204 00:40:24.167052 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.167102 master-0 kubenswrapper[8678]: I1204 00:40:24.167075 8678 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.167102 master-0 kubenswrapper[8678]: I1204 00:40:24.167093 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cad761d1-d42c-4e56-9220-73ea1678eef5-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.167191 master-0 kubenswrapper[8678]: I1204 00:40:24.167112 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad761d1-d42c-4e56-9220-73ea1678eef5-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.168822 master-0 kubenswrapper[8678]: I1204 00:40:24.168761 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config" (OuterVolumeSpecName: "config") pod "187031e5-1d74-4d95-8163-d0c46e8e6734" (UID: "187031e5-1d74-4d95-8163-d0c46e8e6734"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:40:24.170680 master-0 kubenswrapper[8678]: I1204 00:40:24.170342 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca" (OuterVolumeSpecName: "client-ca") pod "187031e5-1d74-4d95-8163-d0c46e8e6734" (UID: "187031e5-1d74-4d95-8163-d0c46e8e6734"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:40:24.193294 master-0 kubenswrapper[8678]: I1204 00:40:24.193240 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "187031e5-1d74-4d95-8163-d0c46e8e6734" (UID: "187031e5-1d74-4d95-8163-d0c46e8e6734"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:40:24.195142 master-0 kubenswrapper[8678]: I1204 00:40:24.195070 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm" (OuterVolumeSpecName: "kube-api-access-569fm") pod "187031e5-1d74-4d95-8163-d0c46e8e6734" (UID: "187031e5-1d74-4d95-8163-d0c46e8e6734"). InnerVolumeSpecName "kube-api-access-569fm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:40:24.268422 master-0 kubenswrapper[8678]: I1204 00:40:24.268329 8678 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/187031e5-1d74-4d95-8163-d0c46e8e6734-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.268422 master-0 kubenswrapper[8678]: I1204 00:40:24.268374 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.268422 master-0 kubenswrapper[8678]: I1204 00:40:24.268388 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-569fm\" (UniqueName: \"kubernetes.io/projected/187031e5-1d74-4d95-8163-d0c46e8e6734-kube-api-access-569fm\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.268422 master-0 kubenswrapper[8678]: I1204 00:40:24.268400 8678 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/187031e5-1d74-4d95-8163-d0c46e8e6734-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:24.402907 master-0 kubenswrapper[8678]: I1204 00:40:24.402830 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:40:24.428008 master-0 kubenswrapper[8678]: I1204 00:40:24.427919 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-5bbbf854f-x8c6r"] Dec 04 00:40:24.524854 master-0 kubenswrapper[8678]: I1204 00:40:24.524770 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:24.524854 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:24.524854 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:24.524854 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:24.525213 master-0 kubenswrapper[8678]: I1204 00:40:24.524861 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:24.863292 master-0 kubenswrapper[8678]: I1204 00:40:24.863211 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" path="/var/lib/kubelet/pods/cad761d1-d42c-4e56-9220-73ea1678eef5/volumes" Dec 04 00:40:25.075380 master-0 kubenswrapper[8678]: I1204 00:40:25.075312 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" event={"ID":"187031e5-1d74-4d95-8163-d0c46e8e6734","Type":"ContainerDied","Data":"fd706b1b34f264c9e738d9898089f6a639826d7ffe04c12ca3feba1d6691d6a4"} Dec 04 00:40:25.075380 master-0 kubenswrapper[8678]: I1204 00:40:25.075375 8678 scope.go:117] "RemoveContainer" containerID="b8e242238e9bbc63620508dabeaccc004f016f449e6a4a22f8f976464721a60c" Dec 04 00:40:25.075670 master-0 kubenswrapper[8678]: I1204 00:40:25.075464 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp" Dec 04 00:40:25.240122 master-0 kubenswrapper[8678]: I1204 00:40:25.239678 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:40:25.414088 master-0 kubenswrapper[8678]: I1204 00:40:25.413996 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-ccff84fcd-dbncp"] Dec 04 00:40:25.524004 master-0 kubenswrapper[8678]: I1204 00:40:25.523788 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:25.524004 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:25.524004 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:25.524004 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:25.524004 master-0 kubenswrapper[8678]: I1204 00:40:25.523910 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:26.522802 master-0 kubenswrapper[8678]: I1204 00:40:26.522753 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:26.522802 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:26.522802 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:26.522802 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:26.523409 master-0 kubenswrapper[8678]: I1204 00:40:26.522812 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:26.858112 master-0 kubenswrapper[8678]: I1204 00:40:26.858050 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187031e5-1d74-4d95-8163-d0c46e8e6734" path="/var/lib/kubelet/pods/187031e5-1d74-4d95-8163-d0c46e8e6734/volumes" Dec 04 00:40:27.522615 master-0 kubenswrapper[8678]: I1204 00:40:27.522422 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:27.522615 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:27.522615 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:27.522615 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:27.522615 master-0 kubenswrapper[8678]: I1204 00:40:27.522535 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:28.523659 master-0 kubenswrapper[8678]: I1204 00:40:28.523538 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:28.523659 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:28.523659 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:28.523659 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:28.524483 master-0 kubenswrapper[8678]: I1204 00:40:28.523674 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:29.522097 master-0 kubenswrapper[8678]: I1204 00:40:29.521975 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:40:29.522097 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:40:29.522097 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:40:29.522097 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:40:29.522755 master-0 kubenswrapper[8678]: I1204 00:40:29.522124 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:40:29.522755 master-0 kubenswrapper[8678]: I1204 00:40:29.522228 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:40:29.523531 master-0 kubenswrapper[8678]: I1204 00:40:29.523472 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="router" containerStatusID={"Type":"cri-o","ID":"e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632"} pod="openshift-ingress/router-default-54f97f57-x27s4" containerMessage="Container router failed startup probe, will be restarted" Dec 04 00:40:29.523615 master-0 kubenswrapper[8678]: I1204 00:40:29.523569 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" containerID="cri-o://e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632" gracePeriod=3600 Dec 04 00:40:36.850136 master-0 kubenswrapper[8678]: I1204 00:40:36.850030 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:36.880477 master-0 kubenswrapper[8678]: I1204 00:40:36.880391 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="11fc5a4f-b700-4af7-ba41-d564e83ea131" Dec 04 00:40:36.880477 master-0 kubenswrapper[8678]: I1204 00:40:36.880460 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="11fc5a4f-b700-4af7-ba41-d564e83ea131" Dec 04 00:40:36.901414 master-0 kubenswrapper[8678]: I1204 00:40:36.901330 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:40:36.906044 master-0 kubenswrapper[8678]: I1204 00:40:36.905599 8678 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:36.913608 master-0 kubenswrapper[8678]: I1204 00:40:36.913541 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:40:36.923015 master-0 kubenswrapper[8678]: I1204 00:40:36.922923 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 00:40:36.923219 master-0 kubenswrapper[8678]: I1204 00:40:36.923160 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:40:36.923576 master-0 kubenswrapper[8678]: I1204 00:40:36.923535 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:36.923823 master-0 kubenswrapper[8678]: I1204 00:40:36.923778 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-readyz" containerID="cri-o://82ff8e87e5ae91c2dd0d02f9048d75269a6a042664e9b18b5e0da259157ab00c" gracePeriod=30 Dec 04 00:40:36.923899 master-0 kubenswrapper[8678]: I1204 00:40:36.923832 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-rev" containerID="cri-o://c6ba48b68ff9ed2a1ef53e045da181c07e856273e5cda13989812c5e51dcbd8f" gracePeriod=30 Dec 04 00:40:36.923995 master-0 kubenswrapper[8678]: I1204 00:40:36.923800 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcdctl" containerID="cri-o://bf036457c891374f07b3971f201af28348584fd8bc55d027f138b68845a7f9c5" gracePeriod=30 Dec 04 00:40:36.924050 master-0 kubenswrapper[8678]: I1204 00:40:36.923776 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-metrics" containerID="cri-o://3de93b93248fc37e1dc44ecdda58bfd5dbe10fdf2a3e5f6252c1f2d6c155905a" gracePeriod=30 Dec 04 00:40:36.924128 master-0 kubenswrapper[8678]: I1204 00:40:36.923970 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd" containerID="cri-o://7ab30ae3e317040e0131f176b2a07b785a6c1bff67d196756458ee2d14c0ccce" gracePeriod=30 Dec 04 00:40:36.927033 master-0 kubenswrapper[8678]: I1204 00:40:36.926994 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:40:36.927303 master-0 kubenswrapper[8678]: E1204 00:40:36.927278 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-ensure-env-vars" Dec 04 00:40:36.927303 master-0 kubenswrapper[8678]: I1204 00:40:36.927301 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-ensure-env-vars" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: E1204 00:40:36.927313 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-readyz" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: I1204 00:40:36.927322 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-readyz" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: E1204 00:40:36.927337 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-metrics" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: I1204 00:40:36.927345 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-metrics" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: E1204 00:40:36.927360 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: I1204 00:40:36.927368 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: E1204 00:40:36.927383 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcdctl" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: I1204 00:40:36.927391 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcdctl" Dec 04 00:40:36.927395 master-0 kubenswrapper[8678]: E1204 00:40:36.927400 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="setup" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927409 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="setup" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927421 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-rev" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927428 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-rev" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927447 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="187031e5-1d74-4d95-8163-d0c46e8e6734" containerName="route-controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927457 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="187031e5-1d74-4d95-8163-d0c46e8e6734" containerName="route-controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927470 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927479 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927493 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927501 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927515 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-resources-copy" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927524 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-resources-copy" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: E1204 00:40:36.927536 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927544 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927681 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927699 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-metrics" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927709 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927721 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-rev" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927734 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd" Dec 04 00:40:36.927730 master-0 kubenswrapper[8678]: I1204 00:40:36.927743 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcd-readyz" Dec 04 00:40:36.928559 master-0 kubenswrapper[8678]: I1204 00:40:36.927756 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="cad761d1-d42c-4e56-9220-73ea1678eef5" containerName="controller-manager" Dec 04 00:40:36.928559 master-0 kubenswrapper[8678]: I1204 00:40:36.927769 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebf07eb54db570834b7c9a90b6b07403" containerName="etcdctl" Dec 04 00:40:36.928559 master-0 kubenswrapper[8678]: I1204 00:40:36.927780 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="187031e5-1d74-4d95-8163-d0c46e8e6734" containerName="route-controller-manager" Dec 04 00:40:37.078767 master-0 kubenswrapper[8678]: I1204 00:40:37.078697 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.078920 master-0 kubenswrapper[8678]: I1204 00:40:37.078788 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.078920 master-0 kubenswrapper[8678]: I1204 00:40:37.078826 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.079175 master-0 kubenswrapper[8678]: I1204 00:40:37.079000 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.079175 master-0 kubenswrapper[8678]: I1204 00:40:37.079038 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.079175 master-0 kubenswrapper[8678]: I1204 00:40:37.079092 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.164847 master-0 kubenswrapper[8678]: I1204 00:40:37.164784 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-rev/0.log" Dec 04 00:40:37.165967 master-0 kubenswrapper[8678]: I1204 00:40:37.165911 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-metrics/0.log" Dec 04 00:40:37.168167 master-0 kubenswrapper[8678]: I1204 00:40:37.168115 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="c6ba48b68ff9ed2a1ef53e045da181c07e856273e5cda13989812c5e51dcbd8f" exitCode=2 Dec 04 00:40:37.168167 master-0 kubenswrapper[8678]: I1204 00:40:37.168145 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="82ff8e87e5ae91c2dd0d02f9048d75269a6a042664e9b18b5e0da259157ab00c" exitCode=0 Dec 04 00:40:37.168167 master-0 kubenswrapper[8678]: I1204 00:40:37.168153 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="3de93b93248fc37e1dc44ecdda58bfd5dbe10fdf2a3e5f6252c1f2d6c155905a" exitCode=2 Dec 04 00:40:37.170285 master-0 kubenswrapper[8678]: I1204 00:40:37.170223 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"3e687558ac9303feb73670490b1fecaf558fff432fa6eb10eb8333dd042f763b"} Dec 04 00:40:37.180330 master-0 kubenswrapper[8678]: I1204 00:40:37.180289 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180427 master-0 kubenswrapper[8678]: I1204 00:40:37.180369 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180427 master-0 kubenswrapper[8678]: I1204 00:40:37.180393 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180427 master-0 kubenswrapper[8678]: I1204 00:40:37.180405 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180505 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180538 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180561 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180606 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180607 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180627 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180572 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:37.180703 master-0 kubenswrapper[8678]: I1204 00:40:37.180660 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:40:38.182555 master-0 kubenswrapper[8678]: I1204 00:40:38.182461 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"a433747788e31b911be2d5dee0f4d95602e43d74e31e597fb77efe46bd44281f"} Dec 04 00:40:42.214152 master-0 kubenswrapper[8678]: I1204 00:40:42.214076 8678 generic.go:334] "Generic (PLEG): container finished" podID="fd2fa610bb2a39c39fcdd00db03a511a" containerID="a433747788e31b911be2d5dee0f4d95602e43d74e31e597fb77efe46bd44281f" exitCode=0 Dec 04 00:40:42.214918 master-0 kubenswrapper[8678]: I1204 00:40:42.214151 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerDied","Data":"a433747788e31b911be2d5dee0f4d95602e43d74e31e597fb77efe46bd44281f"} Dec 04 00:40:43.224955 master-0 kubenswrapper[8678]: I1204 00:40:43.224883 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"d087c5369abafac8257323e4a3cdee0afd5095e579509890d896a866c8dc7850"} Dec 04 00:40:43.225571 master-0 kubenswrapper[8678]: I1204 00:40:43.224984 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"b161863113c6139a611f04e59906422e687c026b8160b780bb0e96afed49b6e2"} Dec 04 00:40:43.225571 master-0 kubenswrapper[8678]: I1204 00:40:43.225003 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"a720c84c34a3a85156a6762f68a4fbd1f22af6519f05ed2a56176eb6f32551b8"} Dec 04 00:40:43.225812 master-0 kubenswrapper[8678]: I1204 00:40:43.225780 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:40:50.308965 master-0 kubenswrapper[8678]: I1204 00:40:50.308862 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:40:50.309831 master-0 kubenswrapper[8678]: I1204 00:40:50.309011 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" exitCode=1 Dec 04 00:40:50.309831 master-0 kubenswrapper[8678]: I1204 00:40:50.309070 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} Dec 04 00:40:50.309976 master-0 kubenswrapper[8678]: I1204 00:40:50.309908 8678 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:40:51.319821 master-0 kubenswrapper[8678]: I1204 00:40:51.319743 8678 generic.go:334] "Generic (PLEG): container finished" podID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerID="4118fa7c7b8720a6318c70d78a37012ba48f750c5f42e27c8bad625646cee34f" exitCode=0 Dec 04 00:40:51.320775 master-0 kubenswrapper[8678]: I1204 00:40:51.319862 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f","Type":"ContainerDied","Data":"4118fa7c7b8720a6318c70d78a37012ba48f750c5f42e27c8bad625646cee34f"} Dec 04 00:40:51.324956 master-0 kubenswrapper[8678]: I1204 00:40:51.324885 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:40:51.325060 master-0 kubenswrapper[8678]: I1204 00:40:51.324995 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} Dec 04 00:40:52.730994 master-0 kubenswrapper[8678]: I1204 00:40:52.726886 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:52.855016 master-0 kubenswrapper[8678]: I1204 00:40:52.854943 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access\") pod \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " Dec 04 00:40:52.855016 master-0 kubenswrapper[8678]: I1204 00:40:52.855015 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir\") pod \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " Dec 04 00:40:52.855393 master-0 kubenswrapper[8678]: I1204 00:40:52.855122 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock\") pod \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\" (UID: \"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f\") " Dec 04 00:40:52.855393 master-0 kubenswrapper[8678]: I1204 00:40:52.855260 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock" (OuterVolumeSpecName: "var-lock") pod "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" (UID: "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:52.855393 master-0 kubenswrapper[8678]: I1204 00:40:52.855276 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" (UID: "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:40:52.855608 master-0 kubenswrapper[8678]: I1204 00:40:52.855520 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:52.855608 master-0 kubenswrapper[8678]: I1204 00:40:52.855537 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:52.858659 master-0 kubenswrapper[8678]: I1204 00:40:52.858541 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" (UID: "19deb5f6-135d-4a17-8eb8-7b996f4f2e9f"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:40:52.957908 master-0 kubenswrapper[8678]: I1204 00:40:52.957721 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/19deb5f6-135d-4a17-8eb8-7b996f4f2e9f-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:40:53.347716 master-0 kubenswrapper[8678]: I1204 00:40:53.347635 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"19deb5f6-135d-4a17-8eb8-7b996f4f2e9f","Type":"ContainerDied","Data":"6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa"} Dec 04 00:40:53.347716 master-0 kubenswrapper[8678]: I1204 00:40:53.347684 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 00:40:53.347716 master-0 kubenswrapper[8678]: I1204 00:40:53.347702 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa" Dec 04 00:40:53.504325 master-0 kubenswrapper[8678]: E1204 00:40:53.503972 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:40:59.944860 master-0 kubenswrapper[8678]: I1204 00:40:59.944773 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:40:59.944860 master-0 kubenswrapper[8678]: I1204 00:40:59.944854 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:40:59.944860 master-0 kubenswrapper[8678]: I1204 00:40:59.944847 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:40:59.945565 master-0 kubenswrapper[8678]: I1204 00:40:59.944942 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:41:03.504385 master-0 kubenswrapper[8678]: E1204 00:41:03.504287 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": context deadline exceeded" Dec 04 00:41:07.485241 master-0 kubenswrapper[8678]: I1204 00:41:07.485138 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-rev/0.log" Dec 04 00:41:07.487377 master-0 kubenswrapper[8678]: I1204 00:41:07.487338 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-metrics/0.log" Dec 04 00:41:07.487968 master-0 kubenswrapper[8678]: I1204 00:41:07.487885 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd/0.log" Dec 04 00:41:07.490960 master-0 kubenswrapper[8678]: I1204 00:41:07.490863 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcdctl/0.log" Dec 04 00:41:07.492304 master-0 kubenswrapper[8678]: I1204 00:41:07.492227 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="7ab30ae3e317040e0131f176b2a07b785a6c1bff67d196756458ee2d14c0ccce" exitCode=137 Dec 04 00:41:07.492304 master-0 kubenswrapper[8678]: I1204 00:41:07.492275 8678 generic.go:334] "Generic (PLEG): container finished" podID="ebf07eb54db570834b7c9a90b6b07403" containerID="bf036457c891374f07b3971f201af28348584fd8bc55d027f138b68845a7f9c5" exitCode=137 Dec 04 00:41:07.516405 master-0 kubenswrapper[8678]: I1204 00:41:07.516350 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-rev/0.log" Dec 04 00:41:07.517337 master-0 kubenswrapper[8678]: I1204 00:41:07.517308 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-metrics/0.log" Dec 04 00:41:07.518125 master-0 kubenswrapper[8678]: I1204 00:41:07.517912 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd/0.log" Dec 04 00:41:07.518591 master-0 kubenswrapper[8678]: I1204 00:41:07.518570 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcdctl/0.log" Dec 04 00:41:07.519565 master-0 kubenswrapper[8678]: I1204 00:41:07.519534 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:41:07.589852 master-0 kubenswrapper[8678]: I1204 00:41:07.589668 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590143 master-0 kubenswrapper[8678]: I1204 00:41:07.589769 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin" (OuterVolumeSpecName: "usr-local-bin") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "usr-local-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.590143 master-0 kubenswrapper[8678]: I1204 00:41:07.589893 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590143 master-0 kubenswrapper[8678]: I1204 00:41:07.589971 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.590143 master-0 kubenswrapper[8678]: I1204 00:41:07.590124 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir" (OuterVolumeSpecName: "static-pod-dir") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "static-pod-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.590143 master-0 kubenswrapper[8678]: I1204 00:41:07.590093 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590248 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590286 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590356 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590371 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir\") pod \"ebf07eb54db570834b7c9a90b6b07403\" (UID: \"ebf07eb54db570834b7c9a90b6b07403\") " Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590400 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir" (OuterVolumeSpecName: "log-dir") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "log-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.590520 master-0 kubenswrapper[8678]: I1204 00:41:07.590480 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir" (OuterVolumeSpecName: "data-dir") pod "ebf07eb54db570834b7c9a90b6b07403" (UID: "ebf07eb54db570834b7c9a90b6b07403"). InnerVolumeSpecName "data-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:41:07.591043 master-0 kubenswrapper[8678]: I1204 00:41:07.591003 8678 reconciler_common.go:293] "Volume detached for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-static-pod-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:07.591043 master-0 kubenswrapper[8678]: I1204 00:41:07.591030 8678 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:07.591199 master-0 kubenswrapper[8678]: I1204 00:41:07.591046 8678 reconciler_common.go:293] "Volume detached for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-log-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:07.591199 master-0 kubenswrapper[8678]: I1204 00:41:07.591064 8678 reconciler_common.go:293] "Volume detached for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-data-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:07.591199 master-0 kubenswrapper[8678]: I1204 00:41:07.591086 8678 reconciler_common.go:293] "Volume detached for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-usr-local-bin\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:07.591199 master-0 kubenswrapper[8678]: I1204 00:41:07.591101 8678 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/ebf07eb54db570834b7c9a90b6b07403-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:41:08.502898 master-0 kubenswrapper[8678]: I1204 00:41:08.502774 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-rev/0.log" Dec 04 00:41:08.504950 master-0 kubenswrapper[8678]: I1204 00:41:08.504846 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd-metrics/0.log" Dec 04 00:41:08.506818 master-0 kubenswrapper[8678]: I1204 00:41:08.506678 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcd/0.log" Dec 04 00:41:08.508047 master-0 kubenswrapper[8678]: I1204 00:41:08.508001 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_ebf07eb54db570834b7c9a90b6b07403/etcdctl/0.log" Dec 04 00:41:08.510815 master-0 kubenswrapper[8678]: I1204 00:41:08.510764 8678 scope.go:117] "RemoveContainer" containerID="c6ba48b68ff9ed2a1ef53e045da181c07e856273e5cda13989812c5e51dcbd8f" Dec 04 00:41:08.511065 master-0 kubenswrapper[8678]: I1204 00:41:08.511010 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:41:08.536854 master-0 kubenswrapper[8678]: I1204 00:41:08.536647 8678 scope.go:117] "RemoveContainer" containerID="82ff8e87e5ae91c2dd0d02f9048d75269a6a042664e9b18b5e0da259157ab00c" Dec 04 00:41:08.567102 master-0 kubenswrapper[8678]: I1204 00:41:08.567017 8678 scope.go:117] "RemoveContainer" containerID="3de93b93248fc37e1dc44ecdda58bfd5dbe10fdf2a3e5f6252c1f2d6c155905a" Dec 04 00:41:08.591514 master-0 kubenswrapper[8678]: I1204 00:41:08.591431 8678 scope.go:117] "RemoveContainer" containerID="7ab30ae3e317040e0131f176b2a07b785a6c1bff67d196756458ee2d14c0ccce" Dec 04 00:41:08.617445 master-0 kubenswrapper[8678]: I1204 00:41:08.617282 8678 scope.go:117] "RemoveContainer" containerID="bf036457c891374f07b3971f201af28348584fd8bc55d027f138b68845a7f9c5" Dec 04 00:41:08.640424 master-0 kubenswrapper[8678]: I1204 00:41:08.640362 8678 scope.go:117] "RemoveContainer" containerID="3ab83d217e29e8499eaf40a7b77ac6911f130d05e9b255651ddaf30e1585c461" Dec 04 00:41:08.671068 master-0 kubenswrapper[8678]: I1204 00:41:08.671010 8678 scope.go:117] "RemoveContainer" containerID="95ba4d49e94c16be82a5ba8e72d99997698c72b8ee596dfbc0232731eaeac613" Dec 04 00:41:08.698256 master-0 kubenswrapper[8678]: I1204 00:41:08.698174 8678 scope.go:117] "RemoveContainer" containerID="67e38273020ce17d473eb917f328e45267b4f71464186e9b0145d163f9067d2c" Dec 04 00:41:08.863278 master-0 kubenswrapper[8678]: I1204 00:41:08.863163 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf07eb54db570834b7c9a90b6b07403" path="/var/lib/kubelet/pods/ebf07eb54db570834b7c9a90b6b07403/volumes" Dec 04 00:41:09.944671 master-0 kubenswrapper[8678]: I1204 00:41:09.944572 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:41:09.944671 master-0 kubenswrapper[8678]: I1204 00:41:09.944672 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:41:10.931528 master-0 kubenswrapper[8678]: E1204 00:41:10.931343 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0.187ddc496d4fa0ab openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0,UID:ebf07eb54db570834b7c9a90b6b07403,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Killing,Message:Stopping container etcd-metrics,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:36.923760811 +0000 UTC m=+620.250493367,LastTimestamp:2025-12-04 00:40:36.923760811 +0000 UTC m=+620.250493367,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:41:13.505411 master-0 kubenswrapper[8678]: E1204 00:41:13.505246 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:41:15.740436 master-0 kubenswrapper[8678]: E1204 00:41:15.740386 8678 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e0d056_186c_4067_b586_14fe2970fcc0.slice/crio-conmon-e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632.scope\": RecentStats: unable to find data in memory cache]" Dec 04 00:41:16.582455 master-0 kubenswrapper[8678]: I1204 00:41:16.582319 8678 generic.go:334] "Generic (PLEG): container finished" podID="83e0d056-186c-4067-b586-14fe2970fcc0" containerID="e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632" exitCode=0 Dec 04 00:41:16.582455 master-0 kubenswrapper[8678]: I1204 00:41:16.582403 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerDied","Data":"e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632"} Dec 04 00:41:16.582455 master-0 kubenswrapper[8678]: I1204 00:41:16.582443 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f"} Dec 04 00:41:16.582455 master-0 kubenswrapper[8678]: I1204 00:41:16.582468 8678 scope.go:117] "RemoveContainer" containerID="f9239341fd0a0b22436ada55ce119be83516aa56fce251136b9aa05939839dba" Dec 04 00:41:16.850143 master-0 kubenswrapper[8678]: I1204 00:41:16.850075 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:41:16.880606 master-0 kubenswrapper[8678]: I1204 00:41:16.880510 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:41:16.880606 master-0 kubenswrapper[8678]: I1204 00:41:16.880574 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:41:17.520179 master-0 kubenswrapper[8678]: I1204 00:41:17.519965 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:41:17.522745 master-0 kubenswrapper[8678]: I1204 00:41:17.522690 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:17.522745 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:17.522745 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:17.522745 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:17.523099 master-0 kubenswrapper[8678]: I1204 00:41:17.522750 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:18.523372 master-0 kubenswrapper[8678]: I1204 00:41:18.523298 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:18.523372 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:18.523372 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:18.523372 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:18.524456 master-0 kubenswrapper[8678]: I1204 00:41:18.523393 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:19.523309 master-0 kubenswrapper[8678]: I1204 00:41:19.523212 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:19.523309 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:19.523309 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:19.523309 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:19.523309 master-0 kubenswrapper[8678]: I1204 00:41:19.523299 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:19.952392 master-0 kubenswrapper[8678]: I1204 00:41:19.952313 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:41:19.959066 master-0 kubenswrapper[8678]: I1204 00:41:19.959011 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:41:20.520705 master-0 kubenswrapper[8678]: I1204 00:41:20.520608 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:41:20.524365 master-0 kubenswrapper[8678]: I1204 00:41:20.524304 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:20.524365 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:20.524365 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:20.524365 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:20.524971 master-0 kubenswrapper[8678]: I1204 00:41:20.524408 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:21.523439 master-0 kubenswrapper[8678]: I1204 00:41:21.523362 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:21.523439 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:21.523439 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:21.523439 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:21.524206 master-0 kubenswrapper[8678]: I1204 00:41:21.524078 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:22.523497 master-0 kubenswrapper[8678]: I1204 00:41:22.523342 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:22.523497 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:22.523497 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:22.523497 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:22.523497 master-0 kubenswrapper[8678]: I1204 00:41:22.523454 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:23.506534 master-0 kubenswrapper[8678]: E1204 00:41:23.506402 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:41:23.523867 master-0 kubenswrapper[8678]: I1204 00:41:23.523759 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:23.523867 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:23.523867 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:23.523867 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:23.524863 master-0 kubenswrapper[8678]: I1204 00:41:23.523888 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:24.523152 master-0 kubenswrapper[8678]: I1204 00:41:24.523063 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:24.523152 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:24.523152 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:24.523152 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:24.523491 master-0 kubenswrapper[8678]: I1204 00:41:24.523160 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:25.523989 master-0 kubenswrapper[8678]: I1204 00:41:25.523846 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:25.523989 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:25.523989 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:25.523989 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:25.525140 master-0 kubenswrapper[8678]: I1204 00:41:25.524002 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:26.523598 master-0 kubenswrapper[8678]: I1204 00:41:26.523506 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:26.523598 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:26.523598 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:26.523598 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:26.523993 master-0 kubenswrapper[8678]: I1204 00:41:26.523627 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:27.524067 master-0 kubenswrapper[8678]: I1204 00:41:27.523835 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:27.524067 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:27.524067 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:27.524067 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:27.524067 master-0 kubenswrapper[8678]: I1204 00:41:27.523983 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:28.523847 master-0 kubenswrapper[8678]: I1204 00:41:28.523769 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:28.523847 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:28.523847 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:28.523847 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:28.524504 master-0 kubenswrapper[8678]: I1204 00:41:28.523864 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:29.523418 master-0 kubenswrapper[8678]: I1204 00:41:29.523311 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:29.523418 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:29.523418 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:29.523418 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:29.524001 master-0 kubenswrapper[8678]: I1204 00:41:29.523434 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:30.523439 master-0 kubenswrapper[8678]: I1204 00:41:30.522963 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:30.523439 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:30.523439 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:30.523439 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:30.524607 master-0 kubenswrapper[8678]: I1204 00:41:30.523409 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:30.684690 master-0 kubenswrapper[8678]: I1204 00:41:30.684632 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/1.log" Dec 04 00:41:30.685355 master-0 kubenswrapper[8678]: I1204 00:41:30.685312 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/0.log" Dec 04 00:41:30.685886 master-0 kubenswrapper[8678]: I1204 00:41:30.685841 8678 generic.go:334] "Generic (PLEG): container finished" podID="0616abbd-748a-4451-96b7-df0178c99e8f" containerID="915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3" exitCode=1 Dec 04 00:41:30.686044 master-0 kubenswrapper[8678]: I1204 00:41:30.685892 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerDied","Data":"915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3"} Dec 04 00:41:30.686144 master-0 kubenswrapper[8678]: I1204 00:41:30.686100 8678 scope.go:117] "RemoveContainer" containerID="0031d90626c44a0b4ae51f89c3656c79774d7fc6c63d89e20791d3810bda9cee" Dec 04 00:41:30.686852 master-0 kubenswrapper[8678]: I1204 00:41:30.686816 8678 scope.go:117] "RemoveContainer" containerID="915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3" Dec 04 00:41:30.687125 master-0 kubenswrapper[8678]: E1204 00:41:30.687089 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"approver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=approver pod=network-node-identity-lxpmq_openshift-network-node-identity(0616abbd-748a-4451-96b7-df0178c99e8f)\"" pod="openshift-network-node-identity/network-node-identity-lxpmq" podUID="0616abbd-748a-4451-96b7-df0178c99e8f" Dec 04 00:41:31.523868 master-0 kubenswrapper[8678]: I1204 00:41:31.523752 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:31.523868 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:31.523868 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:31.523868 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:31.523868 master-0 kubenswrapper[8678]: I1204 00:41:31.523859 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:31.696999 master-0 kubenswrapper[8678]: I1204 00:41:31.696892 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/1.log" Dec 04 00:41:32.523623 master-0 kubenswrapper[8678]: I1204 00:41:32.523507 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:32.523623 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:32.523623 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:32.523623 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:32.524546 master-0 kubenswrapper[8678]: I1204 00:41:32.523695 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:33.507579 master-0 kubenswrapper[8678]: E1204 00:41:33.507421 8678 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:41:33.507579 master-0 kubenswrapper[8678]: I1204 00:41:33.507567 8678 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 00:41:33.522818 master-0 kubenswrapper[8678]: I1204 00:41:33.522733 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:33.522818 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:33.522818 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:33.522818 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:33.523210 master-0 kubenswrapper[8678]: I1204 00:41:33.522810 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:34.523001 master-0 kubenswrapper[8678]: I1204 00:41:34.522865 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:34.523001 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:34.523001 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:34.523001 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:34.523001 master-0 kubenswrapper[8678]: I1204 00:41:34.522966 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:35.351974 master-0 kubenswrapper[8678]: I1204 00:41:35.351869 8678 scope.go:117] "RemoveContainer" containerID="1300eec5b13e1deefbf3fca03fc706b8741b7b845c75e9d289332ec08965e0c6" Dec 04 00:41:35.371402 master-0 kubenswrapper[8678]: I1204 00:41:35.371366 8678 scope.go:117] "RemoveContainer" containerID="48c67116d49ad7cd921e7ddab5b35648b4c4d5a88ba326ed611b27fed4143751" Dec 04 00:41:35.393202 master-0 kubenswrapper[8678]: I1204 00:41:35.393095 8678 scope.go:117] "RemoveContainer" containerID="e76c5c944117a73ac8803ecb0df1d95186e0d91b8c04b7625cfb1438afafe09e" Dec 04 00:41:35.411062 master-0 kubenswrapper[8678]: I1204 00:41:35.411006 8678 scope.go:117] "RemoveContainer" containerID="ea9fbd8571832394f3e37c90fe6b99d7010e72171a50cd3e139481b9591359c3" Dec 04 00:41:35.523046 master-0 kubenswrapper[8678]: I1204 00:41:35.522987 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:35.523046 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:35.523046 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:35.523046 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:35.524066 master-0 kubenswrapper[8678]: I1204 00:41:35.523068 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:36.523665 master-0 kubenswrapper[8678]: I1204 00:41:36.523553 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:36.523665 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:36.523665 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:36.523665 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:36.525107 master-0 kubenswrapper[8678]: I1204 00:41:36.523696 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:37.523658 master-0 kubenswrapper[8678]: I1204 00:41:37.523501 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:37.523658 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:37.523658 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:37.523658 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:37.524308 master-0 kubenswrapper[8678]: I1204 00:41:37.523662 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:37.925224 master-0 kubenswrapper[8678]: I1204 00:41:37.925084 8678 patch_prober.go:28] interesting pod/openshift-kube-scheduler-master-0 container/kube-scheduler namespace/openshift-kube-scheduler: Readiness probe status=failure output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:41:37.925224 master-0 kubenswrapper[8678]: I1204 00:41:37.925169 8678 patch_prober.go:28] interesting pod/openshift-kube-scheduler-master-0 container/kube-scheduler namespace/openshift-kube-scheduler: Liveness probe status=failure output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:41:37.925224 master-0 kubenswrapper[8678]: I1204 00:41:37.925221 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="fd2fa610bb2a39c39fcdd00db03a511a" containerName="kube-scheduler" probeResult="failure" output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:41:37.925742 master-0 kubenswrapper[8678]: I1204 00:41:37.925234 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="fd2fa610bb2a39c39fcdd00db03a511a" containerName="kube-scheduler" probeResult="failure" output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:41:38.184683 master-0 kubenswrapper[8678]: I1204 00:41:38.184480 8678 status_manager.go:851] "Failed to get status for pod" podUID="fd2fa610bb2a39c39fcdd00db03a511a" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods openshift-kube-scheduler-master-0)" Dec 04 00:41:38.524259 master-0 kubenswrapper[8678]: I1204 00:41:38.524078 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:38.524259 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:38.524259 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:38.524259 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:38.524259 master-0 kubenswrapper[8678]: I1204 00:41:38.524189 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:39.522559 master-0 kubenswrapper[8678]: I1204 00:41:39.522485 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:39.522559 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:39.522559 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:39.522559 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:39.523123 master-0 kubenswrapper[8678]: I1204 00:41:39.522595 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:40.522687 master-0 kubenswrapper[8678]: I1204 00:41:40.522585 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:40.522687 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:40.522687 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:40.522687 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:40.523295 master-0 kubenswrapper[8678]: I1204 00:41:40.522709 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:41.522982 master-0 kubenswrapper[8678]: I1204 00:41:41.522887 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:41.522982 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:41.522982 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:41.522982 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:41.523710 master-0 kubenswrapper[8678]: I1204 00:41:41.523007 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:41.850462 master-0 kubenswrapper[8678]: I1204 00:41:41.850386 8678 scope.go:117] "RemoveContainer" containerID="915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3" Dec 04 00:41:42.522385 master-0 kubenswrapper[8678]: I1204 00:41:42.522303 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:42.522385 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:42.522385 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:42.522385 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:42.522734 master-0 kubenswrapper[8678]: I1204 00:41:42.522392 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:42.784664 master-0 kubenswrapper[8678]: I1204 00:41:42.783346 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/1.log" Dec 04 00:41:42.784664 master-0 kubenswrapper[8678]: I1204 00:41:42.783773 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lxpmq" event={"ID":"0616abbd-748a-4451-96b7-df0178c99e8f","Type":"ContainerStarted","Data":"fd9b877dbb19f2e3a451626ae55f46d8aa05ca0c1caac8299370cddf31842de8"} Dec 04 00:41:43.537365 master-0 kubenswrapper[8678]: E1204 00:41:43.537263 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="200ms" Dec 04 00:41:43.542598 master-0 kubenswrapper[8678]: I1204 00:41:43.541870 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:43.542598 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:43.542598 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:43.542598 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:43.542598 master-0 kubenswrapper[8678]: I1204 00:41:43.541996 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:44.523083 master-0 kubenswrapper[8678]: I1204 00:41:44.522982 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:44.523083 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:44.523083 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:44.523083 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:44.523083 master-0 kubenswrapper[8678]: I1204 00:41:44.523105 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:44.801421 master-0 kubenswrapper[8678]: I1204 00:41:44.801207 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/3.log" Dec 04 00:41:44.802267 master-0 kubenswrapper[8678]: I1204 00:41:44.802219 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/2.log" Dec 04 00:41:44.803033 master-0 kubenswrapper[8678]: I1204 00:41:44.802962 8678 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" exitCode=1 Dec 04 00:41:44.803033 master-0 kubenswrapper[8678]: I1204 00:41:44.803023 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerDied","Data":"84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560"} Dec 04 00:41:44.803320 master-0 kubenswrapper[8678]: I1204 00:41:44.803082 8678 scope.go:117] "RemoveContainer" containerID="0822f227f2c68168e1a971ca1a77c0f6afd3e2cce3d701a9086a5536151456d8" Dec 04 00:41:44.804330 master-0 kubenswrapper[8678]: I1204 00:41:44.804240 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:41:44.805433 master-0 kubenswrapper[8678]: E1204 00:41:44.804815 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:41:44.934960 master-0 kubenswrapper[8678]: E1204 00:41:44.934734 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4970f0cce1 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:36.984655073 +0000 UTC m=+620.311387649,LastTimestamp:2025-12-04 00:40:36.984655073 +0000 UTC m=+620.311387649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:41:45.523511 master-0 kubenswrapper[8678]: I1204 00:41:45.523331 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:45.523511 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:45.523511 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:45.523511 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:45.523511 master-0 kubenswrapper[8678]: I1204 00:41:45.523473 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:45.813835 master-0 kubenswrapper[8678]: I1204 00:41:45.813643 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/3.log" Dec 04 00:41:46.523508 master-0 kubenswrapper[8678]: I1204 00:41:46.523416 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:46.523508 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:46.523508 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:46.523508 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:46.524223 master-0 kubenswrapper[8678]: I1204 00:41:46.523522 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:46.932749 master-0 kubenswrapper[8678]: I1204 00:41:46.932673 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:41:47.523915 master-0 kubenswrapper[8678]: I1204 00:41:47.523707 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:47.523915 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:47.523915 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:47.523915 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:47.523915 master-0 kubenswrapper[8678]: I1204 00:41:47.523833 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:48.523553 master-0 kubenswrapper[8678]: I1204 00:41:48.523468 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:48.523553 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:48.523553 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:48.523553 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:48.524736 master-0 kubenswrapper[8678]: I1204 00:41:48.523560 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:49.523429 master-0 kubenswrapper[8678]: I1204 00:41:49.523278 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:49.523429 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:49.523429 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:49.523429 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:49.523429 master-0 kubenswrapper[8678]: I1204 00:41:49.523406 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:50.523629 master-0 kubenswrapper[8678]: I1204 00:41:50.523542 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:50.523629 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:50.523629 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:50.523629 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:50.523629 master-0 kubenswrapper[8678]: I1204 00:41:50.523630 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:50.884193 master-0 kubenswrapper[8678]: E1204 00:41:50.884073 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:41:50.885170 master-0 kubenswrapper[8678]: I1204 00:41:50.885079 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 00:41:51.523014 master-0 kubenswrapper[8678]: I1204 00:41:51.522759 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:51.523014 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:51.523014 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:51.523014 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:51.523014 master-0 kubenswrapper[8678]: I1204 00:41:51.522954 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:51.864782 master-0 kubenswrapper[8678]: I1204 00:41:51.864695 8678 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="4f0e5e65ec23a0d46db6114295e8e2ea0c7aa061d233e49d8004312b84bad2da" exitCode=0 Dec 04 00:41:51.864782 master-0 kubenswrapper[8678]: I1204 00:41:51.864775 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"4f0e5e65ec23a0d46db6114295e8e2ea0c7aa061d233e49d8004312b84bad2da"} Dec 04 00:41:51.865653 master-0 kubenswrapper[8678]: I1204 00:41:51.864820 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"4ee3dd7cd38da2c920657ce4d7b82c0b34d9d38275312a1c0eadf1bcf0b5d640"} Dec 04 00:41:51.865653 master-0 kubenswrapper[8678]: I1204 00:41:51.865259 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:41:51.865653 master-0 kubenswrapper[8678]: I1204 00:41:51.865284 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:41:52.523351 master-0 kubenswrapper[8678]: I1204 00:41:52.523209 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:52.523351 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:52.523351 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:52.523351 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:52.523351 master-0 kubenswrapper[8678]: I1204 00:41:52.523333 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:53.524266 master-0 kubenswrapper[8678]: I1204 00:41:53.524108 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:53.524266 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:53.524266 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:53.524266 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:53.525369 master-0 kubenswrapper[8678]: I1204 00:41:53.524288 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:53.739394 master-0 kubenswrapper[8678]: E1204 00:41:53.739241 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="400ms" Dec 04 00:41:54.523474 master-0 kubenswrapper[8678]: I1204 00:41:54.523303 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:54.523474 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:54.523474 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:54.523474 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:54.524075 master-0 kubenswrapper[8678]: I1204 00:41:54.523509 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:55.523019 master-0 kubenswrapper[8678]: I1204 00:41:55.522895 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:55.523019 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:55.523019 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:55.523019 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:55.523019 master-0 kubenswrapper[8678]: I1204 00:41:55.522994 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:55.850592 master-0 kubenswrapper[8678]: I1204 00:41:55.850484 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:41:55.850911 master-0 kubenswrapper[8678]: E1204 00:41:55.850843 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:41:56.524210 master-0 kubenswrapper[8678]: I1204 00:41:56.524104 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:56.524210 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:56.524210 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:56.524210 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:56.524844 master-0 kubenswrapper[8678]: I1204 00:41:56.524213 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:57.522918 master-0 kubenswrapper[8678]: I1204 00:41:57.522710 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:57.522918 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:57.522918 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:57.522918 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:57.522918 master-0 kubenswrapper[8678]: I1204 00:41:57.522796 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:58.523846 master-0 kubenswrapper[8678]: I1204 00:41:58.523734 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:58.523846 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:58.523846 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:58.523846 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:58.524563 master-0 kubenswrapper[8678]: I1204 00:41:58.523858 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:41:59.523666 master-0 kubenswrapper[8678]: I1204 00:41:59.523550 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:41:59.523666 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:41:59.523666 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:41:59.523666 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:41:59.524730 master-0 kubenswrapper[8678]: I1204 00:41:59.523721 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:00.522694 master-0 kubenswrapper[8678]: I1204 00:42:00.522581 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:00.522694 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:00.522694 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:00.522694 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:00.523126 master-0 kubenswrapper[8678]: I1204 00:42:00.522730 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:01.523170 master-0 kubenswrapper[8678]: I1204 00:42:01.523030 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:01.523170 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:01.523170 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:01.523170 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:01.524217 master-0 kubenswrapper[8678]: I1204 00:42:01.523172 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:02.523537 master-0 kubenswrapper[8678]: I1204 00:42:02.523407 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:02.523537 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:02.523537 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:02.523537 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:02.524762 master-0 kubenswrapper[8678]: I1204 00:42:02.523530 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:03.523297 master-0 kubenswrapper[8678]: I1204 00:42:03.523164 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:03.523297 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:03.523297 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:03.523297 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:03.524408 master-0 kubenswrapper[8678]: I1204 00:42:03.523292 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:03.747982 master-0 kubenswrapper[8678]: E1204 00:42:03.747844 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:41:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:41:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:41:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:41:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":false},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:42:04.140283 master-0 kubenswrapper[8678]: E1204 00:42:04.140175 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="800ms" Dec 04 00:42:04.523992 master-0 kubenswrapper[8678]: I1204 00:42:04.523745 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:04.523992 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:04.523992 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:04.523992 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:04.523992 master-0 kubenswrapper[8678]: I1204 00:42:04.523883 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:05.523151 master-0 kubenswrapper[8678]: I1204 00:42:05.523068 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:05.523151 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:05.523151 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:05.523151 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:05.523467 master-0 kubenswrapper[8678]: I1204 00:42:05.523173 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:06.522674 master-0 kubenswrapper[8678]: I1204 00:42:06.522603 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:06.522674 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:06.522674 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:06.522674 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:06.523852 master-0 kubenswrapper[8678]: I1204 00:42:06.522690 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:07.523711 master-0 kubenswrapper[8678]: I1204 00:42:07.523563 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:07.523711 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:07.523711 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:07.523711 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:07.524304 master-0 kubenswrapper[8678]: I1204 00:42:07.523697 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:07.850109 master-0 kubenswrapper[8678]: I1204 00:42:07.850014 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:42:07.850424 master-0 kubenswrapper[8678]: E1204 00:42:07.850337 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:42:08.523176 master-0 kubenswrapper[8678]: I1204 00:42:08.523088 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:08.523176 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:08.523176 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:08.523176 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:08.523616 master-0 kubenswrapper[8678]: I1204 00:42:08.523177 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:09.523522 master-0 kubenswrapper[8678]: I1204 00:42:09.523323 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:09.523522 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:09.523522 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:09.523522 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:09.523522 master-0 kubenswrapper[8678]: I1204 00:42:09.523472 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:10.522895 master-0 kubenswrapper[8678]: I1204 00:42:10.522840 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:10.522895 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:10.522895 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:10.522895 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:10.523306 master-0 kubenswrapper[8678]: I1204 00:42:10.522908 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:11.523638 master-0 kubenswrapper[8678]: I1204 00:42:11.523496 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:11.523638 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:11.523638 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:11.523638 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:11.523638 master-0 kubenswrapper[8678]: I1204 00:42:11.523628 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:12.523870 master-0 kubenswrapper[8678]: I1204 00:42:12.523783 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:12.523870 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:12.523870 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:12.523870 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:12.524658 master-0 kubenswrapper[8678]: I1204 00:42:12.523884 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:13.523233 master-0 kubenswrapper[8678]: I1204 00:42:13.523102 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:13.523233 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:13.523233 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:13.523233 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:13.523730 master-0 kubenswrapper[8678]: I1204 00:42:13.523241 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:13.749303 master-0 kubenswrapper[8678]: E1204 00:42:13.749214 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:42:14.523501 master-0 kubenswrapper[8678]: I1204 00:42:14.523405 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:14.523501 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:14.523501 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:14.523501 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:14.523965 master-0 kubenswrapper[8678]: I1204 00:42:14.523499 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:14.941635 master-0 kubenswrapper[8678]: E1204 00:42:14.941465 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="1.6s" Dec 04 00:42:15.523209 master-0 kubenswrapper[8678]: I1204 00:42:15.523111 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:15.523209 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:15.523209 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:15.523209 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:15.523209 master-0 kubenswrapper[8678]: I1204 00:42:15.523208 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:16.523784 master-0 kubenswrapper[8678]: I1204 00:42:16.523649 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:16.523784 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:16.523784 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:16.523784 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:16.524737 master-0 kubenswrapper[8678]: I1204 00:42:16.523775 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:17.523456 master-0 kubenswrapper[8678]: I1204 00:42:17.523268 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:17.523456 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:17.523456 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:17.523456 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:17.523766 master-0 kubenswrapper[8678]: I1204 00:42:17.523476 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:18.523876 master-0 kubenswrapper[8678]: I1204 00:42:18.523798 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:18.523876 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:18.523876 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:18.523876 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:18.524867 master-0 kubenswrapper[8678]: I1204 00:42:18.523911 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:18.850067 master-0 kubenswrapper[8678]: I1204 00:42:18.849989 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:42:18.850571 master-0 kubenswrapper[8678]: E1204 00:42:18.850445 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:42:18.938421 master-0 kubenswrapper[8678]: E1204 00:42:18.938156 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc497fccfa4b openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Created,Message:Created container: wait-for-host-port,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:37.233965643 +0000 UTC m=+620.560698209,LastTimestamp:2025-12-04 00:40:37.233965643 +0000 UTC m=+620.560698209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:42:19.079271 master-0 kubenswrapper[8678]: I1204 00:42:19.079138 8678 generic.go:334] "Generic (PLEG): container finished" podID="aa2eaba9-479e-4420-a24f-63530e4da783" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" exitCode=0 Dec 04 00:42:19.079271 master-0 kubenswrapper[8678]: I1204 00:42:19.079234 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerDied","Data":"3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076"} Dec 04 00:42:19.079699 master-0 kubenswrapper[8678]: I1204 00:42:19.079303 8678 scope.go:117] "RemoveContainer" containerID="21271674bed5db800ead1d33a02a41079776995c09f1c049ca58e762322ee71d" Dec 04 00:42:19.080327 master-0 kubenswrapper[8678]: I1204 00:42:19.080254 8678 scope.go:117] "RemoveContainer" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" Dec 04 00:42:19.080773 master-0 kubenswrapper[8678]: E1204 00:42:19.080711 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"marketplace-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=marketplace-operator pod=marketplace-operator-7d67745bb7-2qnbf_openshift-marketplace(aa2eaba9-479e-4420-a24f-63530e4da783)\"" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" Dec 04 00:42:19.523630 master-0 kubenswrapper[8678]: I1204 00:42:19.523452 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:19.523630 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:19.523630 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:19.523630 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:19.523630 master-0 kubenswrapper[8678]: I1204 00:42:19.523552 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:19.909120 master-0 kubenswrapper[8678]: I1204 00:42:19.909001 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:42:19.909120 master-0 kubenswrapper[8678]: I1204 00:42:19.909101 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:42:20.088173 master-0 kubenswrapper[8678]: I1204 00:42:20.088102 8678 scope.go:117] "RemoveContainer" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" Dec 04 00:42:20.088577 master-0 kubenswrapper[8678]: E1204 00:42:20.088525 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"marketplace-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=marketplace-operator pod=marketplace-operator-7d67745bb7-2qnbf_openshift-marketplace(aa2eaba9-479e-4420-a24f-63530e4da783)\"" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" Dec 04 00:42:20.523819 master-0 kubenswrapper[8678]: I1204 00:42:20.523744 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:20.523819 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:20.523819 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:20.523819 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:20.524834 master-0 kubenswrapper[8678]: I1204 00:42:20.523832 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:21.523143 master-0 kubenswrapper[8678]: I1204 00:42:21.523067 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:21.523143 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:21.523143 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:21.523143 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:21.523143 master-0 kubenswrapper[8678]: I1204 00:42:21.523149 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:22.523703 master-0 kubenswrapper[8678]: I1204 00:42:22.523613 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:22.523703 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:22.523703 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:22.523703 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:22.524987 master-0 kubenswrapper[8678]: I1204 00:42:22.523702 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:23.523032 master-0 kubenswrapper[8678]: I1204 00:42:23.522893 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:23.523032 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:23.523032 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:23.523032 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:23.523528 master-0 kubenswrapper[8678]: I1204 00:42:23.523048 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:23.750243 master-0 kubenswrapper[8678]: E1204 00:42:23.750130 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:42:24.522730 master-0 kubenswrapper[8678]: I1204 00:42:24.522618 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:24.522730 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:24.522730 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:24.522730 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:24.522730 master-0 kubenswrapper[8678]: I1204 00:42:24.522710 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:25.127551 master-0 kubenswrapper[8678]: I1204 00:42:25.127467 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/1.log" Dec 04 00:42:25.128564 master-0 kubenswrapper[8678]: I1204 00:42:25.128500 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/0.log" Dec 04 00:42:25.129055 master-0 kubenswrapper[8678]: I1204 00:42:25.128991 8678 generic.go:334] "Generic (PLEG): container finished" podID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerID="fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb" exitCode=1 Dec 04 00:42:25.129146 master-0 kubenswrapper[8678]: I1204 00:42:25.129059 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerDied","Data":"fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb"} Dec 04 00:42:25.129146 master-0 kubenswrapper[8678]: I1204 00:42:25.129117 8678 scope.go:117] "RemoveContainer" containerID="f134fa404e41ccccd9a96968aae081a3d4c05ff32e7941607b4075f5497a7ae4" Dec 04 00:42:25.129855 master-0 kubenswrapper[8678]: I1204 00:42:25.129812 8678 scope.go:117] "RemoveContainer" containerID="fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb" Dec 04 00:42:25.130134 master-0 kubenswrapper[8678]: E1204 00:42:25.130085 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=catalogd-controller-manager-754cfd84-zjpxn_openshift-catalogd(bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced)\"" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podUID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" Dec 04 00:42:25.523858 master-0 kubenswrapper[8678]: I1204 00:42:25.523649 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:25.523858 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:25.523858 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:25.523858 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:25.523858 master-0 kubenswrapper[8678]: I1204 00:42:25.523728 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:25.869194 master-0 kubenswrapper[8678]: E1204 00:42:25.869091 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:42:26.138089 master-0 kubenswrapper[8678]: I1204 00:42:26.137910 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/1.log" Dec 04 00:42:26.524020 master-0 kubenswrapper[8678]: I1204 00:42:26.523803 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:26.524020 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:26.524020 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:26.524020 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:26.524658 master-0 kubenswrapper[8678]: I1204 00:42:26.524570 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:26.543216 master-0 kubenswrapper[8678]: E1204 00:42:26.543127 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="3.2s" Dec 04 00:42:27.150846 master-0 kubenswrapper[8678]: I1204 00:42:27.150716 8678 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="f951fe8d6420f20633e9aa099f7a29a56295f060f029ad2921bd92a9bc5f21b3" exitCode=0 Dec 04 00:42:27.150846 master-0 kubenswrapper[8678]: I1204 00:42:27.150809 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"f951fe8d6420f20633e9aa099f7a29a56295f060f029ad2921bd92a9bc5f21b3"} Dec 04 00:42:27.151827 master-0 kubenswrapper[8678]: I1204 00:42:27.151353 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:42:27.151827 master-0 kubenswrapper[8678]: I1204 00:42:27.151382 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:42:27.522998 master-0 kubenswrapper[8678]: I1204 00:42:27.522795 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:27.522998 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:27.522998 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:27.522998 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:27.522998 master-0 kubenswrapper[8678]: I1204 00:42:27.522890 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:28.523305 master-0 kubenswrapper[8678]: I1204 00:42:28.523149 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:28.523305 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:28.523305 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:28.523305 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:28.523305 master-0 kubenswrapper[8678]: I1204 00:42:28.523254 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:29.167873 master-0 kubenswrapper[8678]: I1204 00:42:29.167824 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 00:42:29.168886 master-0 kubenswrapper[8678]: I1204 00:42:29.168815 8678 generic.go:334] "Generic (PLEG): container finished" podID="b900991f-c6ec-45d1-a76b-44aec0f56cde" containerID="f0c494bde70f37736abe62be0def4b2d933ab52a855d6e1c1ecf0f70379f00c8" exitCode=1 Dec 04 00:42:29.168886 master-0 kubenswrapper[8678]: I1204 00:42:29.168879 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerDied","Data":"f0c494bde70f37736abe62be0def4b2d933ab52a855d6e1c1ecf0f70379f00c8"} Dec 04 00:42:29.169692 master-0 kubenswrapper[8678]: I1204 00:42:29.169652 8678 scope.go:117] "RemoveContainer" containerID="f0c494bde70f37736abe62be0def4b2d933ab52a855d6e1c1ecf0f70379f00c8" Dec 04 00:42:29.523632 master-0 kubenswrapper[8678]: I1204 00:42:29.523525 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:29.523632 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:29.523632 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:29.523632 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:29.523632 master-0 kubenswrapper[8678]: I1204 00:42:29.523621 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:29.850878 master-0 kubenswrapper[8678]: I1204 00:42:29.850789 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:42:30.181781 master-0 kubenswrapper[8678]: I1204 00:42:30.181594 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/1.log" Dec 04 00:42:30.183568 master-0 kubenswrapper[8678]: I1204 00:42:30.183508 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/0.log" Dec 04 00:42:30.183716 master-0 kubenswrapper[8678]: I1204 00:42:30.183609 8678 generic.go:334] "Generic (PLEG): container finished" podID="47152378-4ef5-4eff-9b30-fd8635982f02" containerID="f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88" exitCode=1 Dec 04 00:42:30.183790 master-0 kubenswrapper[8678]: I1204 00:42:30.183738 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerDied","Data":"f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88"} Dec 04 00:42:30.183875 master-0 kubenswrapper[8678]: I1204 00:42:30.183835 8678 scope.go:117] "RemoveContainer" containerID="36a2cab4ca8775c3db41d1bd854a9aa530900e8e907d105b1156a340fd433e8d" Dec 04 00:42:30.184844 master-0 kubenswrapper[8678]: I1204 00:42:30.184795 8678 scope.go:117] "RemoveContainer" containerID="f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88" Dec 04 00:42:30.185262 master-0 kubenswrapper[8678]: E1204 00:42:30.185216 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=operator-controller-controller-manager-5f78c89466-mwkdg_openshift-operator-controller(47152378-4ef5-4eff-9b30-fd8635982f02)\"" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" Dec 04 00:42:30.197082 master-0 kubenswrapper[8678]: I1204 00:42:30.196993 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 00:42:30.197972 master-0 kubenswrapper[8678]: I1204 00:42:30.197839 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"04f26e45a98c2120063f3883f7318c4a1034574775719899e4a1164ade681bf3"} Dec 04 00:42:30.201679 master-0 kubenswrapper[8678]: I1204 00:42:30.201568 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/3.log" Dec 04 00:42:30.202619 master-0 kubenswrapper[8678]: I1204 00:42:30.202473 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16"} Dec 04 00:42:30.522967 master-0 kubenswrapper[8678]: I1204 00:42:30.522784 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:30.522967 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:30.522967 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:30.522967 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:30.522967 master-0 kubenswrapper[8678]: I1204 00:42:30.522879 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:31.214007 master-0 kubenswrapper[8678]: I1204 00:42:31.213697 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/1.log" Dec 04 00:42:31.524244 master-0 kubenswrapper[8678]: I1204 00:42:31.524011 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:31.524244 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:31.524244 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:31.524244 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:31.524244 master-0 kubenswrapper[8678]: I1204 00:42:31.524139 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:32.524320 master-0 kubenswrapper[8678]: I1204 00:42:32.524243 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:32.524320 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:32.524320 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:32.524320 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:32.524320 master-0 kubenswrapper[8678]: I1204 00:42:32.524326 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:33.523743 master-0 kubenswrapper[8678]: I1204 00:42:33.523635 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:33.523743 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:33.523743 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:33.523743 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:33.524296 master-0 kubenswrapper[8678]: I1204 00:42:33.523745 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:33.527085 master-0 kubenswrapper[8678]: I1204 00:42:33.527029 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:42:33.528042 master-0 kubenswrapper[8678]: I1204 00:42:33.527991 8678 scope.go:117] "RemoveContainer" containerID="fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb" Dec 04 00:42:33.528378 master-0 kubenswrapper[8678]: E1204 00:42:33.528315 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=catalogd-controller-manager-754cfd84-zjpxn_openshift-catalogd(bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced)\"" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" podUID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" Dec 04 00:42:33.751223 master-0 kubenswrapper[8678]: E1204 00:42:33.751119 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:42:33.850541 master-0 kubenswrapper[8678]: I1204 00:42:33.850443 8678 scope.go:117] "RemoveContainer" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" Dec 04 00:42:34.246461 master-0 kubenswrapper[8678]: I1204 00:42:34.246291 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerStarted","Data":"92792118dd0a5a1a1c921b14d629d4d25ef671bee8053d80a341b1994ffec4a3"} Dec 04 00:42:34.246942 master-0 kubenswrapper[8678]: I1204 00:42:34.246841 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:42:34.250244 master-0 kubenswrapper[8678]: I1204 00:42:34.250166 8678 patch_prober.go:28] interesting pod/marketplace-operator-7d67745bb7-2qnbf container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" start-of-body= Dec 04 00:42:34.250356 master-0 kubenswrapper[8678]: I1204 00:42:34.250291 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" podUID="aa2eaba9-479e-4420-a24f-63530e4da783" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.9:8080/healthz\": dial tcp 10.128.0.9:8080: connect: connection refused" Dec 04 00:42:34.524109 master-0 kubenswrapper[8678]: I1204 00:42:34.523887 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:34.524109 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:34.524109 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:34.524109 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:34.524109 master-0 kubenswrapper[8678]: I1204 00:42:34.524020 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:35.231827 master-0 kubenswrapper[8678]: I1204 00:42:35.231745 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:42:35.232627 master-0 kubenswrapper[8678]: I1204 00:42:35.232277 8678 scope.go:117] "RemoveContainer" containerID="f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88" Dec 04 00:42:35.232627 master-0 kubenswrapper[8678]: E1204 00:42:35.232558 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=operator-controller-controller-manager-5f78c89466-mwkdg_openshift-operator-controller(47152378-4ef5-4eff-9b30-fd8635982f02)\"" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" podUID="47152378-4ef5-4eff-9b30-fd8635982f02" Dec 04 00:42:35.263294 master-0 kubenswrapper[8678]: I1204 00:42:35.263202 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:42:35.468860 master-0 kubenswrapper[8678]: I1204 00:42:35.468773 8678 scope.go:117] "RemoveContainer" containerID="18136422546c4a147a7c94fb498b0ad89b67c61c8dd61c5af0d85a4eadbfa728" Dec 04 00:42:35.531521 master-0 kubenswrapper[8678]: I1204 00:42:35.526214 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:35.531521 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:35.531521 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:35.531521 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:35.531521 master-0 kubenswrapper[8678]: I1204 00:42:35.526328 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:36.265664 master-0 kubenswrapper[8678]: I1204 00:42:36.265583 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/2.log" Dec 04 00:42:36.265664 master-0 kubenswrapper[8678]: I1204 00:42:36.265650 8678 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1" exitCode=1 Dec 04 00:42:36.266623 master-0 kubenswrapper[8678]: I1204 00:42:36.265724 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerDied","Data":"773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1"} Dec 04 00:42:36.266623 master-0 kubenswrapper[8678]: I1204 00:42:36.266498 8678 scope.go:117] "RemoveContainer" containerID="773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1" Dec 04 00:42:36.266981 master-0 kubenswrapper[8678]: E1204 00:42:36.266903 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:42:36.523846 master-0 kubenswrapper[8678]: I1204 00:42:36.523639 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:36.523846 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:36.523846 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:36.523846 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:36.523846 master-0 kubenswrapper[8678]: I1204 00:42:36.523739 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:37.524549 master-0 kubenswrapper[8678]: I1204 00:42:37.524357 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:37.524549 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:37.524549 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:37.524549 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:37.524549 master-0 kubenswrapper[8678]: I1204 00:42:37.524465 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:38.186187 master-0 kubenswrapper[8678]: I1204 00:42:38.186003 8678 status_manager.go:851] "Failed to get status for pod" podUID="ebf07eb54db570834b7c9a90b6b07403" pod="openshift-etcd/etcd-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods etcd-master-0)" Dec 04 00:42:38.524249 master-0 kubenswrapper[8678]: I1204 00:42:38.524053 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:38.524249 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:38.524249 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:38.524249 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:38.524249 master-0 kubenswrapper[8678]: I1204 00:42:38.524154 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:39.523405 master-0 kubenswrapper[8678]: I1204 00:42:39.523314 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:39.523405 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:39.523405 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:39.523405 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:39.523405 master-0 kubenswrapper[8678]: I1204 00:42:39.523395 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:39.745069 master-0 kubenswrapper[8678]: E1204 00:42:39.744890 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="6.4s" Dec 04 00:42:40.530696 master-0 kubenswrapper[8678]: I1204 00:42:40.523698 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:40.530696 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:40.530696 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:40.530696 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:40.530696 master-0 kubenswrapper[8678]: I1204 00:42:40.523818 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:41.523261 master-0 kubenswrapper[8678]: I1204 00:42:41.523159 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:41.523261 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:41.523261 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:41.523261 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:41.524304 master-0 kubenswrapper[8678]: I1204 00:42:41.523277 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:42.523541 master-0 kubenswrapper[8678]: I1204 00:42:42.523455 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:42.523541 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:42.523541 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:42.523541 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:42.524280 master-0 kubenswrapper[8678]: I1204 00:42:42.523542 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:43.326187 master-0 kubenswrapper[8678]: I1204 00:42:43.326044 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 00:42:43.326858 master-0 kubenswrapper[8678]: I1204 00:42:43.326800 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/cluster-cloud-controller-manager/0.log" Dec 04 00:42:43.327051 master-0 kubenswrapper[8678]: I1204 00:42:43.326895 8678 generic.go:334] "Generic (PLEG): container finished" podID="b900991f-c6ec-45d1-a76b-44aec0f56cde" containerID="1fce128595f021cc732e1d1f11e229a1b136cad65889380e6f7c888dae64bf44" exitCode=1 Dec 04 00:42:43.327051 master-0 kubenswrapper[8678]: I1204 00:42:43.326994 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerDied","Data":"1fce128595f021cc732e1d1f11e229a1b136cad65889380e6f7c888dae64bf44"} Dec 04 00:42:43.327880 master-0 kubenswrapper[8678]: I1204 00:42:43.327836 8678 scope.go:117] "RemoveContainer" containerID="1fce128595f021cc732e1d1f11e229a1b136cad65889380e6f7c888dae64bf44" Dec 04 00:42:43.522955 master-0 kubenswrapper[8678]: I1204 00:42:43.522832 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:43.522955 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:43.522955 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:43.522955 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:43.523429 master-0 kubenswrapper[8678]: I1204 00:42:43.522999 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:43.527202 master-0 kubenswrapper[8678]: I1204 00:42:43.527139 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:42:43.528085 master-0 kubenswrapper[8678]: I1204 00:42:43.528036 8678 scope.go:117] "RemoveContainer" containerID="fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb" Dec 04 00:42:43.751865 master-0 kubenswrapper[8678]: E1204 00:42:43.751605 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:42:43.751865 master-0 kubenswrapper[8678]: E1204 00:42:43.751654 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:42:44.338959 master-0 kubenswrapper[8678]: I1204 00:42:44.338858 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/1.log" Dec 04 00:42:44.340397 master-0 kubenswrapper[8678]: I1204 00:42:44.340291 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" event={"ID":"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced","Type":"ContainerStarted","Data":"ecb3ebdffd739950e34670eee90555de670c2558bac74f5b8910518c841a4ca0"} Dec 04 00:42:44.342061 master-0 kubenswrapper[8678]: I1204 00:42:44.342007 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:42:44.347635 master-0 kubenswrapper[8678]: I1204 00:42:44.347556 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 00:42:44.348630 master-0 kubenswrapper[8678]: I1204 00:42:44.348543 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/cluster-cloud-controller-manager/0.log" Dec 04 00:42:44.348787 master-0 kubenswrapper[8678]: I1204 00:42:44.348677 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" event={"ID":"b900991f-c6ec-45d1-a76b-44aec0f56cde","Type":"ContainerStarted","Data":"2cfe675e0b44d315b0a7e2b6c2800598f85971227e506f9a28ee0ad5c104b043"} Dec 04 00:42:44.524250 master-0 kubenswrapper[8678]: I1204 00:42:44.524184 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:44.524250 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:44.524250 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:44.524250 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:44.531544 master-0 kubenswrapper[8678]: I1204 00:42:44.525201 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:45.232066 master-0 kubenswrapper[8678]: I1204 00:42:45.231909 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:42:45.233134 master-0 kubenswrapper[8678]: I1204 00:42:45.233087 8678 scope.go:117] "RemoveContainer" containerID="f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88" Dec 04 00:42:45.524398 master-0 kubenswrapper[8678]: I1204 00:42:45.524312 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:45.524398 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:45.524398 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:45.524398 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:45.524841 master-0 kubenswrapper[8678]: I1204 00:42:45.524502 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:46.380015 master-0 kubenswrapper[8678]: I1204 00:42:46.379902 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/1.log" Dec 04 00:42:46.380845 master-0 kubenswrapper[8678]: I1204 00:42:46.380784 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" event={"ID":"47152378-4ef5-4eff-9b30-fd8635982f02","Type":"ContainerStarted","Data":"ca3610993925096c6f1ab64896a1cfb123de9c7731f2a418249cac9a15e6eb47"} Dec 04 00:42:46.381313 master-0 kubenswrapper[8678]: I1204 00:42:46.381235 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:42:46.523715 master-0 kubenswrapper[8678]: I1204 00:42:46.523591 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:46.523715 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:46.523715 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:46.523715 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:46.523715 master-0 kubenswrapper[8678]: I1204 00:42:46.523673 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:47.523509 master-0 kubenswrapper[8678]: I1204 00:42:47.523264 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:47.523509 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:47.523509 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:47.523509 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:47.523509 master-0 kubenswrapper[8678]: I1204 00:42:47.523401 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:48.523621 master-0 kubenswrapper[8678]: I1204 00:42:48.523534 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:48.523621 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:48.523621 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:48.523621 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:48.524375 master-0 kubenswrapper[8678]: I1204 00:42:48.523638 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:48.849860 master-0 kubenswrapper[8678]: I1204 00:42:48.849753 8678 scope.go:117] "RemoveContainer" containerID="773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1" Dec 04 00:42:48.850215 master-0 kubenswrapper[8678]: E1204 00:42:48.850152 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:42:49.522833 master-0 kubenswrapper[8678]: I1204 00:42:49.522737 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:49.522833 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:49.522833 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:49.522833 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:49.523505 master-0 kubenswrapper[8678]: I1204 00:42:49.522841 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:50.524028 master-0 kubenswrapper[8678]: I1204 00:42:50.523888 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:50.524028 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:50.524028 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:50.524028 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:50.525171 master-0 kubenswrapper[8678]: I1204 00:42:50.524050 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:51.523657 master-0 kubenswrapper[8678]: I1204 00:42:51.523516 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:51.523657 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:51.523657 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:51.523657 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:51.523657 master-0 kubenswrapper[8678]: I1204 00:42:51.523633 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:52.523760 master-0 kubenswrapper[8678]: I1204 00:42:52.523646 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:52.523760 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:52.523760 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:52.523760 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:52.523760 master-0 kubenswrapper[8678]: I1204 00:42:52.523750 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:52.941991 master-0 kubenswrapper[8678]: E1204 00:42:52.941789 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4980af55fc openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Started,Message:Started container wait-for-host-port,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:37.248800252 +0000 UTC m=+620.575532808,LastTimestamp:2025-12-04 00:40:37.248800252 +0000 UTC m=+620.575532808,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:42:53.523903 master-0 kubenswrapper[8678]: I1204 00:42:53.523783 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:53.523903 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:53.523903 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:53.523903 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:53.525154 master-0 kubenswrapper[8678]: I1204 00:42:53.523955 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:53.530766 master-0 kubenswrapper[8678]: I1204 00:42:53.530714 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:42:54.524004 master-0 kubenswrapper[8678]: I1204 00:42:54.523862 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:54.524004 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:54.524004 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:54.524004 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:54.525111 master-0 kubenswrapper[8678]: I1204 00:42:54.524006 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:55.236140 master-0 kubenswrapper[8678]: I1204 00:42:55.236015 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:42:55.523568 master-0 kubenswrapper[8678]: I1204 00:42:55.523383 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:55.523568 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:55.523568 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:55.523568 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:55.523568 master-0 kubenswrapper[8678]: I1204 00:42:55.523502 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:56.147316 master-0 kubenswrapper[8678]: E1204 00:42:56.147220 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:42:56.523867 master-0 kubenswrapper[8678]: I1204 00:42:56.523653 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:56.523867 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:56.523867 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:56.523867 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:56.523867 master-0 kubenswrapper[8678]: I1204 00:42:56.523734 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:57.523153 master-0 kubenswrapper[8678]: I1204 00:42:57.523035 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:57.523153 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:57.523153 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:57.523153 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:57.523153 master-0 kubenswrapper[8678]: I1204 00:42:57.523145 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:58.524116 master-0 kubenswrapper[8678]: I1204 00:42:58.523998 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:58.524116 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:58.524116 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:58.524116 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:58.524116 master-0 kubenswrapper[8678]: I1204 00:42:58.524113 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:42:59.524124 master-0 kubenswrapper[8678]: I1204 00:42:59.523999 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:42:59.524124 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:42:59.524124 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:42:59.524124 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:42:59.524124 master-0 kubenswrapper[8678]: I1204 00:42:59.524116 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:00.523472 master-0 kubenswrapper[8678]: I1204 00:43:00.523353 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:00.523472 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:00.523472 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:00.523472 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:00.523472 master-0 kubenswrapper[8678]: I1204 00:43:00.523449 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:01.154610 master-0 kubenswrapper[8678]: E1204 00:43:01.154494 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:43:01.506137 master-0 kubenswrapper[8678]: I1204 00:43:01.506050 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"bfda60e9468bd1f09a61e5566915637d02a3202a0e4b0c3c89ce083d4719858b"} Dec 04 00:43:01.522626 master-0 kubenswrapper[8678]: I1204 00:43:01.522571 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:01.522626 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:01.522626 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:01.522626 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:01.522835 master-0 kubenswrapper[8678]: I1204 00:43:01.522637 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:01.849970 master-0 kubenswrapper[8678]: I1204 00:43:01.849883 8678 scope.go:117] "RemoveContainer" containerID="773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1" Dec 04 00:43:02.518154 master-0 kubenswrapper[8678]: I1204 00:43:02.518053 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/2.log" Dec 04 00:43:02.519326 master-0 kubenswrapper[8678]: I1204 00:43:02.518231 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2"} Dec 04 00:43:02.522709 master-0 kubenswrapper[8678]: I1204 00:43:02.522627 8678 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="bfda60e9468bd1f09a61e5566915637d02a3202a0e4b0c3c89ce083d4719858b" exitCode=0 Dec 04 00:43:02.522912 master-0 kubenswrapper[8678]: I1204 00:43:02.522700 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"bfda60e9468bd1f09a61e5566915637d02a3202a0e4b0c3c89ce083d4719858b"} Dec 04 00:43:02.523081 master-0 kubenswrapper[8678]: I1204 00:43:02.522998 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:02.523081 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:02.523081 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:02.523081 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:02.523427 master-0 kubenswrapper[8678]: I1204 00:43:02.523082 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:02.523427 master-0 kubenswrapper[8678]: I1204 00:43:02.523258 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:43:02.523427 master-0 kubenswrapper[8678]: I1204 00:43:02.523293 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:43:03.524950 master-0 kubenswrapper[8678]: I1204 00:43:03.524831 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:03.524950 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:03.524950 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:03.524950 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:03.526161 master-0 kubenswrapper[8678]: I1204 00:43:03.524957 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:03.861334 master-0 kubenswrapper[8678]: E1204 00:43:03.861237 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:42:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:42:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:42:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:42:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":false},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:04.523327 master-0 kubenswrapper[8678]: I1204 00:43:04.523204 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:04.523327 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:04.523327 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:04.523327 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:04.523857 master-0 kubenswrapper[8678]: I1204 00:43:04.523338 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:05.524256 master-0 kubenswrapper[8678]: I1204 00:43:05.524118 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:05.524256 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:05.524256 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:05.524256 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:05.524256 master-0 kubenswrapper[8678]: I1204 00:43:05.524226 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:05.550238 master-0 kubenswrapper[8678]: I1204 00:43:05.550141 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-cb84b9cdf-tsm24_62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/machine-approver-controller/0.log" Dec 04 00:43:05.550896 master-0 kubenswrapper[8678]: I1204 00:43:05.550818 8678 generic.go:334] "Generic (PLEG): container finished" podID="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" containerID="74dc0ef48d8fe1939f3624a82b33b96968f437acd029a208849d167b8818221f" exitCode=255 Dec 04 00:43:05.551029 master-0 kubenswrapper[8678]: I1204 00:43:05.550908 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" event={"ID":"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb","Type":"ContainerDied","Data":"74dc0ef48d8fe1939f3624a82b33b96968f437acd029a208849d167b8818221f"} Dec 04 00:43:05.552011 master-0 kubenswrapper[8678]: I1204 00:43:05.551917 8678 scope.go:117] "RemoveContainer" containerID="74dc0ef48d8fe1939f3624a82b33b96968f437acd029a208849d167b8818221f" Dec 04 00:43:06.523791 master-0 kubenswrapper[8678]: I1204 00:43:06.523726 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:06.523791 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:06.523791 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:06.523791 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:06.524761 master-0 kubenswrapper[8678]: I1204 00:43:06.523830 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:06.561038 master-0 kubenswrapper[8678]: I1204 00:43:06.560907 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-cb84b9cdf-tsm24_62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/machine-approver-controller/0.log" Dec 04 00:43:06.561588 master-0 kubenswrapper[8678]: I1204 00:43:06.561531 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" event={"ID":"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb","Type":"ContainerStarted","Data":"8000d81e035069ef4db06656d61f649acca4b5fa31c4f823032c4223b4001cee"} Dec 04 00:43:07.523646 master-0 kubenswrapper[8678]: I1204 00:43:07.523542 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:07.523646 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:07.523646 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:07.523646 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:07.523646 master-0 kubenswrapper[8678]: I1204 00:43:07.523634 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:08.523671 master-0 kubenswrapper[8678]: I1204 00:43:08.523588 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:08.523671 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:08.523671 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:08.523671 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:08.524510 master-0 kubenswrapper[8678]: I1204 00:43:08.523708 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:09.523254 master-0 kubenswrapper[8678]: I1204 00:43:09.523183 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:09.523254 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:09.523254 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:09.523254 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:09.523642 master-0 kubenswrapper[8678]: I1204 00:43:09.523259 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:09.599239 master-0 kubenswrapper[8678]: I1204 00:43:09.599163 8678 generic.go:334] "Generic (PLEG): container finished" podID="2ad96246-c53a-4016-b67d-5e9d66f40d5b" containerID="8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f" exitCode=0 Dec 04 00:43:09.600250 master-0 kubenswrapper[8678]: I1204 00:43:09.599246 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerDied","Data":"8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f"} Dec 04 00:43:09.600250 master-0 kubenswrapper[8678]: I1204 00:43:09.600087 8678 scope.go:117] "RemoveContainer" containerID="7630ed34c5afaf7ec052397359ddb4e03d2aaa0074ba8d9aa9989ae1eab28f0b" Dec 04 00:43:09.600909 master-0 kubenswrapper[8678]: I1204 00:43:09.600839 8678 scope.go:117] "RemoveContainer" containerID="8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f" Dec 04 00:43:09.601270 master-0 kubenswrapper[8678]: E1204 00:43:09.601130 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ovnkube-cluster-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ovnkube-cluster-manager pod=ovnkube-control-plane-f9f7f4946-kwdfc_openshift-ovn-kubernetes(2ad96246-c53a-4016-b67d-5e9d66f40d5b)\"" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" podUID="2ad96246-c53a-4016-b67d-5e9d66f40d5b" Dec 04 00:43:09.602878 master-0 kubenswrapper[8678]: I1204 00:43:09.602570 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72_a6a2308d-6d6f-4e8d-a6db-d931a172ed55/control-plane-machine-set-operator/0.log" Dec 04 00:43:09.602878 master-0 kubenswrapper[8678]: I1204 00:43:09.602623 8678 generic.go:334] "Generic (PLEG): container finished" podID="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" containerID="e5be4fe727906d907e13052e2f5e4da30f0568dc3c005e899e0bb15bd8847ece" exitCode=1 Dec 04 00:43:09.602878 master-0 kubenswrapper[8678]: I1204 00:43:09.602669 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" event={"ID":"a6a2308d-6d6f-4e8d-a6db-d931a172ed55","Type":"ContainerDied","Data":"e5be4fe727906d907e13052e2f5e4da30f0568dc3c005e899e0bb15bd8847ece"} Dec 04 00:43:09.603546 master-0 kubenswrapper[8678]: I1204 00:43:09.603475 8678 scope.go:117] "RemoveContainer" containerID="e5be4fe727906d907e13052e2f5e4da30f0568dc3c005e899e0bb15bd8847ece" Dec 04 00:43:10.523268 master-0 kubenswrapper[8678]: I1204 00:43:10.523168 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:10.523268 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:10.523268 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:10.523268 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:10.523585 master-0 kubenswrapper[8678]: I1204 00:43:10.523310 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:10.616343 master-0 kubenswrapper[8678]: I1204 00:43:10.616251 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72_a6a2308d-6d6f-4e8d-a6db-d931a172ed55/control-plane-machine-set-operator/0.log" Dec 04 00:43:10.616992 master-0 kubenswrapper[8678]: I1204 00:43:10.616438 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" event={"ID":"a6a2308d-6d6f-4e8d-a6db-d931a172ed55","Type":"ContainerStarted","Data":"f0110a77c08731543afb9f23f5d794f7e8812837600f60cfbab48dd5596d5929"} Dec 04 00:43:11.523873 master-0 kubenswrapper[8678]: I1204 00:43:11.523758 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:11.523873 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:11.523873 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:11.523873 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:11.523873 master-0 kubenswrapper[8678]: I1204 00:43:11.523849 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:12.522510 master-0 kubenswrapper[8678]: I1204 00:43:12.522413 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:12.522510 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:12.522510 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:12.522510 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:12.522510 master-0 kubenswrapper[8678]: I1204 00:43:12.522504 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:13.149218 master-0 kubenswrapper[8678]: E1204 00:43:13.149057 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:43:13.524527 master-0 kubenswrapper[8678]: I1204 00:43:13.524366 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:13.524527 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:13.524527 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:13.524527 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:13.525195 master-0 kubenswrapper[8678]: I1204 00:43:13.524502 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:13.861618 master-0 kubenswrapper[8678]: E1204 00:43:13.861527 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:14.524066 master-0 kubenswrapper[8678]: I1204 00:43:14.523969 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:14.524066 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:14.524066 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:14.524066 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:14.524066 master-0 kubenswrapper[8678]: I1204 00:43:14.524058 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:15.523523 master-0 kubenswrapper[8678]: I1204 00:43:15.523361 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:15.523523 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:15.523523 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:15.523523 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:15.523523 master-0 kubenswrapper[8678]: I1204 00:43:15.523503 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: I1204 00:43:16.524297 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: I1204 00:43:16.524383 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:43:16.524462 master-0 kubenswrapper[8678]: I1204 00:43:16.524443 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:43:16.525329 master-0 kubenswrapper[8678]: I1204 00:43:16.525243 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="router" containerStatusID={"Type":"cri-o","ID":"47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f"} pod="openshift-ingress/router-default-54f97f57-x27s4" containerMessage="Container router failed startup probe, will be restarted" Dec 04 00:43:16.525329 master-0 kubenswrapper[8678]: I1204 00:43:16.525292 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" containerID="cri-o://47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f" gracePeriod=3600 Dec 04 00:43:16.664433 master-0 kubenswrapper[8678]: I1204 00:43:16.664358 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/0.log" Dec 04 00:43:16.664433 master-0 kubenswrapper[8678]: I1204 00:43:16.664424 8678 generic.go:334] "Generic (PLEG): container finished" podID="17f5a6f7-07dc-45cc-9db4-810f84b678d1" containerID="b24ed2d1ef2791d02d0f1079016d82083723bce74954fc72d43fc7f3fff32d76" exitCode=1 Dec 04 00:43:16.664729 master-0 kubenswrapper[8678]: I1204 00:43:16.664480 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerDied","Data":"b24ed2d1ef2791d02d0f1079016d82083723bce74954fc72d43fc7f3fff32d76"} Dec 04 00:43:16.665407 master-0 kubenswrapper[8678]: I1204 00:43:16.665363 8678 scope.go:117] "RemoveContainer" containerID="b24ed2d1ef2791d02d0f1079016d82083723bce74954fc72d43fc7f3fff32d76" Dec 04 00:43:17.674598 master-0 kubenswrapper[8678]: I1204 00:43:17.674516 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/0.log" Dec 04 00:43:17.675599 master-0 kubenswrapper[8678]: I1204 00:43:17.674603 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerStarted","Data":"f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3"} Dec 04 00:43:18.688295 master-0 kubenswrapper[8678]: I1204 00:43:18.688182 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:43:18.689099 master-0 kubenswrapper[8678]: I1204 00:43:18.688301 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="b039d39a2371ff5e21f7e918ef96ad96800e7537a564d12b8ab0105917d18f76" exitCode=0 Dec 04 00:43:18.689099 master-0 kubenswrapper[8678]: I1204 00:43:18.688362 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"b039d39a2371ff5e21f7e918ef96ad96800e7537a564d12b8ab0105917d18f76"} Dec 04 00:43:18.689386 master-0 kubenswrapper[8678]: I1204 00:43:18.689335 8678 scope.go:117] "RemoveContainer" containerID="b039d39a2371ff5e21f7e918ef96ad96800e7537a564d12b8ab0105917d18f76" Dec 04 00:43:19.704728 master-0 kubenswrapper[8678]: I1204 00:43:19.704565 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:43:19.704728 master-0 kubenswrapper[8678]: I1204 00:43:19.704656 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c"} Dec 04 00:43:19.944776 master-0 kubenswrapper[8678]: I1204 00:43:19.944270 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:43:19.944776 master-0 kubenswrapper[8678]: I1204 00:43:19.944384 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:43:20.850235 master-0 kubenswrapper[8678]: I1204 00:43:20.850132 8678 scope.go:117] "RemoveContainer" containerID="8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f" Dec 04 00:43:21.724260 master-0 kubenswrapper[8678]: I1204 00:43:21.724162 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" event={"ID":"2ad96246-c53a-4016-b67d-5e9d66f40d5b","Type":"ContainerStarted","Data":"723c7f1daf8d51652c3b09e030a2d9ea33a9ea631eead19a76ebe1c537610a7a"} Dec 04 00:43:22.944609 master-0 kubenswrapper[8678]: I1204 00:43:22.944498 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:43:22.945420 master-0 kubenswrapper[8678]: I1204 00:43:22.944630 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:23.862374 master-0 kubenswrapper[8678]: E1204 00:43:23.862306 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:26.944774 master-0 kubenswrapper[8678]: E1204 00:43:26.944555 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4aa8d033f9 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:42.217010169 +0000 UTC m=+625.543742755,LastTimestamp:2025-12-04 00:40:42.217010169 +0000 UTC m=+625.543742755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:43:30.150851 master-0 kubenswrapper[8678]: E1204 00:43:30.150676 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:43:32.816117 master-0 kubenswrapper[8678]: I1204 00:43:32.816041 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/3.log" Dec 04 00:43:32.816810 master-0 kubenswrapper[8678]: I1204 00:43:32.816745 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/2.log" Dec 04 00:43:32.816884 master-0 kubenswrapper[8678]: I1204 00:43:32.816853 8678 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" exitCode=1 Dec 04 00:43:32.817091 master-0 kubenswrapper[8678]: I1204 00:43:32.817042 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerDied","Data":"56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2"} Dec 04 00:43:32.817712 master-0 kubenswrapper[8678]: I1204 00:43:32.817639 8678 scope.go:117] "RemoveContainer" containerID="773f274d780305a760d80b7fca32e107c3d1a7698e84df0582522a16b79759d1" Dec 04 00:43:32.817881 master-0 kubenswrapper[8678]: I1204 00:43:32.817755 8678 scope.go:117] "RemoveContainer" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" Dec 04 00:43:32.818058 master-0 kubenswrapper[8678]: E1204 00:43:32.818039 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:43:32.944097 master-0 kubenswrapper[8678]: I1204 00:43:32.944016 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:43:32.944311 master-0 kubenswrapper[8678]: I1204 00:43:32.944099 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:33.828382 master-0 kubenswrapper[8678]: I1204 00:43:33.828278 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/3.log" Dec 04 00:43:33.862760 master-0 kubenswrapper[8678]: E1204 00:43:33.862614 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:36.526623 master-0 kubenswrapper[8678]: E1204 00:43:36.526532 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:43:36.864049 master-0 kubenswrapper[8678]: I1204 00:43:36.863963 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"50bc3ef940109b58d6db2f4987717d4d8bf043dc726131752c9f5868f606431e"} Dec 04 00:43:37.885166 master-0 kubenswrapper[8678]: I1204 00:43:37.885048 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"73a0a851fc87078c91307a057c74b8897b9a941bd7c6acebecf52bbe87adbf2f"} Dec 04 00:43:37.885166 master-0 kubenswrapper[8678]: I1204 00:43:37.885111 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"e5a3bb33b325eef7f383c0d659e0c02d068419e9a7e184bfd8398e85be8ec9d8"} Dec 04 00:43:37.885166 master-0 kubenswrapper[8678]: I1204 00:43:37.885125 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"3dc53442451539a70d9cbd440858ffdafc4bc2364b6f832ccbfb1ad0f4b49d4e"} Dec 04 00:43:38.200369 master-0 kubenswrapper[8678]: I1204 00:43:38.200206 8678 status_manager.go:851] "Failed to get status for pod" podUID="4dd8b778e190b1975a0a8fad534da6dd" pod="openshift-etcd/etcd-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods etcd-master-0)" Dec 04 00:43:38.899859 master-0 kubenswrapper[8678]: I1204 00:43:38.899766 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"04eaa0d1e99785cc1b2c1318fb89cd242f6c9e21b8d818d07d3c042a6d8475fc"} Dec 04 00:43:38.900445 master-0 kubenswrapper[8678]: I1204 00:43:38.900240 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:43:38.900445 master-0 kubenswrapper[8678]: I1204 00:43:38.900274 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:43:40.885627 master-0 kubenswrapper[8678]: I1204 00:43:40.885532 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 00:43:40.886322 master-0 kubenswrapper[8678]: I1204 00:43:40.885648 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 00:43:42.945309 master-0 kubenswrapper[8678]: I1204 00:43:42.945203 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:43:42.946476 master-0 kubenswrapper[8678]: I1204 00:43:42.945320 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:42.946476 master-0 kubenswrapper[8678]: I1204 00:43:42.945421 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:43:42.946775 master-0 kubenswrapper[8678]: I1204 00:43:42.946712 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 00:43:42.946954 master-0 kubenswrapper[8678]: I1204 00:43:42.946886 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" containerID="cri-o://548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c" gracePeriod=30 Dec 04 00:43:43.864068 master-0 kubenswrapper[8678]: E1204 00:43:43.863981 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:43.864068 master-0 kubenswrapper[8678]: E1204 00:43:43.864043 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:43:43.944080 master-0 kubenswrapper[8678]: I1204 00:43:43.944026 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/1.log" Dec 04 00:43:43.947113 master-0 kubenswrapper[8678]: I1204 00:43:43.947081 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:43:43.947874 master-0 kubenswrapper[8678]: I1204 00:43:43.947833 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c" exitCode=255 Dec 04 00:43:43.948069 master-0 kubenswrapper[8678]: I1204 00:43:43.947922 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c"} Dec 04 00:43:43.948254 master-0 kubenswrapper[8678]: I1204 00:43:43.948221 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b"} Dec 04 00:43:43.948395 master-0 kubenswrapper[8678]: I1204 00:43:43.948302 8678 scope.go:117] "RemoveContainer" containerID="b039d39a2371ff5e21f7e918ef96ad96800e7537a564d12b8ab0105917d18f76" Dec 04 00:43:44.961419 master-0 kubenswrapper[8678]: I1204 00:43:44.961318 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/1.log" Dec 04 00:43:44.964318 master-0 kubenswrapper[8678]: I1204 00:43:44.964253 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:43:47.151394 master-0 kubenswrapper[8678]: E1204 00:43:47.151254 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:43:47.850008 master-0 kubenswrapper[8678]: I1204 00:43:47.849874 8678 scope.go:117] "RemoveContainer" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" Dec 04 00:43:47.850396 master-0 kubenswrapper[8678]: E1204 00:43:47.850282 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:43:49.952458 master-0 kubenswrapper[8678]: I1204 00:43:49.952326 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:43:49.953205 master-0 kubenswrapper[8678]: I1204 00:43:49.952467 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:43:50.931856 master-0 kubenswrapper[8678]: I1204 00:43:50.931771 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 00:43:52.953217 master-0 kubenswrapper[8678]: I1204 00:43:52.953111 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:43:52.953217 master-0 kubenswrapper[8678]: I1204 00:43:52.953215 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:43:55.921971 master-0 kubenswrapper[8678]: I1204 00:43:55.921877 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 00:44:00.947440 master-0 kubenswrapper[8678]: E1204 00:44:00.947160 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4ab9266e90 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Created,Message:Created container: kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:42.49109672 +0000 UTC m=+625.817829276,LastTimestamp:2025-12-04 00:40:42.49109672 +0000 UTC m=+625.817829276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:44:01.850237 master-0 kubenswrapper[8678]: I1204 00:44:01.850104 8678 scope.go:117] "RemoveContainer" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" Dec 04 00:44:01.851036 master-0 kubenswrapper[8678]: E1204 00:44:01.850764 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:44:02.945000 master-0 kubenswrapper[8678]: I1204 00:44:02.944858 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:44:02.945886 master-0 kubenswrapper[8678]: I1204 00:44:02.945026 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:03.126305 master-0 kubenswrapper[8678]: I1204 00:44:03.126237 8678 generic.go:334] "Generic (PLEG): container finished" podID="83e0d056-186c-4067-b586-14fe2970fcc0" containerID="47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f" exitCode=0 Dec 04 00:44:03.126705 master-0 kubenswrapper[8678]: I1204 00:44:03.126358 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerDied","Data":"47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f"} Dec 04 00:44:03.126832 master-0 kubenswrapper[8678]: I1204 00:44:03.126806 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f"} Dec 04 00:44:03.127072 master-0 kubenswrapper[8678]: I1204 00:44:03.127008 8678 scope.go:117] "RemoveContainer" containerID="e359729a9d1b37b14db0e2e89654b17417d8c677243fa36116addd22735dd632" Dec 04 00:44:03.520413 master-0 kubenswrapper[8678]: I1204 00:44:03.520212 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:44:03.524420 master-0 kubenswrapper[8678]: I1204 00:44:03.524352 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:03.524420 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:03.524420 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:03.524420 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:03.524609 master-0 kubenswrapper[8678]: I1204 00:44:03.524455 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:04.152154 master-0 kubenswrapper[8678]: E1204 00:44:04.152020 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:44:04.523862 master-0 kubenswrapper[8678]: I1204 00:44:04.523710 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:04.523862 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:04.523862 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:04.523862 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:04.523862 master-0 kubenswrapper[8678]: I1204 00:44:04.523777 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:05.522890 master-0 kubenswrapper[8678]: I1204 00:44:05.522772 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:05.522890 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:05.522890 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:05.522890 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:05.524069 master-0 kubenswrapper[8678]: I1204 00:44:05.523008 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:06.524350 master-0 kubenswrapper[8678]: I1204 00:44:06.524240 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:06.524350 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:06.524350 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:06.524350 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:06.525385 master-0 kubenswrapper[8678]: I1204 00:44:06.524387 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:07.524025 master-0 kubenswrapper[8678]: I1204 00:44:07.523915 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:07.524025 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:07.524025 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:07.524025 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:07.524901 master-0 kubenswrapper[8678]: I1204 00:44:07.524039 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:08.523623 master-0 kubenswrapper[8678]: I1204 00:44:08.523553 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:08.523623 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:08.523623 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:08.523623 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:08.524038 master-0 kubenswrapper[8678]: I1204 00:44:08.523641 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:09.523225 master-0 kubenswrapper[8678]: I1204 00:44:09.523123 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:09.523225 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:09.523225 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:09.523225 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:09.524617 master-0 kubenswrapper[8678]: I1204 00:44:09.523246 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:10.520645 master-0 kubenswrapper[8678]: I1204 00:44:10.520558 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:44:10.523482 master-0 kubenswrapper[8678]: I1204 00:44:10.523379 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:10.523482 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:10.523482 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:10.523482 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:10.524227 master-0 kubenswrapper[8678]: I1204 00:44:10.524177 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:11.524997 master-0 kubenswrapper[8678]: I1204 00:44:11.524556 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:11.524997 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:11.524997 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:11.524997 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:11.524997 master-0 kubenswrapper[8678]: I1204 00:44:11.524651 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:12.523222 master-0 kubenswrapper[8678]: I1204 00:44:12.523102 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:12.523222 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:12.523222 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:12.523222 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:12.523222 master-0 kubenswrapper[8678]: I1204 00:44:12.523209 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:12.903203 master-0 kubenswrapper[8678]: E1204 00:44:12.903091 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:44:12.944563 master-0 kubenswrapper[8678]: I1204 00:44:12.944456 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:44:12.944830 master-0 kubenswrapper[8678]: I1204 00:44:12.944554 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:12.944830 master-0 kubenswrapper[8678]: I1204 00:44:12.944632 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:44:12.945920 master-0 kubenswrapper[8678]: I1204 00:44:12.945756 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 00:44:12.946129 master-0 kubenswrapper[8678]: I1204 00:44:12.946078 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" containerID="cri-o://193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b" gracePeriod=30 Dec 04 00:44:13.220056 master-0 kubenswrapper[8678]: I1204 00:44:13.219842 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:44:13.220056 master-0 kubenswrapper[8678]: I1204 00:44:13.219901 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:44:13.523287 master-0 kubenswrapper[8678]: I1204 00:44:13.523121 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:13.523287 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:13.523287 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:13.523287 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:13.523287 master-0 kubenswrapper[8678]: I1204 00:44:13.523217 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:14.229673 master-0 kubenswrapper[8678]: I1204 00:44:14.229621 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/2.log" Dec 04 00:44:14.230230 master-0 kubenswrapper[8678]: I1204 00:44:14.230179 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/1.log" Dec 04 00:44:14.231893 master-0 kubenswrapper[8678]: I1204 00:44:14.231864 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:44:14.231986 master-0 kubenswrapper[8678]: I1204 00:44:14.231941 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b" exitCode=255 Dec 04 00:44:14.232037 master-0 kubenswrapper[8678]: I1204 00:44:14.231987 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b"} Dec 04 00:44:14.232084 master-0 kubenswrapper[8678]: I1204 00:44:14.232035 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} Dec 04 00:44:14.232084 master-0 kubenswrapper[8678]: I1204 00:44:14.232060 8678 scope.go:117] "RemoveContainer" containerID="548cf9c8df3edcbcbf5913ccfe90762a8b8a1a45d1f5182f10c612acf68dce5c" Dec 04 00:44:14.523182 master-0 kubenswrapper[8678]: I1204 00:44:14.522880 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:14.523182 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:14.523182 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:14.523182 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:14.523548 master-0 kubenswrapper[8678]: I1204 00:44:14.523164 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:15.245973 master-0 kubenswrapper[8678]: I1204 00:44:15.245858 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/2.log" Dec 04 00:44:15.249996 master-0 kubenswrapper[8678]: I1204 00:44:15.249918 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:44:15.522727 master-0 kubenswrapper[8678]: I1204 00:44:15.522568 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:15.522727 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:15.522727 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:15.522727 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:15.522727 master-0 kubenswrapper[8678]: I1204 00:44:15.522654 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:16.523480 master-0 kubenswrapper[8678]: I1204 00:44:16.523418 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:16.523480 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:16.523480 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:16.523480 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:16.524592 master-0 kubenswrapper[8678]: I1204 00:44:16.523512 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:16.850860 master-0 kubenswrapper[8678]: I1204 00:44:16.850785 8678 scope.go:117] "RemoveContainer" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" Dec 04 00:44:17.277468 master-0 kubenswrapper[8678]: I1204 00:44:17.277240 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/3.log" Dec 04 00:44:17.277783 master-0 kubenswrapper[8678]: I1204 00:44:17.277436 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342"} Dec 04 00:44:17.281115 master-0 kubenswrapper[8678]: I1204 00:44:17.281048 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/1.log" Dec 04 00:44:17.282507 master-0 kubenswrapper[8678]: I1204 00:44:17.282453 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/0.log" Dec 04 00:44:17.282625 master-0 kubenswrapper[8678]: I1204 00:44:17.282537 8678 generic.go:334] "Generic (PLEG): container finished" podID="17f5a6f7-07dc-45cc-9db4-810f84b678d1" containerID="f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3" exitCode=1 Dec 04 00:44:17.282625 master-0 kubenswrapper[8678]: I1204 00:44:17.282589 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerDied","Data":"f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3"} Dec 04 00:44:17.282761 master-0 kubenswrapper[8678]: I1204 00:44:17.282651 8678 scope.go:117] "RemoveContainer" containerID="b24ed2d1ef2791d02d0f1079016d82083723bce74954fc72d43fc7f3fff32d76" Dec 04 00:44:17.283569 master-0 kubenswrapper[8678]: I1204 00:44:17.283516 8678 scope.go:117] "RemoveContainer" containerID="f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3" Dec 04 00:44:17.284002 master-0 kubenswrapper[8678]: E1204 00:44:17.283912 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-baremetal-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cluster-baremetal-operator pod=cluster-baremetal-operator-5fdc576499-xlwrx_openshift-machine-api(17f5a6f7-07dc-45cc-9db4-810f84b678d1)\"" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" podUID="17f5a6f7-07dc-45cc-9db4-810f84b678d1" Dec 04 00:44:17.523619 master-0 kubenswrapper[8678]: I1204 00:44:17.523522 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:17.523619 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:17.523619 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:17.523619 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:17.523619 master-0 kubenswrapper[8678]: I1204 00:44:17.523613 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:18.292304 master-0 kubenswrapper[8678]: I1204 00:44:18.292184 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/1.log" Dec 04 00:44:18.523373 master-0 kubenswrapper[8678]: I1204 00:44:18.523255 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:18.523373 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:18.523373 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:18.523373 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:18.524041 master-0 kubenswrapper[8678]: I1204 00:44:18.523384 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:19.523656 master-0 kubenswrapper[8678]: I1204 00:44:19.523575 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:19.523656 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:19.523656 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:19.523656 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:19.524283 master-0 kubenswrapper[8678]: I1204 00:44:19.523662 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:19.944585 master-0 kubenswrapper[8678]: I1204 00:44:19.944477 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:44:19.944585 master-0 kubenswrapper[8678]: I1204 00:44:19.944597 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:44:20.523336 master-0 kubenswrapper[8678]: I1204 00:44:20.523236 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:20.523336 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:20.523336 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:20.523336 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:20.524366 master-0 kubenswrapper[8678]: I1204 00:44:20.523358 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:21.154206 master-0 kubenswrapper[8678]: E1204 00:44:21.154062 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:44:21.523996 master-0 kubenswrapper[8678]: I1204 00:44:21.523751 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:21.523996 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:21.523996 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:21.523996 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:21.523996 master-0 kubenswrapper[8678]: I1204 00:44:21.523863 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:22.523422 master-0 kubenswrapper[8678]: I1204 00:44:22.523321 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:22.523422 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:22.523422 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:22.523422 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:22.523886 master-0 kubenswrapper[8678]: I1204 00:44:22.523416 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:22.945634 master-0 kubenswrapper[8678]: I1204 00:44:22.945518 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:44:22.945634 master-0 kubenswrapper[8678]: I1204 00:44:22.945632 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:23.523686 master-0 kubenswrapper[8678]: I1204 00:44:23.523544 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:23.523686 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:23.523686 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:23.523686 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:23.524206 master-0 kubenswrapper[8678]: I1204 00:44:23.523696 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:24.523492 master-0 kubenswrapper[8678]: I1204 00:44:24.523257 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:24.523492 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:24.523492 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:24.523492 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:24.523492 master-0 kubenswrapper[8678]: I1204 00:44:24.523400 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:25.523841 master-0 kubenswrapper[8678]: I1204 00:44:25.523707 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:25.523841 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:25.523841 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:25.523841 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:25.524848 master-0 kubenswrapper[8678]: I1204 00:44:25.523856 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:26.523307 master-0 kubenswrapper[8678]: I1204 00:44:26.523221 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:26.523307 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:26.523307 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:26.523307 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:26.524579 master-0 kubenswrapper[8678]: I1204 00:44:26.523310 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:27.522686 master-0 kubenswrapper[8678]: I1204 00:44:27.522611 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:27.522686 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:27.522686 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:27.522686 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:27.523110 master-0 kubenswrapper[8678]: I1204 00:44:27.522695 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:28.524072 master-0 kubenswrapper[8678]: I1204 00:44:28.523972 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:28.524072 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:28.524072 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:28.524072 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:28.524072 master-0 kubenswrapper[8678]: I1204 00:44:28.524052 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:29.524658 master-0 kubenswrapper[8678]: I1204 00:44:29.524530 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:29.524658 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:29.524658 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:29.524658 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:29.524658 master-0 kubenswrapper[8678]: I1204 00:44:29.524647 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:29.850464 master-0 kubenswrapper[8678]: I1204 00:44:29.850370 8678 scope.go:117] "RemoveContainer" containerID="f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3" Dec 04 00:44:30.388845 master-0 kubenswrapper[8678]: I1204 00:44:30.388471 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/4.log" Dec 04 00:44:30.390040 master-0 kubenswrapper[8678]: I1204 00:44:30.389909 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/3.log" Dec 04 00:44:30.390689 master-0 kubenswrapper[8678]: I1204 00:44:30.390577 8678 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" exitCode=1 Dec 04 00:44:30.390911 master-0 kubenswrapper[8678]: I1204 00:44:30.390828 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerDied","Data":"8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16"} Dec 04 00:44:30.391021 master-0 kubenswrapper[8678]: I1204 00:44:30.390981 8678 scope.go:117] "RemoveContainer" containerID="84ba93491394990bc4e60fb05e352fb46b2a0b4923fa23941d71b1f95566e560" Dec 04 00:44:30.392228 master-0 kubenswrapper[8678]: I1204 00:44:30.392182 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:44:30.392623 master-0 kubenswrapper[8678]: E1204 00:44:30.392584 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:44:30.393900 master-0 kubenswrapper[8678]: I1204 00:44:30.393862 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/1.log" Dec 04 00:44:30.397645 master-0 kubenswrapper[8678]: I1204 00:44:30.397573 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" event={"ID":"17f5a6f7-07dc-45cc-9db4-810f84b678d1","Type":"ContainerStarted","Data":"d16652b333baaccdc5b735bdabafeb31577c8b3ffe7bf17d190715eba31dfb05"} Dec 04 00:44:30.523147 master-0 kubenswrapper[8678]: I1204 00:44:30.522896 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:30.523147 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:30.523147 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:30.523147 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:30.523147 master-0 kubenswrapper[8678]: I1204 00:44:30.523054 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:31.409037 master-0 kubenswrapper[8678]: I1204 00:44:31.408909 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/4.log" Dec 04 00:44:31.523826 master-0 kubenswrapper[8678]: I1204 00:44:31.523723 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:31.523826 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:31.523826 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:31.523826 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:31.523826 master-0 kubenswrapper[8678]: I1204 00:44:31.523802 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:32.523357 master-0 kubenswrapper[8678]: I1204 00:44:32.523298 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:32.523357 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:32.523357 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:32.523357 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:32.524084 master-0 kubenswrapper[8678]: I1204 00:44:32.523371 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:32.944052 master-0 kubenswrapper[8678]: I1204 00:44:32.943907 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:44:32.944366 master-0 kubenswrapper[8678]: I1204 00:44:32.944070 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:33.522996 master-0 kubenswrapper[8678]: I1204 00:44:33.522868 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:33.522996 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:33.522996 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:33.522996 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:33.524069 master-0 kubenswrapper[8678]: I1204 00:44:33.523012 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:34.524347 master-0 kubenswrapper[8678]: I1204 00:44:34.524226 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:34.524347 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:34.524347 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:34.524347 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:34.525132 master-0 kubenswrapper[8678]: I1204 00:44:34.524439 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:34.949994 master-0 kubenswrapper[8678]: E1204 00:44:34.949773 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4ab9fbb1a9 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Started,Message:Started container kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:42.505073065 +0000 UTC m=+625.831805621,LastTimestamp:2025-12-04 00:40:42.505073065 +0000 UTC m=+625.831805621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:44:35.523713 master-0 kubenswrapper[8678]: I1204 00:44:35.523454 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:35.523713 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:35.523713 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:35.523713 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:35.523713 master-0 kubenswrapper[8678]: I1204 00:44:35.523663 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:36.524130 master-0 kubenswrapper[8678]: I1204 00:44:36.524017 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:36.524130 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:36.524130 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:36.524130 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:36.524130 master-0 kubenswrapper[8678]: I1204 00:44:36.524132 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:37.524727 master-0 kubenswrapper[8678]: I1204 00:44:37.524625 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:37.524727 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:37.524727 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:37.524727 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:37.525551 master-0 kubenswrapper[8678]: I1204 00:44:37.524755 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:38.156707 master-0 kubenswrapper[8678]: E1204 00:44:38.156457 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:44:38.202810 master-0 kubenswrapper[8678]: I1204 00:44:38.202710 8678 status_manager.go:851] "Failed to get status for pod" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods csi-snapshot-controller-86897dd478-8zdrm)" Dec 04 00:44:38.523224 master-0 kubenswrapper[8678]: I1204 00:44:38.523025 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:38.523224 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:38.523224 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:38.523224 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:38.523224 master-0 kubenswrapper[8678]: I1204 00:44:38.523126 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:39.524110 master-0 kubenswrapper[8678]: I1204 00:44:39.523897 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:39.524110 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:39.524110 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:39.524110 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:39.524110 master-0 kubenswrapper[8678]: I1204 00:44:39.524070 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:40.523629 master-0 kubenswrapper[8678]: I1204 00:44:40.523510 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:40.523629 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:40.523629 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:40.523629 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:40.524186 master-0 kubenswrapper[8678]: I1204 00:44:40.523655 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:41.523702 master-0 kubenswrapper[8678]: I1204 00:44:41.523575 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:41.523702 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:41.523702 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:41.523702 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:41.523702 master-0 kubenswrapper[8678]: I1204 00:44:41.523669 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:42.523592 master-0 kubenswrapper[8678]: I1204 00:44:42.523470 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:42.523592 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:42.523592 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:42.523592 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:42.523592 master-0 kubenswrapper[8678]: I1204 00:44:42.523579 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:42.944813 master-0 kubenswrapper[8678]: I1204 00:44:42.944707 8678 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:44:42.945743 master-0 kubenswrapper[8678]: I1204 00:44:42.944818 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:42.945743 master-0 kubenswrapper[8678]: I1204 00:44:42.944900 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:44:42.946271 master-0 kubenswrapper[8678]: I1204 00:44:42.946192 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 00:44:42.946484 master-0 kubenswrapper[8678]: I1204 00:44:42.946419 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" containerID="cri-o://6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" gracePeriod=30 Dec 04 00:44:43.079548 master-0 kubenswrapper[8678]: E1204 00:44:43.079477 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:44:43.513182 master-0 kubenswrapper[8678]: I1204 00:44:43.513108 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:44:43.513568 master-0 kubenswrapper[8678]: I1204 00:44:43.513545 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/2.log" Dec 04 00:44:43.515025 master-0 kubenswrapper[8678]: I1204 00:44:43.514999 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:44:43.515157 master-0 kubenswrapper[8678]: I1204 00:44:43.515035 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" exitCode=255 Dec 04 00:44:43.515157 master-0 kubenswrapper[8678]: I1204 00:44:43.515069 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} Dec 04 00:44:43.515157 master-0 kubenswrapper[8678]: I1204 00:44:43.515111 8678 scope.go:117] "RemoveContainer" containerID="193bba57b11926255335a41ac4fa06e86418a6aea92b74924b09ec3b1864910b" Dec 04 00:44:43.515730 master-0 kubenswrapper[8678]: I1204 00:44:43.515691 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:44:43.515969 master-0 kubenswrapper[8678]: E1204 00:44:43.515918 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:44:43.522583 master-0 kubenswrapper[8678]: I1204 00:44:43.522536 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:43.522583 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:43.522583 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:43.522583 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:43.522583 master-0 kubenswrapper[8678]: I1204 00:44:43.522574 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:43.850420 master-0 kubenswrapper[8678]: I1204 00:44:43.850337 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:44:43.851027 master-0 kubenswrapper[8678]: E1204 00:44:43.850908 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:44:44.523831 master-0 kubenswrapper[8678]: I1204 00:44:44.523730 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:44.523831 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:44.523831 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:44.523831 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:44.524866 master-0 kubenswrapper[8678]: I1204 00:44:44.523827 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:44.526991 master-0 kubenswrapper[8678]: I1204 00:44:44.526886 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:44:44.529479 master-0 kubenswrapper[8678]: I1204 00:44:44.529389 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:44:45.377585 master-0 kubenswrapper[8678]: E1204 00:44:45.377428 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:44:35Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:44:35Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:44:35Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:44:35Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":false},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:45.523532 master-0 kubenswrapper[8678]: I1204 00:44:45.523448 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:45.523532 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:45.523532 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:45.523532 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:45.524657 master-0 kubenswrapper[8678]: I1204 00:44:45.523547 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:46.523439 master-0 kubenswrapper[8678]: I1204 00:44:46.523366 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:46.523439 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:46.523439 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:46.523439 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:46.523894 master-0 kubenswrapper[8678]: I1204 00:44:46.523453 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:47.223184 master-0 kubenswrapper[8678]: E1204 00:44:47.223116 8678 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 00:44:47.523990 master-0 kubenswrapper[8678]: I1204 00:44:47.523843 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:47.523990 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:47.523990 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:47.523990 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:47.524396 master-0 kubenswrapper[8678]: I1204 00:44:47.524059 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:47.553691 master-0 kubenswrapper[8678]: I1204 00:44:47.553625 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/4.log" Dec 04 00:44:47.554527 master-0 kubenswrapper[8678]: I1204 00:44:47.554477 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/3.log" Dec 04 00:44:47.554645 master-0 kubenswrapper[8678]: I1204 00:44:47.554583 8678 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" exitCode=1 Dec 04 00:44:47.554733 master-0 kubenswrapper[8678]: I1204 00:44:47.554664 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerDied","Data":"8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342"} Dec 04 00:44:47.554810 master-0 kubenswrapper[8678]: I1204 00:44:47.554780 8678 scope.go:117] "RemoveContainer" containerID="56ea401fe21b8ab6f0e3617cd3675599015f8f35f1c68fdc502618c9860436f2" Dec 04 00:44:47.555645 master-0 kubenswrapper[8678]: I1204 00:44:47.555597 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:44:47.556043 master-0 kubenswrapper[8678]: E1204 00:44:47.555998 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:44:48.522665 master-0 kubenswrapper[8678]: I1204 00:44:48.522581 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:48.522665 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:48.522665 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:48.522665 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:48.523244 master-0 kubenswrapper[8678]: I1204 00:44:48.522689 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:48.566697 master-0 kubenswrapper[8678]: I1204 00:44:48.566588 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/4.log" Dec 04 00:44:49.523366 master-0 kubenswrapper[8678]: I1204 00:44:49.523282 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:49.523366 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:49.523366 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:49.523366 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:49.524167 master-0 kubenswrapper[8678]: I1204 00:44:49.523409 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:49.944210 master-0 kubenswrapper[8678]: I1204 00:44:49.944157 8678 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:44:49.945015 master-0 kubenswrapper[8678]: I1204 00:44:49.944914 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:44:49.945208 master-0 kubenswrapper[8678]: E1204 00:44:49.945172 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:44:50.522479 master-0 kubenswrapper[8678]: I1204 00:44:50.522380 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:50.522479 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:50.522479 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:50.522479 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:50.522827 master-0 kubenswrapper[8678]: I1204 00:44:50.522547 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:51.522873 master-0 kubenswrapper[8678]: I1204 00:44:51.522790 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:51.522873 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:51.522873 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:51.522873 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:51.523842 master-0 kubenswrapper[8678]: I1204 00:44:51.522890 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:52.522776 master-0 kubenswrapper[8678]: I1204 00:44:52.522662 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:52.522776 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:52.522776 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:52.522776 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:52.522776 master-0 kubenswrapper[8678]: I1204 00:44:52.522742 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:53.523199 master-0 kubenswrapper[8678]: I1204 00:44:53.523060 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:53.523199 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:53.523199 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:53.523199 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:53.524196 master-0 kubenswrapper[8678]: I1204 00:44:53.523199 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:54.522547 master-0 kubenswrapper[8678]: I1204 00:44:54.522428 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:54.522547 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:54.522547 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:54.522547 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:54.522912 master-0 kubenswrapper[8678]: I1204 00:44:54.522652 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:55.158219 master-0 kubenswrapper[8678]: E1204 00:44:55.158107 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:44:55.378600 master-0 kubenswrapper[8678]: E1204 00:44:55.378456 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:44:55.524021 master-0 kubenswrapper[8678]: I1204 00:44:55.523801 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:55.524021 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:55.524021 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:55.524021 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:55.524021 master-0 kubenswrapper[8678]: I1204 00:44:55.523964 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:55.850496 master-0 kubenswrapper[8678]: I1204 00:44:55.850433 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:44:55.851029 master-0 kubenswrapper[8678]: E1204 00:44:55.850986 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:44:56.523487 master-0 kubenswrapper[8678]: I1204 00:44:56.523380 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:56.523487 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:56.523487 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:56.523487 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:56.524496 master-0 kubenswrapper[8678]: I1204 00:44:56.524160 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:57.524159 master-0 kubenswrapper[8678]: I1204 00:44:57.524073 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:57.524159 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:57.524159 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:57.524159 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:57.525340 master-0 kubenswrapper[8678]: I1204 00:44:57.524185 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:58.522555 master-0 kubenswrapper[8678]: I1204 00:44:58.522468 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:58.522555 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:58.522555 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:58.522555 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:58.523576 master-0 kubenswrapper[8678]: I1204 00:44:58.522576 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:59.523835 master-0 kubenswrapper[8678]: I1204 00:44:59.523721 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:44:59.523835 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:44:59.523835 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:44:59.523835 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:44:59.525048 master-0 kubenswrapper[8678]: I1204 00:44:59.523852 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:44:59.850876 master-0 kubenswrapper[8678]: I1204 00:44:59.850769 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:44:59.851220 master-0 kubenswrapper[8678]: E1204 00:44:59.851124 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:00.239283 master-0 kubenswrapper[8678]: I1204 00:45:00.238791 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podStartSLOduration=264.238768539 podStartE2EDuration="4m24.238768539s" podCreationTimestamp="2025-12-04 00:40:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:45:00.198923721 +0000 UTC m=+883.525656317" watchObservedRunningTime="2025-12-04 00:45:00.238768539 +0000 UTC m=+883.565501105" Dec 04 00:45:00.537631 master-0 kubenswrapper[8678]: I1204 00:45:00.523901 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:00.537631 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:00.537631 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:00.537631 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:00.537631 master-0 kubenswrapper[8678]: I1204 00:45:00.537548 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:01.523974 master-0 kubenswrapper[8678]: I1204 00:45:01.523837 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:01.523974 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:01.523974 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:01.523974 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:01.524561 master-0 kubenswrapper[8678]: I1204 00:45:01.523985 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:02.523233 master-0 kubenswrapper[8678]: I1204 00:45:02.523119 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:02.523233 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:02.523233 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:02.523233 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:02.523233 master-0 kubenswrapper[8678]: I1204 00:45:02.523233 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:03.523555 master-0 kubenswrapper[8678]: I1204 00:45:03.523479 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:03.523555 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:03.523555 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:03.523555 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:03.524850 master-0 kubenswrapper[8678]: I1204 00:45:03.524733 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:03.850785 master-0 kubenswrapper[8678]: I1204 00:45:03.850666 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:45:03.851465 master-0 kubenswrapper[8678]: E1204 00:45:03.851140 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:45:04.523682 master-0 kubenswrapper[8678]: I1204 00:45:04.523589 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:04.523682 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:04.523682 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:04.523682 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:04.524764 master-0 kubenswrapper[8678]: I1204 00:45:04.523684 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:05.380201 master-0 kubenswrapper[8678]: E1204 00:45:05.379780 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:45:05.523712 master-0 kubenswrapper[8678]: I1204 00:45:05.523568 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:05.523712 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:05.523712 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:05.523712 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:05.524863 master-0 kubenswrapper[8678]: I1204 00:45:05.523722 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:06.523352 master-0 kubenswrapper[8678]: I1204 00:45:06.523278 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:06.523352 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:06.523352 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:06.523352 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:06.524586 master-0 kubenswrapper[8678]: I1204 00:45:06.523355 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:07.523370 master-0 kubenswrapper[8678]: I1204 00:45:07.523242 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:07.523370 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:07.523370 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:07.523370 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:07.523370 master-0 kubenswrapper[8678]: I1204 00:45:07.523317 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:08.523742 master-0 kubenswrapper[8678]: I1204 00:45:08.523657 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:08.523742 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:08.523742 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:08.523742 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:08.524516 master-0 kubenswrapper[8678]: I1204 00:45:08.523760 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:08.952655 master-0 kubenswrapper[8678]: E1204 00:45:08.952239 8678 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-kube-scheduler-master-0.187ddc4aba0ddbf3 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-master-0,UID:fd2fa610bb2a39c39fcdd00db03a511a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:40:42.506263539 +0000 UTC m=+625.832996095,LastTimestamp:2025-12-04 00:40:42.506263539 +0000 UTC m=+625.832996095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:45:09.523560 master-0 kubenswrapper[8678]: I1204 00:45:09.523475 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:09.523560 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:09.523560 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:09.523560 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:09.524753 master-0 kubenswrapper[8678]: I1204 00:45:09.523572 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:09.850240 master-0 kubenswrapper[8678]: I1204 00:45:09.850165 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:45:09.850685 master-0 kubenswrapper[8678]: E1204 00:45:09.850598 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:45:10.523958 master-0 kubenswrapper[8678]: I1204 00:45:10.523851 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:10.523958 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:10.523958 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:10.523958 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:10.525172 master-0 kubenswrapper[8678]: I1204 00:45:10.523989 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:10.851100 master-0 kubenswrapper[8678]: I1204 00:45:10.850978 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:45:10.851627 master-0 kubenswrapper[8678]: E1204 00:45:10.851579 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:11.524197 master-0 kubenswrapper[8678]: I1204 00:45:11.524106 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:11.524197 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:11.524197 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:11.524197 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:11.524950 master-0 kubenswrapper[8678]: I1204 00:45:11.524222 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:12.159757 master-0 kubenswrapper[8678]: E1204 00:45:12.159670 8678 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 00:45:12.523994 master-0 kubenswrapper[8678]: I1204 00:45:12.523738 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:12.523994 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:12.523994 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:12.523994 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:12.523994 master-0 kubenswrapper[8678]: I1204 00:45:12.523860 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:13.523491 master-0 kubenswrapper[8678]: I1204 00:45:13.523399 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:13.523491 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:13.523491 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:13.523491 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:13.524018 master-0 kubenswrapper[8678]: I1204 00:45:13.523495 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:14.523854 master-0 kubenswrapper[8678]: I1204 00:45:14.523650 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:14.523854 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:14.523854 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:14.523854 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:14.523854 master-0 kubenswrapper[8678]: I1204 00:45:14.523764 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:14.761573 master-0 kubenswrapper[8678]: I1204 00:45:14.761474 8678 generic.go:334] "Generic (PLEG): container finished" podID="3e104a8c-66dc-4a9a-836f-656e6f4cc923" containerID="d0c2b162740018e46456402872eb28a1d15f5b59d45bffcefe5f2776b4811d37" exitCode=0 Dec 04 00:45:14.761573 master-0 kubenswrapper[8678]: I1204 00:45:14.761540 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" event={"ID":"3e104a8c-66dc-4a9a-836f-656e6f4cc923","Type":"ContainerDied","Data":"d0c2b162740018e46456402872eb28a1d15f5b59d45bffcefe5f2776b4811d37"} Dec 04 00:45:14.762234 master-0 kubenswrapper[8678]: I1204 00:45:14.762191 8678 scope.go:117] "RemoveContainer" containerID="d0c2b162740018e46456402872eb28a1d15f5b59d45bffcefe5f2776b4811d37" Dec 04 00:45:15.380922 master-0 kubenswrapper[8678]: E1204 00:45:15.380842 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:45:15.523987 master-0 kubenswrapper[8678]: I1204 00:45:15.523915 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:15.523987 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:15.523987 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:15.523987 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:15.524803 master-0 kubenswrapper[8678]: I1204 00:45:15.524013 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:15.774358 master-0 kubenswrapper[8678]: I1204 00:45:15.774169 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" event={"ID":"3e104a8c-66dc-4a9a-836f-656e6f4cc923","Type":"ContainerStarted","Data":"5ccffd5f25f0c96fc326607931dbc7c791b41fae5614f23f082b3524b1ab17f2"} Dec 04 00:45:15.850625 master-0 kubenswrapper[8678]: I1204 00:45:15.850511 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:45:15.851067 master-0 kubenswrapper[8678]: E1204 00:45:15.850986 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:45:16.523631 master-0 kubenswrapper[8678]: I1204 00:45:16.523548 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:16.523631 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:16.523631 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:16.523631 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:16.524714 master-0 kubenswrapper[8678]: I1204 00:45:16.523673 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:17.523257 master-0 kubenswrapper[8678]: I1204 00:45:17.523152 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:17.523257 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:17.523257 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:17.523257 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:17.523624 master-0 kubenswrapper[8678]: I1204 00:45:17.523269 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:18.411806 master-0 kubenswrapper[8678]: I1204 00:45:18.411396 8678 patch_prober.go:28] interesting pod/openshift-config-operator-68c95b6cf5-qgr6l container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.128.0.22:8443/healthz\": read tcp 10.128.0.2:50694->10.128.0.22:8443: read: connection reset by peer" start-of-body= Dec 04 00:45:18.411806 master-0 kubenswrapper[8678]: I1204 00:45:18.411471 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" podUID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.22:8443/healthz\": read tcp 10.128.0.2:50694->10.128.0.22:8443: read: connection reset by peer" Dec 04 00:45:18.510638 master-0 kubenswrapper[8678]: I1204 00:45:18.510559 8678 patch_prober.go:28] interesting pod/openshift-config-operator-68c95b6cf5-qgr6l container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.22:8443/healthz\": dial tcp 10.128.0.22:8443: connect: connection refused" start-of-body= Dec 04 00:45:18.510638 master-0 kubenswrapper[8678]: I1204 00:45:18.510642 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" podUID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.22:8443/healthz\": dial tcp 10.128.0.22:8443: connect: connection refused" Dec 04 00:45:18.522714 master-0 kubenswrapper[8678]: I1204 00:45:18.522644 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:18.522714 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:18.522714 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:18.522714 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:18.522714 master-0 kubenswrapper[8678]: I1204 00:45:18.522708 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:18.808309 master-0 kubenswrapper[8678]: I1204 00:45:18.808241 8678 generic.go:334] "Generic (PLEG): container finished" podID="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" containerID="757db1e370e5b4cbd7b221ef1b6bf638c1107af84e7d48c8bb84579675cd71b1" exitCode=0 Dec 04 00:45:18.808538 master-0 kubenswrapper[8678]: I1204 00:45:18.808363 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" event={"ID":"46a9c1fd-6e78-4d87-85ef-f8fc195bb980","Type":"ContainerDied","Data":"757db1e370e5b4cbd7b221ef1b6bf638c1107af84e7d48c8bb84579675cd71b1"} Dec 04 00:45:18.809253 master-0 kubenswrapper[8678]: I1204 00:45:18.809222 8678 scope.go:117] "RemoveContainer" containerID="757db1e370e5b4cbd7b221ef1b6bf638c1107af84e7d48c8bb84579675cd71b1" Dec 04 00:45:18.811351 master-0 kubenswrapper[8678]: I1204 00:45:18.811323 8678 generic.go:334] "Generic (PLEG): container finished" podID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerID="381b0d861d6cea3e99674d5dcd82176cb0cef0ec90d4b9a314a1938f78d4a9f5" exitCode=0 Dec 04 00:45:18.811506 master-0 kubenswrapper[8678]: I1204 00:45:18.811438 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerDied","Data":"381b0d861d6cea3e99674d5dcd82176cb0cef0ec90d4b9a314a1938f78d4a9f5"} Dec 04 00:45:18.811636 master-0 kubenswrapper[8678]: I1204 00:45:18.811604 8678 scope.go:117] "RemoveContainer" containerID="b8185fde18a9eb9676dbfdd093ee8f19900d0fde6a1013953667e65a89842339" Dec 04 00:45:18.812432 master-0 kubenswrapper[8678]: I1204 00:45:18.812337 8678 scope.go:117] "RemoveContainer" containerID="381b0d861d6cea3e99674d5dcd82176cb0cef0ec90d4b9a314a1938f78d4a9f5" Dec 04 00:45:18.814340 master-0 kubenswrapper[8678]: I1204 00:45:18.814041 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:45:18.816316 master-0 kubenswrapper[8678]: I1204 00:45:18.816283 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:45:18.817320 master-0 kubenswrapper[8678]: I1204 00:45:18.817237 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:45:18.817359 master-0 kubenswrapper[8678]: I1204 00:45:18.817326 8678 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" exitCode=1 Dec 04 00:45:18.817477 master-0 kubenswrapper[8678]: I1204 00:45:18.817430 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} Dec 04 00:45:18.818785 master-0 kubenswrapper[8678]: I1204 00:45:18.818749 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:45:18.818857 master-0 kubenswrapper[8678]: I1204 00:45:18.818790 8678 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:45:18.820742 master-0 kubenswrapper[8678]: I1204 00:45:18.820611 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-bbd9b9dff-lqlgs_cb121145-3e1a-49da-aac5-822cf65eefcf/cluster-node-tuning-operator/0.log" Dec 04 00:45:18.820742 master-0 kubenswrapper[8678]: I1204 00:45:18.820660 8678 generic.go:334] "Generic (PLEG): container finished" podID="cb121145-3e1a-49da-aac5-822cf65eefcf" containerID="f20da8400c336d34fe4b807aa7ddfc6b03001cf06f4172fd2e33bddf36815af7" exitCode=1 Dec 04 00:45:18.820837 master-0 kubenswrapper[8678]: I1204 00:45:18.820715 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" event={"ID":"cb121145-3e1a-49da-aac5-822cf65eefcf","Type":"ContainerDied","Data":"f20da8400c336d34fe4b807aa7ddfc6b03001cf06f4172fd2e33bddf36815af7"} Dec 04 00:45:18.822617 master-0 kubenswrapper[8678]: I1204 00:45:18.822519 8678 scope.go:117] "RemoveContainer" containerID="f20da8400c336d34fe4b807aa7ddfc6b03001cf06f4172fd2e33bddf36815af7" Dec 04 00:45:18.823803 master-0 kubenswrapper[8678]: I1204 00:45:18.823771 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-56f5898f45-2qvfj_dd621016-f4f2-4839-aae0-a804e6023423/service-ca-operator/1.log" Dec 04 00:45:18.823872 master-0 kubenswrapper[8678]: I1204 00:45:18.823840 8678 generic.go:334] "Generic (PLEG): container finished" podID="dd621016-f4f2-4839-aae0-a804e6023423" containerID="3a39d58bf14a8a0237f78a42a4d77a9a5f5be020fc17c1b7fa5678e3282f18dc" exitCode=0 Dec 04 00:45:18.823988 master-0 kubenswrapper[8678]: I1204 00:45:18.823953 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerDied","Data":"3a39d58bf14a8a0237f78a42a4d77a9a5f5be020fc17c1b7fa5678e3282f18dc"} Dec 04 00:45:18.824607 master-0 kubenswrapper[8678]: I1204 00:45:18.824574 8678 scope.go:117] "RemoveContainer" containerID="3a39d58bf14a8a0237f78a42a4d77a9a5f5be020fc17c1b7fa5678e3282f18dc" Dec 04 00:45:18.827216 master-0 kubenswrapper[8678]: I1204 00:45:18.827162 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-75b4d49d4c-7s5z5_c79edcd7-4399-4ded-9b03-9084ad9e14b4/package-server-manager/0.log" Dec 04 00:45:18.829249 master-0 kubenswrapper[8678]: I1204 00:45:18.828852 8678 generic.go:334] "Generic (PLEG): container finished" podID="c79edcd7-4399-4ded-9b03-9084ad9e14b4" containerID="91047caa011840485cf0440ea5435e7255eea04d0a040e632ceb8483ac22b986" exitCode=1 Dec 04 00:45:18.829249 master-0 kubenswrapper[8678]: I1204 00:45:18.828983 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" event={"ID":"c79edcd7-4399-4ded-9b03-9084ad9e14b4","Type":"ContainerDied","Data":"91047caa011840485cf0440ea5435e7255eea04d0a040e632ceb8483ac22b986"} Dec 04 00:45:18.830255 master-0 kubenswrapper[8678]: I1204 00:45:18.830100 8678 scope.go:117] "RemoveContainer" containerID="91047caa011840485cf0440ea5435e7255eea04d0a040e632ceb8483ac22b986" Dec 04 00:45:18.834035 master-0 kubenswrapper[8678]: I1204 00:45:18.834001 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-667484ff5-mswdx_655dc370-c0d1-4d03-a317-64bf099aff1b/openshift-apiserver-operator/1.log" Dec 04 00:45:18.834128 master-0 kubenswrapper[8678]: I1204 00:45:18.834089 8678 generic.go:334] "Generic (PLEG): container finished" podID="655dc370-c0d1-4d03-a317-64bf099aff1b" containerID="b50a746f991e98693c439e07b3494f8b2b88b67b84aa17a2878ffc95b7437489" exitCode=0 Dec 04 00:45:18.834187 master-0 kubenswrapper[8678]: I1204 00:45:18.834152 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerDied","Data":"b50a746f991e98693c439e07b3494f8b2b88b67b84aa17a2878ffc95b7437489"} Dec 04 00:45:18.834833 master-0 kubenswrapper[8678]: I1204 00:45:18.834787 8678 scope.go:117] "RemoveContainer" containerID="b50a746f991e98693c439e07b3494f8b2b88b67b84aa17a2878ffc95b7437489" Dec 04 00:45:18.857702 master-0 kubenswrapper[8678]: I1204 00:45:18.857649 8678 scope.go:117] "RemoveContainer" containerID="4a833ea2a9a15920b34c9ef6e8f314468e42b929cf904fcaab498c2e48700df5" Dec 04 00:45:18.976353 master-0 kubenswrapper[8678]: I1204 00:45:18.976317 8678 scope.go:117] "RemoveContainer" containerID="04b6797d433194e1224976bde27df7380ac53111703d386c9136d1bdaf11768c" Dec 04 00:45:19.183627 master-0 kubenswrapper[8678]: E1204 00:45:19.183558 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:45:19.523969 master-0 kubenswrapper[8678]: I1204 00:45:19.523157 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:19.523969 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:19.523969 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:19.523969 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:19.523969 master-0 kubenswrapper[8678]: I1204 00:45:19.523255 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:19.845088 master-0 kubenswrapper[8678]: I1204 00:45:19.844996 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" event={"ID":"dd621016-f4f2-4839-aae0-a804e6023423","Type":"ContainerStarted","Data":"5d3ec53c680e264c343fcff0c07287b08449881ba10d5ac3ec49a0182fb49d22"} Dec 04 00:45:19.847234 master-0 kubenswrapper[8678]: I1204 00:45:19.847187 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-75b4d49d4c-7s5z5_c79edcd7-4399-4ded-9b03-9084ad9e14b4/package-server-manager/0.log" Dec 04 00:45:19.847780 master-0 kubenswrapper[8678]: I1204 00:45:19.847734 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" event={"ID":"c79edcd7-4399-4ded-9b03-9084ad9e14b4","Type":"ContainerStarted","Data":"28afeb3c09e44b259adb33899c1fe430fa37ca9e9671e857c472bed6e09d4321"} Dec 04 00:45:19.848588 master-0 kubenswrapper[8678]: I1204 00:45:19.848551 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:45:19.850578 master-0 kubenswrapper[8678]: I1204 00:45:19.850538 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" event={"ID":"655dc370-c0d1-4d03-a317-64bf099aff1b","Type":"ContainerStarted","Data":"ca909bc9f7a5c581d3ac95a4bea40302a2d9625dcf1dcb8b6903da0475d21028"} Dec 04 00:45:19.852786 master-0 kubenswrapper[8678]: I1204 00:45:19.852739 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" event={"ID":"46a9c1fd-6e78-4d87-85ef-f8fc195bb980","Type":"ContainerStarted","Data":"888d01223f171fabbf2351cd4170dfc1b16d55665184c43c438a4d9d946f0cdd"} Dec 04 00:45:19.855463 master-0 kubenswrapper[8678]: I1204 00:45:19.855404 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" event={"ID":"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39","Type":"ContainerStarted","Data":"6a9e4fb822e7e0e5c87f0232ed23439eb4a25237e075884fe4c02c3f4fd293df"} Dec 04 00:45:19.855766 master-0 kubenswrapper[8678]: I1204 00:45:19.855734 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:45:19.857286 master-0 kubenswrapper[8678]: I1204 00:45:19.857250 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/1.log" Dec 04 00:45:19.857355 master-0 kubenswrapper[8678]: I1204 00:45:19.857302 8678 generic.go:334] "Generic (PLEG): container finished" podID="3e901355-2d0f-46f9-9d64-c4bc900b1839" containerID="1390652d357c9660029c7c11251fd012033ccb910a6529103f75fc7a1f1c9652" exitCode=0 Dec 04 00:45:19.857416 master-0 kubenswrapper[8678]: I1204 00:45:19.857364 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerDied","Data":"1390652d357c9660029c7c11251fd012033ccb910a6529103f75fc7a1f1c9652"} Dec 04 00:45:19.857416 master-0 kubenswrapper[8678]: I1204 00:45:19.857398 8678 scope.go:117] "RemoveContainer" containerID="8535d74ae1fe68cf19d4bcff1682688f5b7202742afc467329b215e7d307d732" Dec 04 00:45:19.858142 master-0 kubenswrapper[8678]: I1204 00:45:19.858087 8678 scope.go:117] "RemoveContainer" containerID="1390652d357c9660029c7c11251fd012033ccb910a6529103f75fc7a1f1c9652" Dec 04 00:45:19.859552 master-0 kubenswrapper[8678]: I1204 00:45:19.859512 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:45:19.861057 master-0 kubenswrapper[8678]: I1204 00:45:19.860872 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:45:19.861607 master-0 kubenswrapper[8678]: I1204 00:45:19.861495 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:45:19.861607 master-0 kubenswrapper[8678]: I1204 00:45:19.861603 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} Dec 04 00:45:19.864013 master-0 kubenswrapper[8678]: I1204 00:45:19.862022 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:45:19.864013 master-0 kubenswrapper[8678]: E1204 00:45:19.862303 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(61b999b2e31764aaaf13d451199f7b0e)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" Dec 04 00:45:19.864184 master-0 kubenswrapper[8678]: I1204 00:45:19.864100 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-bbd9b9dff-lqlgs_cb121145-3e1a-49da-aac5-822cf65eefcf/cluster-node-tuning-operator/0.log" Dec 04 00:45:19.864252 master-0 kubenswrapper[8678]: I1204 00:45:19.864213 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" event={"ID":"cb121145-3e1a-49da-aac5-822cf65eefcf","Type":"ContainerStarted","Data":"e62cb4a627d379df0ca962d099da70a98b2d23f30d3aac2380450af1b3a09969"} Dec 04 00:45:20.523163 master-0 kubenswrapper[8678]: I1204 00:45:20.523088 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:20.523163 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:20.523163 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:20.523163 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:20.523506 master-0 kubenswrapper[8678]: I1204 00:45:20.523171 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:20.851127 master-0 kubenswrapper[8678]: I1204 00:45:20.850995 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:45:20.852432 master-0 kubenswrapper[8678]: E1204 00:45:20.851418 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:45:20.875511 master-0 kubenswrapper[8678]: I1204 00:45:20.875419 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" event={"ID":"3e901355-2d0f-46f9-9d64-c4bc900b1839","Type":"ContainerStarted","Data":"8a2fdd889b628956fe7ad6b0ea5b48a2db559be42c97a5d0b89f390f9a8c9701"} Dec 04 00:45:21.523354 master-0 kubenswrapper[8678]: I1204 00:45:21.523293 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:21.523354 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:21.523354 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:21.523354 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:21.523859 master-0 kubenswrapper[8678]: I1204 00:45:21.523379 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:22.523526 master-0 kubenswrapper[8678]: I1204 00:45:22.523449 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:22.523526 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:22.523526 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:22.523526 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:22.524690 master-0 kubenswrapper[8678]: I1204 00:45:22.523543 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:22.909628 master-0 kubenswrapper[8678]: I1204 00:45:22.909536 8678 generic.go:334] "Generic (PLEG): container finished" podID="004c989d-6ae8-4147-8355-af1118fe6a98" containerID="c3851f459af3a52ca2d5286fdbe5bfbc4f8adb04de417f015b441c48011e4416" exitCode=0 Dec 04 00:45:22.909628 master-0 kubenswrapper[8678]: I1204 00:45:22.909595 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" event={"ID":"004c989d-6ae8-4147-8355-af1118fe6a98","Type":"ContainerDied","Data":"c3851f459af3a52ca2d5286fdbe5bfbc4f8adb04de417f015b441c48011e4416"} Dec 04 00:45:22.910203 master-0 kubenswrapper[8678]: I1204 00:45:22.910154 8678 scope.go:117] "RemoveContainer" containerID="c3851f459af3a52ca2d5286fdbe5bfbc4f8adb04de417f015b441c48011e4416" Dec 04 00:45:23.522254 master-0 kubenswrapper[8678]: I1204 00:45:23.522195 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:23.522254 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:23.522254 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:23.522254 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:23.522727 master-0 kubenswrapper[8678]: I1204 00:45:23.522691 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:23.850462 master-0 kubenswrapper[8678]: I1204 00:45:23.850424 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:45:23.851306 master-0 kubenswrapper[8678]: E1204 00:45:23.851278 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:23.923585 master-0 kubenswrapper[8678]: I1204 00:45:23.923515 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" event={"ID":"004c989d-6ae8-4147-8355-af1118fe6a98","Type":"ContainerStarted","Data":"ac79169612159a3877b3223c43062e2156a3cb75d058f13298140acb64e4a5e3"} Dec 04 00:45:24.523984 master-0 kubenswrapper[8678]: I1204 00:45:24.523891 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:24.523984 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:24.523984 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:24.523984 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:24.524581 master-0 kubenswrapper[8678]: I1204 00:45:24.524540 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:25.382295 master-0 kubenswrapper[8678]: E1204 00:45:25.382198 8678 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 00:45:25.382295 master-0 kubenswrapper[8678]: E1204 00:45:25.382274 8678 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:45:25.391332 master-0 kubenswrapper[8678]: I1204 00:45:25.391244 8678 patch_prober.go:28] interesting pod/openshift-config-operator-68c95b6cf5-qgr6l container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.128.0.22:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:45:25.391587 master-0 kubenswrapper[8678]: I1204 00:45:25.391374 8678 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" podUID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.22:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:45:25.510520 master-0 kubenswrapper[8678]: I1204 00:45:25.510444 8678 patch_prober.go:28] interesting pod/openshift-config-operator-68c95b6cf5-qgr6l container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.22:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:45:25.510777 master-0 kubenswrapper[8678]: I1204 00:45:25.510533 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" podUID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.22:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:45:25.522458 master-0 kubenswrapper[8678]: I1204 00:45:25.522373 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:25.522458 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:25.522458 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:25.522458 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:25.522735 master-0 kubenswrapper[8678]: I1204 00:45:25.522494 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:26.523786 master-0 kubenswrapper[8678]: I1204 00:45:26.523607 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:26.523786 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:26.523786 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:26.523786 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:26.523786 master-0 kubenswrapper[8678]: I1204 00:45:26.523730 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:26.948830 master-0 kubenswrapper[8678]: I1204 00:45:26.948768 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/1.log" Dec 04 00:45:26.948830 master-0 kubenswrapper[8678]: I1204 00:45:26.948820 8678 generic.go:334] "Generic (PLEG): container finished" podID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerID="04e9200304854483446720319d72e82a552d8c10ce33bfebf374bd1ca17290f6" exitCode=0 Dec 04 00:45:26.948830 master-0 kubenswrapper[8678]: I1204 00:45:26.948855 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerDied","Data":"04e9200304854483446720319d72e82a552d8c10ce33bfebf374bd1ca17290f6"} Dec 04 00:45:26.949381 master-0 kubenswrapper[8678]: I1204 00:45:26.948907 8678 scope.go:117] "RemoveContainer" containerID="30334a3fa525d9b6061a522d88430ab12379b269164eecaa76fc0069f4a00c26" Dec 04 00:45:26.949836 master-0 kubenswrapper[8678]: I1204 00:45:26.949779 8678 scope.go:117] "RemoveContainer" containerID="04e9200304854483446720319d72e82a552d8c10ce33bfebf374bd1ca17290f6" Dec 04 00:45:27.523218 master-0 kubenswrapper[8678]: I1204 00:45:27.523124 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:27.523218 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:27.523218 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:27.523218 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:27.523218 master-0 kubenswrapper[8678]: I1204 00:45:27.523201 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:27.961020 master-0 kubenswrapper[8678]: I1204 00:45:27.960888 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" event={"ID":"d5f22827-c301-4584-b999-0a1cc1033bb5","Type":"ContainerStarted","Data":"bfdfc33d4e286040dd9b96ad6c422be5f239d52ab5947682b76b1ff20eb3b306"} Dec 04 00:45:28.111617 master-0 kubenswrapper[8678]: I1204 00:45:28.111557 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:45:28.112576 master-0 kubenswrapper[8678]: E1204 00:45:28.111908 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:45:28.112576 master-0 kubenswrapper[8678]: I1204 00:45:28.111931 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:45:28.112576 master-0 kubenswrapper[8678]: I1204 00:45:28.112143 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:45:28.112785 master-0 kubenswrapper[8678]: I1204 00:45:28.112701 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.118087 master-0 kubenswrapper[8678]: I1204 00:45:28.118027 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:45:28.119319 master-0 kubenswrapper[8678]: I1204 00:45:28.119300 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.121118 master-0 kubenswrapper[8678]: I1204 00:45:28.121095 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.121305 master-0 kubenswrapper[8678]: I1204 00:45:28.121286 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.121399 master-0 kubenswrapper[8678]: I1204 00:45:28.121385 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.121558 master-0 kubenswrapper[8678]: I1204 00:45:28.121541 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.121702 master-0 kubenswrapper[8678]: I1204 00:45:28.121686 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.132034 master-0 kubenswrapper[8678]: I1204 00:45:28.123496 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:28.132034 master-0 kubenswrapper[8678]: I1204 00:45:28.124927 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:45:28.132034 master-0 kubenswrapper[8678]: I1204 00:45:28.125136 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.132034 master-0 kubenswrapper[8678]: I1204 00:45:28.125632 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:28.132034 master-0 kubenswrapper[8678]: I1204 00:45:28.127254 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.134303 master-0 kubenswrapper[8678]: I1204 00:45:28.133151 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:45:28.134303 master-0 kubenswrapper[8678]: I1204 00:45:28.134144 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:45:28.134579 master-0 kubenswrapper[8678]: I1204 00:45:28.134560 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:45:28.134749 master-0 kubenswrapper[8678]: I1204 00:45:28.134701 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:45:28.135199 master-0 kubenswrapper[8678]: I1204 00:45:28.135156 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:45:28.138840 master-0 kubenswrapper[8678]: I1204 00:45:28.138019 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:45:28.138840 master-0 kubenswrapper[8678]: I1204 00:45:28.138457 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:45:28.138840 master-0 kubenswrapper[8678]: I1204 00:45:28.138603 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:45:28.139228 master-0 kubenswrapper[8678]: I1204 00:45:28.139195 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:45:28.139476 master-0 kubenswrapper[8678]: I1204 00:45:28.139413 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:45:28.140013 master-0 kubenswrapper[8678]: I1204 00:45:28.139974 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-b7gnv" Dec 04 00:45:28.140171 master-0 kubenswrapper[8678]: I1204 00:45:28.140151 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:45:28.142188 master-0 kubenswrapper[8678]: I1204 00:45:28.142139 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:45:28.145723 master-0 kubenswrapper[8678]: I1204 00:45:28.145702 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:28.147451 master-0 kubenswrapper[8678]: I1204 00:45:28.147430 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.159096 master-0 kubenswrapper[8678]: I1204 00:45:28.158559 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:28.159908 master-0 kubenswrapper[8678]: I1204 00:45:28.159884 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.162070 master-0 kubenswrapper[8678]: I1204 00:45:28.162022 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:28.166605 master-0 kubenswrapper[8678]: I1204 00:45:28.166561 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:45:28.169536 master-0 kubenswrapper[8678]: I1204 00:45:28.169323 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:45:28.173236 master-0 kubenswrapper[8678]: I1204 00:45:28.173180 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:28.184494 master-0 kubenswrapper[8678]: I1204 00:45:28.184446 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:28.190073 master-0 kubenswrapper[8678]: I1204 00:45:28.188649 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:28.223071 master-0 kubenswrapper[8678]: I1204 00:45:28.222951 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.223744 master-0 kubenswrapper[8678]: I1204 00:45:28.223728 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.223865 master-0 kubenswrapper[8678]: I1204 00:45:28.223852 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.223981 master-0 kubenswrapper[8678]: I1204 00:45:28.223964 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.224119 master-0 kubenswrapper[8678]: I1204 00:45:28.224106 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.224229 master-0 kubenswrapper[8678]: I1204 00:45:28.224216 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.224333 master-0 kubenswrapper[8678]: I1204 00:45:28.224320 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.224457 master-0 kubenswrapper[8678]: I1204 00:45:28.224444 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbdhv\" (UniqueName: \"kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.224581 master-0 kubenswrapper[8678]: I1204 00:45:28.224567 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7snd\" (UniqueName: \"kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.224691 master-0 kubenswrapper[8678]: I1204 00:45:28.224678 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.224813 master-0 kubenswrapper[8678]: I1204 00:45:28.224801 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.226108 master-0 kubenswrapper[8678]: I1204 00:45:28.226093 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.226269 master-0 kubenswrapper[8678]: I1204 00:45:28.226256 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.227422 master-0 kubenswrapper[8678]: I1204 00:45:28.227262 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.227422 master-0 kubenswrapper[8678]: I1204 00:45:28.227369 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.227422 master-0 kubenswrapper[8678]: I1204 00:45:28.226049 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.227422 master-0 kubenswrapper[8678]: I1204 00:45:28.227397 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.227592 master-0 kubenswrapper[8678]: I1204 00:45:28.227419 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwh97\" (UniqueName: \"kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.227592 master-0 kubenswrapper[8678]: I1204 00:45:28.227496 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.227592 master-0 kubenswrapper[8678]: I1204 00:45:28.227563 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.227592 master-0 kubenswrapper[8678]: I1204 00:45:28.227591 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.227709 master-0 kubenswrapper[8678]: I1204 00:45:28.227631 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.227709 master-0 kubenswrapper[8678]: I1204 00:45:28.227662 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.228802 master-0 kubenswrapper[8678]: I1204 00:45:28.228771 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.230554 master-0 kubenswrapper[8678]: I1204 00:45:28.230521 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.243012 master-0 kubenswrapper[8678]: I1204 00:45:28.242247 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.329107 master-0 kubenswrapper[8678]: I1204 00:45:28.329053 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lwh97\" (UniqueName: \"kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.329107 master-0 kubenswrapper[8678]: I1204 00:45:28.329104 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329131 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329158 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329194 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329218 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329234 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329255 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329270 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329285 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329309 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329338 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdhv\" (UniqueName: \"kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329361 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g7snd\" (UniqueName: \"kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329379 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329434 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.329461 master-0 kubenswrapper[8678]: I1204 00:45:28.329465 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.329963 master-0 kubenswrapper[8678]: I1204 00:45:28.329912 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.330475 master-0 kubenswrapper[8678]: I1204 00:45:28.330452 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.330536 master-0 kubenswrapper[8678]: I1204 00:45:28.330467 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.330581 master-0 kubenswrapper[8678]: I1204 00:45:28.330549 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.330821 master-0 kubenswrapper[8678]: I1204 00:45:28.330776 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.330907 master-0 kubenswrapper[8678]: I1204 00:45:28.330865 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.331165 master-0 kubenswrapper[8678]: I1204 00:45:28.331128 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.331469 master-0 kubenswrapper[8678]: I1204 00:45:28.331428 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.332006 master-0 kubenswrapper[8678]: I1204 00:45:28.331974 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.332196 master-0 kubenswrapper[8678]: I1204 00:45:28.332173 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.333584 master-0 kubenswrapper[8678]: I1204 00:45:28.333546 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.347376 master-0 kubenswrapper[8678]: I1204 00:45:28.347328 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7snd\" (UniqueName: \"kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd\") pod \"certified-operators-24mpn\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.347607 master-0 kubenswrapper[8678]: I1204 00:45:28.347416 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87\") pod \"redhat-marketplace-wh4gp\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.350742 master-0 kubenswrapper[8678]: I1204 00:45:28.350698 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbdhv\" (UniqueName: \"kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv\") pod \"redhat-operators-nh2ml\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.351405 master-0 kubenswrapper[8678]: I1204 00:45:28.351369 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwh97\" (UniqueName: \"kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97\") pod \"community-operators-4gm92\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.352793 master-0 kubenswrapper[8678]: I1204 00:45:28.352754 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.492272 master-0 kubenswrapper[8678]: I1204 00:45:28.492035 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:28.523474 master-0 kubenswrapper[8678]: I1204 00:45:28.523359 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:28.523474 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:28.523474 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:28.523474 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:28.523901 master-0 kubenswrapper[8678]: I1204 00:45:28.523480 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:28.555332 master-0 kubenswrapper[8678]: I1204 00:45:28.555236 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:28.581190 master-0 kubenswrapper[8678]: I1204 00:45:28.581024 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:28.644821 master-0 kubenswrapper[8678]: I1204 00:45:28.644219 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:28.657156 master-0 kubenswrapper[8678]: I1204 00:45:28.657096 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:28.675743 master-0 kubenswrapper[8678]: I1204 00:45:28.675054 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:28.951303 master-0 kubenswrapper[8678]: I1204 00:45:28.951246 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:45:28.956602 master-0 kubenswrapper[8678]: W1204 00:45:28.956538 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3545341_90a7_42fe_9ba4_bf6e71ef776e.slice/crio-9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046 WatchSource:0}: Error finding container 9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046: Status 404 returned error can't find the container with id 9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046 Dec 04 00:45:28.971725 master-0 kubenswrapper[8678]: I1204 00:45:28.971675 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-7c4697b5f5-x459g_8a5721ad-a077-439a-9ec0-57d90dfb5c14/openshift-controller-manager-operator/1.log" Dec 04 00:45:28.972158 master-0 kubenswrapper[8678]: I1204 00:45:28.971732 8678 generic.go:334] "Generic (PLEG): container finished" podID="8a5721ad-a077-439a-9ec0-57d90dfb5c14" containerID="c152b09b4d8fa529e75f7bbb79145b482cc8f1155d6ff7779131595595f74485" exitCode=0 Dec 04 00:45:28.972158 master-0 kubenswrapper[8678]: I1204 00:45:28.971787 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerDied","Data":"c152b09b4d8fa529e75f7bbb79145b482cc8f1155d6ff7779131595595f74485"} Dec 04 00:45:28.972158 master-0 kubenswrapper[8678]: I1204 00:45:28.971832 8678 scope.go:117] "RemoveContainer" containerID="7f51b557a3ad1653c4152bc3d0fece4c806c2c0777a98f5a35231532d2e85bae" Dec 04 00:45:28.972365 master-0 kubenswrapper[8678]: I1204 00:45:28.972331 8678 scope.go:117] "RemoveContainer" containerID="c152b09b4d8fa529e75f7bbb79145b482cc8f1155d6ff7779131595595f74485" Dec 04 00:45:28.974721 master-0 kubenswrapper[8678]: I1204 00:45:28.974684 8678 generic.go:334] "Generic (PLEG): container finished" podID="29db06e4-26c0-45e4-ba90-509f51cad1a2" containerID="424502a5227056c566845d24bfb829be46563652d57707e9bcb00b5cb331cfba" exitCode=0 Dec 04 00:45:28.974794 master-0 kubenswrapper[8678]: I1204 00:45:28.974741 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" event={"ID":"29db06e4-26c0-45e4-ba90-509f51cad1a2","Type":"ContainerDied","Data":"424502a5227056c566845d24bfb829be46563652d57707e9bcb00b5cb331cfba"} Dec 04 00:45:28.975142 master-0 kubenswrapper[8678]: I1204 00:45:28.975103 8678 scope.go:117] "RemoveContainer" containerID="424502a5227056c566845d24bfb829be46563652d57707e9bcb00b5cb331cfba" Dec 04 00:45:28.978595 master-0 kubenswrapper[8678]: I1204 00:45:28.978482 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/machine-api-operator/0.log" Dec 04 00:45:28.980448 master-0 kubenswrapper[8678]: I1204 00:45:28.980405 8678 generic.go:334] "Generic (PLEG): container finished" podID="e852069a-82f1-4121-9d86-277b8ca07370" containerID="cac1a420acb28af33b28f244c49fd2673d1e17a48f3b917cbbd4e2767cc69b94" exitCode=255 Dec 04 00:45:28.980513 master-0 kubenswrapper[8678]: I1204 00:45:28.980468 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" event={"ID":"e852069a-82f1-4121-9d86-277b8ca07370","Type":"ContainerDied","Data":"cac1a420acb28af33b28f244c49fd2673d1e17a48f3b917cbbd4e2767cc69b94"} Dec 04 00:45:28.981072 master-0 kubenswrapper[8678]: I1204 00:45:28.981011 8678 scope.go:117] "RemoveContainer" containerID="cac1a420acb28af33b28f244c49fd2673d1e17a48f3b917cbbd4e2767cc69b94" Dec 04 00:45:28.983112 master-0 kubenswrapper[8678]: I1204 00:45:28.982825 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/cluster-autoscaler-operator/0.log" Dec 04 00:45:28.983549 master-0 kubenswrapper[8678]: I1204 00:45:28.983526 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" event={"ID":"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96","Type":"ContainerDied","Data":"0dfd8857ba31b986ea7faa5328c297f0b3c9f0ea5f465d27f87b850465ce0710"} Dec 04 00:45:28.983549 master-0 kubenswrapper[8678]: I1204 00:45:28.983529 8678 generic.go:334] "Generic (PLEG): container finished" podID="ba4531f5-90d7-41b9-9bbc-0f0d5c640d96" containerID="0dfd8857ba31b986ea7faa5328c297f0b3c9f0ea5f465d27f87b850465ce0710" exitCode=255 Dec 04 00:45:28.983912 master-0 kubenswrapper[8678]: I1204 00:45:28.983868 8678 scope.go:117] "RemoveContainer" containerID="0dfd8857ba31b986ea7faa5328c297f0b3c9f0ea5f465d27f87b850465ce0710" Dec 04 00:45:28.987089 master-0 kubenswrapper[8678]: I1204 00:45:28.987008 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-589f5cdc9d-vqmbm_2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/cluster-olm-operator/0.log" Dec 04 00:45:28.988770 master-0 kubenswrapper[8678]: I1204 00:45:28.988729 8678 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="cf24040c300df106253834dddfb5503ac540d510ceeea8af9fdc130d4568b9b1" exitCode=0 Dec 04 00:45:28.988849 master-0 kubenswrapper[8678]: I1204 00:45:28.988809 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerDied","Data":"cf24040c300df106253834dddfb5503ac540d510ceeea8af9fdc130d4568b9b1"} Dec 04 00:45:28.989324 master-0 kubenswrapper[8678]: I1204 00:45:28.989243 8678 scope.go:117] "RemoveContainer" containerID="cf24040c300df106253834dddfb5503ac540d510ceeea8af9fdc130d4568b9b1" Dec 04 00:45:28.990532 master-0 kubenswrapper[8678]: I1204 00:45:28.990470 8678 generic.go:334] "Generic (PLEG): container finished" podID="95141f9b-b6b0-40dc-a6e2-b5c84d24caac" containerID="7cbd376a461c53f9f8504aae5e51bc78d01b3ac68dfe3fd40f099e142c972b78" exitCode=0 Dec 04 00:45:28.990532 master-0 kubenswrapper[8678]: I1204 00:45:28.990525 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" event={"ID":"95141f9b-b6b0-40dc-a6e2-b5c84d24caac","Type":"ContainerDied","Data":"7cbd376a461c53f9f8504aae5e51bc78d01b3ac68dfe3fd40f099e142c972b78"} Dec 04 00:45:28.994839 master-0 kubenswrapper[8678]: I1204 00:45:28.991048 8678 scope.go:117] "RemoveContainer" containerID="7cbd376a461c53f9f8504aae5e51bc78d01b3ac68dfe3fd40f099e142c972b78" Dec 04 00:45:29.009540 master-0 kubenswrapper[8678]: I1204 00:45:29.009463 8678 generic.go:334] "Generic (PLEG): container finished" podID="87c52add-1fdc-4227-b1b1-76f3653e3fb0" containerID="901cafaddfb48ad12a48e90f2d27e69834e9c9300ce76bcf5ec911ddb71f0294" exitCode=0 Dec 04 00:45:29.009775 master-0 kubenswrapper[8678]: I1204 00:45:29.009557 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" event={"ID":"87c52add-1fdc-4227-b1b1-76f3653e3fb0","Type":"ContainerDied","Data":"901cafaddfb48ad12a48e90f2d27e69834e9c9300ce76bcf5ec911ddb71f0294"} Dec 04 00:45:29.010352 master-0 kubenswrapper[8678]: I1204 00:45:29.010322 8678 scope.go:117] "RemoveContainer" containerID="901cafaddfb48ad12a48e90f2d27e69834e9c9300ce76bcf5ec911ddb71f0294" Dec 04 00:45:29.010900 master-0 kubenswrapper[8678]: I1204 00:45:29.010850 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" event={"ID":"e3545341-90a7-42fe-9ba4-bf6e71ef776e","Type":"ContainerStarted","Data":"9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046"} Dec 04 00:45:29.016534 master-0 kubenswrapper[8678]: I1204 00:45:29.016487 8678 generic.go:334] "Generic (PLEG): container finished" podID="285a1e74-1d8e-452e-a5a4-484afc10e10f" containerID="413a2471e1907fc22f6dd6be4e4024d9156701127dfe71a19a5672b890e28f94" exitCode=0 Dec 04 00:45:29.016635 master-0 kubenswrapper[8678]: I1204 00:45:29.016555 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" event={"ID":"285a1e74-1d8e-452e-a5a4-484afc10e10f","Type":"ContainerDied","Data":"413a2471e1907fc22f6dd6be4e4024d9156701127dfe71a19a5672b890e28f94"} Dec 04 00:45:29.017807 master-0 kubenswrapper[8678]: I1204 00:45:29.017757 8678 scope.go:117] "RemoveContainer" containerID="413a2471e1907fc22f6dd6be4e4024d9156701127dfe71a19a5672b890e28f94" Dec 04 00:45:29.068412 master-0 kubenswrapper[8678]: I1204 00:45:29.068088 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:29.074731 master-0 kubenswrapper[8678]: I1204 00:45:29.074654 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:45:29.081281 master-0 kubenswrapper[8678]: I1204 00:45:29.081209 8678 scope.go:117] "RemoveContainer" containerID="8e8f5449f755cdd9f6b1dc599c52378d1c1b713586f918b973c248f56af9f3b3" Dec 04 00:45:29.087026 master-0 kubenswrapper[8678]: W1204 00:45:29.086930 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97707d9a_e2ef_4c4e_9dbc_67b64a988e9f.slice/crio-7a9fd92af0c16332dc19f09fbf4afd04dd2976dc0756cc11d07f972573f1e206 WatchSource:0}: Error finding container 7a9fd92af0c16332dc19f09fbf4afd04dd2976dc0756cc11d07f972573f1e206: Status 404 returned error can't find the container with id 7a9fd92af0c16332dc19f09fbf4afd04dd2976dc0756cc11d07f972573f1e206 Dec 04 00:45:29.095624 master-0 kubenswrapper[8678]: W1204 00:45:29.095574 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfd1a75_01c6_488b_aed9_646f1c4ce0f5.slice/crio-bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2 WatchSource:0}: Error finding container bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2: Status 404 returned error can't find the container with id bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2 Dec 04 00:45:29.209778 master-0 kubenswrapper[8678]: I1204 00:45:29.203672 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:29.209778 master-0 kubenswrapper[8678]: I1204 00:45:29.208339 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:29.213539 master-0 kubenswrapper[8678]: I1204 00:45:29.213465 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:29.522297 master-0 kubenswrapper[8678]: I1204 00:45:29.522216 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:29.522297 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:29.522297 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:29.522297 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:29.522297 master-0 kubenswrapper[8678]: I1204 00:45:29.522269 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:30.026353 master-0 kubenswrapper[8678]: I1204 00:45:30.026188 8678 generic.go:334] "Generic (PLEG): container finished" podID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerID="7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e" exitCode=0 Dec 04 00:45:30.026353 master-0 kubenswrapper[8678]: I1204 00:45:30.026279 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerDied","Data":"7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e"} Dec 04 00:45:30.026353 master-0 kubenswrapper[8678]: I1204 00:45:30.026315 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerStarted","Data":"7a9fd92af0c16332dc19f09fbf4afd04dd2976dc0756cc11d07f972573f1e206"} Dec 04 00:45:30.028151 master-0 kubenswrapper[8678]: I1204 00:45:30.028096 8678 generic.go:334] "Generic (PLEG): container finished" podID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerID="9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c" exitCode=0 Dec 04 00:45:30.028245 master-0 kubenswrapper[8678]: I1204 00:45:30.028166 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerDied","Data":"9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c"} Dec 04 00:45:30.028245 master-0 kubenswrapper[8678]: I1204 00:45:30.028200 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerStarted","Data":"cc79c6a47d68afe50cd6192f3b3f850724de86210a1d291f9c3b7f2ce71c16bb"} Dec 04 00:45:30.029755 master-0 kubenswrapper[8678]: I1204 00:45:30.029704 8678 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:45:30.036017 master-0 kubenswrapper[8678]: I1204 00:45:30.035987 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/cluster-autoscaler-operator/0.log" Dec 04 00:45:30.036482 master-0 kubenswrapper[8678]: I1204 00:45:30.036425 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" event={"ID":"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96","Type":"ContainerStarted","Data":"04982652bdea689fc17660143d928e2743f866047f688941d85952bc795b1a52"} Dec 04 00:45:30.038324 master-0 kubenswrapper[8678]: I1204 00:45:30.038279 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" event={"ID":"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5","Type":"ContainerStarted","Data":"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d"} Dec 04 00:45:30.038324 master-0 kubenswrapper[8678]: I1204 00:45:30.038313 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" event={"ID":"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5","Type":"ContainerStarted","Data":"bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2"} Dec 04 00:45:30.038594 master-0 kubenswrapper[8678]: I1204 00:45:30.038555 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:30.041791 master-0 kubenswrapper[8678]: I1204 00:45:30.041732 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" event={"ID":"87c52add-1fdc-4227-b1b1-76f3653e3fb0","Type":"ContainerStarted","Data":"a89811f7d42a78d31a2a71898ae173df2e81d27cb7e73f41fe6560d077317a7b"} Dec 04 00:45:30.043285 master-0 kubenswrapper[8678]: I1204 00:45:30.043221 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" event={"ID":"e3545341-90a7-42fe-9ba4-bf6e71ef776e","Type":"ContainerStarted","Data":"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042"} Dec 04 00:45:30.043459 master-0 kubenswrapper[8678]: I1204 00:45:30.043409 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:30.044682 master-0 kubenswrapper[8678]: I1204 00:45:30.044641 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" event={"ID":"29db06e4-26c0-45e4-ba90-509f51cad1a2","Type":"ContainerStarted","Data":"864070600b55b4222b9bf72b1a8ab8c433f495fce12d7e4f31f5016560f63d8f"} Dec 04 00:45:30.045698 master-0 kubenswrapper[8678]: I1204 00:45:30.045655 8678 generic.go:334] "Generic (PLEG): container finished" podID="20b72b56-e3de-447b-9f30-79e0295770da" containerID="38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a" exitCode=0 Dec 04 00:45:30.045810 master-0 kubenswrapper[8678]: I1204 00:45:30.045702 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerDied","Data":"38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a"} Dec 04 00:45:30.045810 master-0 kubenswrapper[8678]: I1204 00:45:30.045719 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerStarted","Data":"e0ce2f76225fa03e652d00ee11c0ac6ef9f9a76a191b63cea8fef6c0c65d6cab"} Dec 04 00:45:30.049000 master-0 kubenswrapper[8678]: I1204 00:45:30.048944 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/machine-api-operator/0.log" Dec 04 00:45:30.049372 master-0 kubenswrapper[8678]: I1204 00:45:30.049309 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" event={"ID":"e852069a-82f1-4121-9d86-277b8ca07370","Type":"ContainerStarted","Data":"b85a1209eb4c89fb45d7e597cf52091fb9d4d3c4943dc290137886073eccc255"} Dec 04 00:45:30.050702 master-0 kubenswrapper[8678]: I1204 00:45:30.050653 8678 generic.go:334] "Generic (PLEG): container finished" podID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerID="54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81" exitCode=0 Dec 04 00:45:30.050702 master-0 kubenswrapper[8678]: I1204 00:45:30.050680 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerDied","Data":"54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81"} Dec 04 00:45:30.050889 master-0 kubenswrapper[8678]: I1204 00:45:30.050706 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerStarted","Data":"7a0394dbc52d2005020d5795113ee4eaafc48dd61f3f74124a98582b587be777"} Dec 04 00:45:30.052476 master-0 kubenswrapper[8678]: I1204 00:45:30.052433 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:45:30.054110 master-0 kubenswrapper[8678]: I1204 00:45:30.054068 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" event={"ID":"8a5721ad-a077-439a-9ec0-57d90dfb5c14","Type":"ContainerStarted","Data":"2aac71fd63b04f28f73c62464a7b4c7c00efb1e6a5f201c3ea0cc4338a68cc32"} Dec 04 00:45:30.056332 master-0 kubenswrapper[8678]: I1204 00:45:30.056297 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" event={"ID":"95141f9b-b6b0-40dc-a6e2-b5c84d24caac","Type":"ContainerStarted","Data":"06fa72c9d7ba634c428ece7996f7fcb3ba95d71da7fb5cd71e618ae6114bc984"} Dec 04 00:45:30.063425 master-0 kubenswrapper[8678]: I1204 00:45:30.060678 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" event={"ID":"285a1e74-1d8e-452e-a5a4-484afc10e10f","Type":"ContainerStarted","Data":"7efbf88ac518c506c3a029f3850e27da779f7d1648ec2ede3a9eecad800f7432"} Dec 04 00:45:30.071842 master-0 kubenswrapper[8678]: I1204 00:45:30.071593 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" event={"ID":"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11","Type":"ContainerStarted","Data":"cf87c29d032b1cd25ce98cac4c1f284d01eb2538ab566857acb0af6b96abf62f"} Dec 04 00:45:30.206865 master-0 kubenswrapper[8678]: I1204 00:45:30.206770 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" podStartSLOduration=307.206748181 podStartE2EDuration="5m7.206748181s" podCreationTimestamp="2025-12-04 00:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:45:30.205498765 +0000 UTC m=+913.532231321" watchObservedRunningTime="2025-12-04 00:45:30.206748181 +0000 UTC m=+913.533480737" Dec 04 00:45:30.207104 master-0 kubenswrapper[8678]: I1204 00:45:30.207030 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:45:30.232983 master-0 kubenswrapper[8678]: I1204 00:45:30.232896 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" podStartSLOduration=307.232874747 podStartE2EDuration="5m7.232874747s" podCreationTimestamp="2025-12-04 00:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:45:30.231036105 +0000 UTC m=+913.557768671" watchObservedRunningTime="2025-12-04 00:45:30.232874747 +0000 UTC m=+913.559607303" Dec 04 00:45:30.521989 master-0 kubenswrapper[8678]: I1204 00:45:30.521906 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:30.521989 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:30.521989 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:30.521989 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:30.522374 master-0 kubenswrapper[8678]: I1204 00:45:30.522006 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:31.083789 master-0 kubenswrapper[8678]: I1204 00:45:31.083622 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerStarted","Data":"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4"} Dec 04 00:45:31.087388 master-0 kubenswrapper[8678]: I1204 00:45:31.087358 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerStarted","Data":"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105"} Dec 04 00:45:31.090319 master-0 kubenswrapper[8678]: I1204 00:45:31.090224 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerStarted","Data":"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88"} Dec 04 00:45:31.092861 master-0 kubenswrapper[8678]: I1204 00:45:31.092808 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerStarted","Data":"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13"} Dec 04 00:45:31.522749 master-0 kubenswrapper[8678]: I1204 00:45:31.522672 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:31.522749 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:31.522749 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:31.522749 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:31.523373 master-0 kubenswrapper[8678]: I1204 00:45:31.522751 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:32.107220 master-0 kubenswrapper[8678]: I1204 00:45:32.107096 8678 generic.go:334] "Generic (PLEG): container finished" podID="20b72b56-e3de-447b-9f30-79e0295770da" containerID="b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105" exitCode=0 Dec 04 00:45:32.108368 master-0 kubenswrapper[8678]: I1204 00:45:32.107258 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerDied","Data":"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105"} Dec 04 00:45:32.112371 master-0 kubenswrapper[8678]: I1204 00:45:32.112333 8678 generic.go:334] "Generic (PLEG): container finished" podID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerID="762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88" exitCode=0 Dec 04 00:45:32.112512 master-0 kubenswrapper[8678]: I1204 00:45:32.112430 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerDied","Data":"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88"} Dec 04 00:45:32.115764 master-0 kubenswrapper[8678]: I1204 00:45:32.115510 8678 generic.go:334] "Generic (PLEG): container finished" podID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerID="1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13" exitCode=0 Dec 04 00:45:32.117465 master-0 kubenswrapper[8678]: I1204 00:45:32.115566 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerDied","Data":"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13"} Dec 04 00:45:32.120818 master-0 kubenswrapper[8678]: I1204 00:45:32.120153 8678 generic.go:334] "Generic (PLEG): container finished" podID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerID="8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4" exitCode=0 Dec 04 00:45:32.120818 master-0 kubenswrapper[8678]: I1204 00:45:32.120665 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerDied","Data":"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4"} Dec 04 00:45:32.530101 master-0 kubenswrapper[8678]: I1204 00:45:32.529969 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:32.530101 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:32.530101 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:32.530101 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:32.530101 master-0 kubenswrapper[8678]: I1204 00:45:32.530078 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:32.850217 master-0 kubenswrapper[8678]: I1204 00:45:32.850169 8678 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:45:33.522781 master-0 kubenswrapper[8678]: I1204 00:45:33.522704 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:33.522781 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:33.522781 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:33.522781 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:33.523555 master-0 kubenswrapper[8678]: I1204 00:45:33.522821 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:34.142859 master-0 kubenswrapper[8678]: I1204 00:45:34.142663 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:45:34.144627 master-0 kubenswrapper[8678]: I1204 00:45:34.144559 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:45:34.145495 master-0 kubenswrapper[8678]: I1204 00:45:34.145445 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:45:34.145654 master-0 kubenswrapper[8678]: I1204 00:45:34.145525 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} Dec 04 00:45:34.523219 master-0 kubenswrapper[8678]: I1204 00:45:34.523030 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:34.523219 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:34.523219 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:34.523219 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:34.523219 master-0 kubenswrapper[8678]: I1204 00:45:34.523135 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:34.849356 master-0 kubenswrapper[8678]: I1204 00:45:34.849322 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:45:34.849569 master-0 kubenswrapper[8678]: E1204 00:45:34.849539 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:35.156276 master-0 kubenswrapper[8678]: I1204 00:45:35.156146 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerStarted","Data":"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452"} Dec 04 00:45:35.158502 master-0 kubenswrapper[8678]: I1204 00:45:35.158441 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerStarted","Data":"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5"} Dec 04 00:45:35.162587 master-0 kubenswrapper[8678]: I1204 00:45:35.162536 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerStarted","Data":"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff"} Dec 04 00:45:35.166717 master-0 kubenswrapper[8678]: I1204 00:45:35.166673 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerStarted","Data":"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41"} Dec 04 00:45:35.208690 master-0 kubenswrapper[8678]: I1204 00:45:35.208556 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-wh4gp" podStartSLOduration=7.554444432 podStartE2EDuration="12.208534999s" podCreationTimestamp="2025-12-04 00:45:23 +0000 UTC" firstStartedPulling="2025-12-04 00:45:30.047117642 +0000 UTC m=+913.373850198" lastFinishedPulling="2025-12-04 00:45:34.701208209 +0000 UTC m=+918.027940765" observedRunningTime="2025-12-04 00:45:35.187482308 +0000 UTC m=+918.514214874" watchObservedRunningTime="2025-12-04 00:45:35.208534999 +0000 UTC m=+918.535267555" Dec 04 00:45:35.209569 master-0 kubenswrapper[8678]: I1204 00:45:35.209529 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-24mpn" podStartSLOduration=12.563505091 podStartE2EDuration="17.209521787s" podCreationTimestamp="2025-12-04 00:45:18 +0000 UTC" firstStartedPulling="2025-12-04 00:45:30.029602612 +0000 UTC m=+913.356335168" lastFinishedPulling="2025-12-04 00:45:34.675619308 +0000 UTC m=+918.002351864" observedRunningTime="2025-12-04 00:45:35.2067947 +0000 UTC m=+918.533527256" watchObservedRunningTime="2025-12-04 00:45:35.209521787 +0000 UTC m=+918.536254343" Dec 04 00:45:35.261806 master-0 kubenswrapper[8678]: I1204 00:45:35.261710 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-nh2ml" podStartSLOduration=12.72421665 podStartE2EDuration="17.261684237s" podCreationTimestamp="2025-12-04 00:45:18 +0000 UTC" firstStartedPulling="2025-12-04 00:45:30.035441108 +0000 UTC m=+913.362173664" lastFinishedPulling="2025-12-04 00:45:34.572908695 +0000 UTC m=+917.899641251" observedRunningTime="2025-12-04 00:45:35.231400512 +0000 UTC m=+918.558133078" watchObservedRunningTime="2025-12-04 00:45:35.261684237 +0000 UTC m=+918.588416803" Dec 04 00:45:35.286679 master-0 kubenswrapper[8678]: I1204 00:45:35.286598 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-4gm92" podStartSLOduration=7.726193157 podStartE2EDuration="12.286572838s" podCreationTimestamp="2025-12-04 00:45:23 +0000 UTC" firstStartedPulling="2025-12-04 00:45:30.053253037 +0000 UTC m=+913.379985593" lastFinishedPulling="2025-12-04 00:45:34.613632718 +0000 UTC m=+917.940365274" observedRunningTime="2025-12-04 00:45:35.286205758 +0000 UTC m=+918.612938334" watchObservedRunningTime="2025-12-04 00:45:35.286572838 +0000 UTC m=+918.613305394" Dec 04 00:45:35.523524 master-0 kubenswrapper[8678]: I1204 00:45:35.523398 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:35.523524 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:35.523524 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:35.523524 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:35.523524 master-0 kubenswrapper[8678]: I1204 00:45:35.523491 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:35.850140 master-0 kubenswrapper[8678]: I1204 00:45:35.850071 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:45:35.850419 master-0 kubenswrapper[8678]: E1204 00:45:35.850295 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-85dbd94574-7clvx_openshift-ingress-operator(c0f3ded2-925e-4d86-9c91-55b5df9f28ab)\"" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" podUID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" Dec 04 00:45:36.526754 master-0 kubenswrapper[8678]: I1204 00:45:36.526685 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:36.526754 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:36.526754 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:36.526754 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:36.527468 master-0 kubenswrapper[8678]: I1204 00:45:36.526785 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:37.523408 master-0 kubenswrapper[8678]: I1204 00:45:37.523293 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:37.523408 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:37.523408 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:37.523408 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:37.523738 master-0 kubenswrapper[8678]: I1204 00:45:37.523440 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:38.523833 master-0 kubenswrapper[8678]: I1204 00:45:38.523750 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:38.523833 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:38.523833 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:38.523833 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:38.524537 master-0 kubenswrapper[8678]: I1204 00:45:38.523862 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:38.581418 master-0 kubenswrapper[8678]: I1204 00:45:38.581349 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:38.581418 master-0 kubenswrapper[8678]: I1204 00:45:38.581440 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:38.645428 master-0 kubenswrapper[8678]: I1204 00:45:38.645376 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:38.645679 master-0 kubenswrapper[8678]: I1204 00:45:38.645461 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:38.658339 master-0 kubenswrapper[8678]: I1204 00:45:38.658291 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:38.658339 master-0 kubenswrapper[8678]: I1204 00:45:38.658328 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:38.676799 master-0 kubenswrapper[8678]: I1204 00:45:38.676738 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:38.676799 master-0 kubenswrapper[8678]: I1204 00:45:38.676796 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:38.711200 master-0 kubenswrapper[8678]: I1204 00:45:38.711157 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:38.718282 master-0 kubenswrapper[8678]: I1204 00:45:38.718229 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:38.743910 master-0 kubenswrapper[8678]: I1204 00:45:38.743841 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:39.252920 master-0 kubenswrapper[8678]: I1204 00:45:39.252852 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:39.266585 master-0 kubenswrapper[8678]: I1204 00:45:39.266504 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:39.276405 master-0 kubenswrapper[8678]: I1204 00:45:39.276335 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:39.523804 master-0 kubenswrapper[8678]: I1204 00:45:39.523625 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:39.523804 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:39.523804 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:39.523804 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:39.523804 master-0 kubenswrapper[8678]: I1204 00:45:39.523741 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:39.646320 master-0 kubenswrapper[8678]: I1204 00:45:39.646246 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-nh2ml" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="registry-server" probeResult="failure" output=< Dec 04 00:45:39.646320 master-0 kubenswrapper[8678]: timeout: failed to connect service ":50051" within 1s Dec 04 00:45:39.646320 master-0 kubenswrapper[8678]: > Dec 04 00:45:39.943707 master-0 kubenswrapper[8678]: I1204 00:45:39.943587 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:45:39.943707 master-0 kubenswrapper[8678]: I1204 00:45:39.943684 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:45:39.952107 master-0 kubenswrapper[8678]: I1204 00:45:39.952030 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:45:40.522499 master-0 kubenswrapper[8678]: I1204 00:45:40.522414 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:40.522499 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:40.522499 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:40.522499 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:40.522499 master-0 kubenswrapper[8678]: I1204 00:45:40.522490 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:40.660036 master-0 kubenswrapper[8678]: I1204 00:45:40.659943 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:41.208723 master-0 kubenswrapper[8678]: I1204 00:45:41.208611 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-24mpn" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="registry-server" containerID="cri-o://a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5" gracePeriod=2 Dec 04 00:45:41.526694 master-0 kubenswrapper[8678]: I1204 00:45:41.526433 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:41.526694 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:41.526694 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:41.526694 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:41.526694 master-0 kubenswrapper[8678]: I1204 00:45:41.526618 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:41.721721 master-0 kubenswrapper[8678]: I1204 00:45:41.721667 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:41.754319 master-0 kubenswrapper[8678]: I1204 00:45:41.754210 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7snd\" (UniqueName: \"kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd\") pod \"1c89b21f-9c26-4d2c-829a-75519d1070d1\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " Dec 04 00:45:41.756150 master-0 kubenswrapper[8678]: I1204 00:45:41.754390 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities\") pod \"1c89b21f-9c26-4d2c-829a-75519d1070d1\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " Dec 04 00:45:41.756150 master-0 kubenswrapper[8678]: I1204 00:45:41.754577 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content\") pod \"1c89b21f-9c26-4d2c-829a-75519d1070d1\" (UID: \"1c89b21f-9c26-4d2c-829a-75519d1070d1\") " Dec 04 00:45:41.756150 master-0 kubenswrapper[8678]: I1204 00:45:41.755419 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities" (OuterVolumeSpecName: "utilities") pod "1c89b21f-9c26-4d2c-829a-75519d1070d1" (UID: "1c89b21f-9c26-4d2c-829a-75519d1070d1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:41.760314 master-0 kubenswrapper[8678]: I1204 00:45:41.760236 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd" (OuterVolumeSpecName: "kube-api-access-g7snd") pod "1c89b21f-9c26-4d2c-829a-75519d1070d1" (UID: "1c89b21f-9c26-4d2c-829a-75519d1070d1"). InnerVolumeSpecName "kube-api-access-g7snd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:45:41.845219 master-0 kubenswrapper[8678]: I1204 00:45:41.845133 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1c89b21f-9c26-4d2c-829a-75519d1070d1" (UID: "1c89b21f-9c26-4d2c-829a-75519d1070d1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:41.857128 master-0 kubenswrapper[8678]: I1204 00:45:41.857041 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g7snd\" (UniqueName: \"kubernetes.io/projected/1c89b21f-9c26-4d2c-829a-75519d1070d1-kube-api-access-g7snd\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:41.857128 master-0 kubenswrapper[8678]: I1204 00:45:41.857116 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:41.857128 master-0 kubenswrapper[8678]: I1204 00:45:41.857135 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1c89b21f-9c26-4d2c-829a-75519d1070d1-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:42.223958 master-0 kubenswrapper[8678]: I1204 00:45:42.223871 8678 generic.go:334] "Generic (PLEG): container finished" podID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerID="a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5" exitCode=0 Dec 04 00:45:42.223958 master-0 kubenswrapper[8678]: I1204 00:45:42.223958 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerDied","Data":"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5"} Dec 04 00:45:42.224432 master-0 kubenswrapper[8678]: I1204 00:45:42.223997 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-24mpn" event={"ID":"1c89b21f-9c26-4d2c-829a-75519d1070d1","Type":"ContainerDied","Data":"cc79c6a47d68afe50cd6192f3b3f850724de86210a1d291f9c3b7f2ce71c16bb"} Dec 04 00:45:42.224432 master-0 kubenswrapper[8678]: I1204 00:45:42.224028 8678 scope.go:117] "RemoveContainer" containerID="a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5" Dec 04 00:45:42.224432 master-0 kubenswrapper[8678]: I1204 00:45:42.224183 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-24mpn" Dec 04 00:45:42.252957 master-0 kubenswrapper[8678]: I1204 00:45:42.252879 8678 scope.go:117] "RemoveContainer" containerID="762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88" Dec 04 00:45:42.287133 master-0 kubenswrapper[8678]: I1204 00:45:42.287062 8678 scope.go:117] "RemoveContainer" containerID="9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c" Dec 04 00:45:42.307834 master-0 kubenswrapper[8678]: I1204 00:45:42.304841 8678 scope.go:117] "RemoveContainer" containerID="a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5" Dec 04 00:45:42.308945 master-0 kubenswrapper[8678]: E1204 00:45:42.308867 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5\": container with ID starting with a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5 not found: ID does not exist" containerID="a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5" Dec 04 00:45:42.309019 master-0 kubenswrapper[8678]: I1204 00:45:42.308946 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5"} err="failed to get container status \"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5\": rpc error: code = NotFound desc = could not find container \"a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5\": container with ID starting with a65e5098406a516d181278ec8b7317ff30e3927f84a6f95dba8be6a053c4a4e5 not found: ID does not exist" Dec 04 00:45:42.309019 master-0 kubenswrapper[8678]: I1204 00:45:42.308994 8678 scope.go:117] "RemoveContainer" containerID="762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88" Dec 04 00:45:42.309629 master-0 kubenswrapper[8678]: E1204 00:45:42.309560 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88\": container with ID starting with 762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88 not found: ID does not exist" containerID="762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88" Dec 04 00:45:42.309729 master-0 kubenswrapper[8678]: I1204 00:45:42.309617 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88"} err="failed to get container status \"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88\": rpc error: code = NotFound desc = could not find container \"762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88\": container with ID starting with 762312d33b9b47d3e08cd3ec2e45f5ba148f9e7b0a29a446432987d50eb13e88 not found: ID does not exist" Dec 04 00:45:42.309729 master-0 kubenswrapper[8678]: I1204 00:45:42.309653 8678 scope.go:117] "RemoveContainer" containerID="9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c" Dec 04 00:45:42.310036 master-0 kubenswrapper[8678]: E1204 00:45:42.309975 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c\": container with ID starting with 9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c not found: ID does not exist" containerID="9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c" Dec 04 00:45:42.310036 master-0 kubenswrapper[8678]: I1204 00:45:42.310003 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c"} err="failed to get container status \"9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c\": rpc error: code = NotFound desc = could not find container \"9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c\": container with ID starting with 9e8b9c699f416c9df78ad3a067456130f8afdcda03a586c2c6fcb7c540cc669c not found: ID does not exist" Dec 04 00:45:42.522654 master-0 kubenswrapper[8678]: I1204 00:45:42.522511 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:42.522654 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:42.522654 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:42.522654 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:42.522654 master-0 kubenswrapper[8678]: I1204 00:45:42.522602 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:43.523320 master-0 kubenswrapper[8678]: I1204 00:45:43.523235 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:43.523320 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:43.523320 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:43.523320 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:43.524080 master-0 kubenswrapper[8678]: I1204 00:45:43.523333 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:44.522406 master-0 kubenswrapper[8678]: I1204 00:45:44.522339 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:44.522406 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:44.522406 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:44.522406 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:44.522406 master-0 kubenswrapper[8678]: I1204 00:45:44.522400 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: I1204 00:45:45.452967 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: E1204 00:45:45.453331 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="extract-content" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: I1204 00:45:45.453347 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="extract-content" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: E1204 00:45:45.453392 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="extract-utilities" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: I1204 00:45:45.453400 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="extract-utilities" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: E1204 00:45:45.453411 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="registry-server" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: I1204 00:45:45.453419 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="registry-server" Dec 04 00:45:45.453791 master-0 kubenswrapper[8678]: I1204 00:45:45.453572 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" containerName="registry-server" Dec 04 00:45:45.454504 master-0 kubenswrapper[8678]: I1204 00:45:45.454403 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.460105 master-0 kubenswrapper[8678]: I1204 00:45:45.460047 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-8xh6q" Dec 04 00:45:45.462869 master-0 kubenswrapper[8678]: I1204 00:45:45.462820 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:45.463778 master-0 kubenswrapper[8678]: I1204 00:45:45.463690 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-4gm92" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="registry-server" containerID="cri-o://5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff" gracePeriod=2 Dec 04 00:45:45.463891 master-0 kubenswrapper[8678]: I1204 00:45:45.463844 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 00:45:45.468296 master-0 kubenswrapper[8678]: I1204 00:45:45.468250 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:45.481627 master-0 kubenswrapper[8678]: I1204 00:45:45.480429 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:45:45.495959 master-0 kubenswrapper[8678]: I1204 00:45:45.494441 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-24mpn"] Dec 04 00:45:45.502907 master-0 kubenswrapper[8678]: I1204 00:45:45.502840 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:45.503252 master-0 kubenswrapper[8678]: I1204 00:45:45.503216 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-wh4gp" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="registry-server" containerID="cri-o://e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452" gracePeriod=2 Dec 04 00:45:45.520959 master-0 kubenswrapper[8678]: I1204 00:45:45.517142 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.520959 master-0 kubenswrapper[8678]: I1204 00:45:45.517223 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.520959 master-0 kubenswrapper[8678]: I1204 00:45:45.517249 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.525537 master-0 kubenswrapper[8678]: I1204 00:45:45.525466 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:45.525537 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:45.525537 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:45.525537 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:45.525787 master-0 kubenswrapper[8678]: I1204 00:45:45.525559 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:45.619119 master-0 kubenswrapper[8678]: I1204 00:45:45.619067 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.619119 master-0 kubenswrapper[8678]: I1204 00:45:45.619122 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.619281 master-0 kubenswrapper[8678]: I1204 00:45:45.619141 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.619501 master-0 kubenswrapper[8678]: I1204 00:45:45.619420 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.619501 master-0 kubenswrapper[8678]: I1204 00:45:45.619434 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.637004 master-0 kubenswrapper[8678]: I1204 00:45:45.636670 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access\") pod \"installer-2-master-0\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.790356 master-0 kubenswrapper[8678]: I1204 00:45:45.787867 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:45:45.860102 master-0 kubenswrapper[8678]: I1204 00:45:45.851501 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:45:45.860102 master-0 kubenswrapper[8678]: E1204 00:45:45.851699 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:45.922471 master-0 kubenswrapper[8678]: I1204 00:45:45.919193 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht"] Dec 04 00:45:45.922471 master-0 kubenswrapper[8678]: I1204 00:45:45.920824 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:45.939141 master-0 kubenswrapper[8678]: I1204 00:45:45.923568 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 00:45:45.939141 master-0 kubenswrapper[8678]: I1204 00:45:45.923577 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-zx2gd" Dec 04 00:45:45.939141 master-0 kubenswrapper[8678]: I1204 00:45:45.937065 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht"] Dec 04 00:45:45.992604 master-0 kubenswrapper[8678]: I1204 00:45:45.991372 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:46.030888 master-0 kubenswrapper[8678]: I1204 00:45:46.030408 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87\") pod \"20b72b56-e3de-447b-9f30-79e0295770da\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " Dec 04 00:45:46.030888 master-0 kubenswrapper[8678]: I1204 00:45:46.030537 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content\") pod \"20b72b56-e3de-447b-9f30-79e0295770da\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " Dec 04 00:45:46.030888 master-0 kubenswrapper[8678]: I1204 00:45:46.030573 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities\") pod \"20b72b56-e3de-447b-9f30-79e0295770da\" (UID: \"20b72b56-e3de-447b-9f30-79e0295770da\") " Dec 04 00:45:46.032117 master-0 kubenswrapper[8678]: I1204 00:45:46.031403 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgmm\" (UniqueName: \"kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.032117 master-0 kubenswrapper[8678]: I1204 00:45:46.031457 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.032117 master-0 kubenswrapper[8678]: I1204 00:45:46.031544 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.033251 master-0 kubenswrapper[8678]: I1204 00:45:46.033209 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities" (OuterVolumeSpecName: "utilities") pod "20b72b56-e3de-447b-9f30-79e0295770da" (UID: "20b72b56-e3de-447b-9f30-79e0295770da"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:46.034064 master-0 kubenswrapper[8678]: I1204 00:45:46.034019 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:46.042287 master-0 kubenswrapper[8678]: I1204 00:45:46.041046 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87" (OuterVolumeSpecName: "kube-api-access-6hc87") pod "20b72b56-e3de-447b-9f30-79e0295770da" (UID: "20b72b56-e3de-447b-9f30-79e0295770da"). InnerVolumeSpecName "kube-api-access-6hc87". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:45:46.073956 master-0 kubenswrapper[8678]: I1204 00:45:46.061736 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "20b72b56-e3de-447b-9f30-79e0295770da" (UID: "20b72b56-e3de-447b-9f30-79e0295770da"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:46.134958 master-0 kubenswrapper[8678]: I1204 00:45:46.134697 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwh97\" (UniqueName: \"kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97\") pod \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " Dec 04 00:45:46.134958 master-0 kubenswrapper[8678]: I1204 00:45:46.134813 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content\") pod \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " Dec 04 00:45:46.134958 master-0 kubenswrapper[8678]: I1204 00:45:46.134909 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities\") pod \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\" (UID: \"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13\") " Dec 04 00:45:46.136643 master-0 kubenswrapper[8678]: I1204 00:45:46.136600 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgmm\" (UniqueName: \"kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.136700 master-0 kubenswrapper[8678]: I1204 00:45:46.136656 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.136807 master-0 kubenswrapper[8678]: I1204 00:45:46.136773 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.137004 master-0 kubenswrapper[8678]: I1204 00:45:46.136917 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/20b72b56-e3de-447b-9f30-79e0295770da-kube-api-access-6hc87\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.137004 master-0 kubenswrapper[8678]: I1204 00:45:46.136954 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.137004 master-0 kubenswrapper[8678]: I1204 00:45:46.136965 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/20b72b56-e3de-447b-9f30-79e0295770da-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.140951 master-0 kubenswrapper[8678]: I1204 00:45:46.137955 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.140951 master-0 kubenswrapper[8678]: I1204 00:45:46.139720 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities" (OuterVolumeSpecName: "utilities") pod "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" (UID: "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:46.144949 master-0 kubenswrapper[8678]: I1204 00:45:46.142525 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.144949 master-0 kubenswrapper[8678]: I1204 00:45:46.144216 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97" (OuterVolumeSpecName: "kube-api-access-lwh97") pod "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" (UID: "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13"). InnerVolumeSpecName "kube-api-access-lwh97". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:45:46.188959 master-0 kubenswrapper[8678]: I1204 00:45:46.188845 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgmm\" (UniqueName: \"kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm\") pod \"collect-profiles-29413485-5fwht\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.217354 master-0 kubenswrapper[8678]: I1204 00:45:46.217249 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" (UID: "0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:46.238558 master-0 kubenswrapper[8678]: I1204 00:45:46.238484 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lwh97\" (UniqueName: \"kubernetes.io/projected/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-kube-api-access-lwh97\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.238558 master-0 kubenswrapper[8678]: I1204 00:45:46.238533 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.238558 master-0 kubenswrapper[8678]: I1204 00:45:46.238547 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:46.262253 master-0 kubenswrapper[8678]: I1204 00:45:46.262158 8678 generic.go:334] "Generic (PLEG): container finished" podID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerID="5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff" exitCode=0 Dec 04 00:45:46.262253 master-0 kubenswrapper[8678]: I1204 00:45:46.262219 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerDied","Data":"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff"} Dec 04 00:45:46.262500 master-0 kubenswrapper[8678]: I1204 00:45:46.262273 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gm92" Dec 04 00:45:46.262500 master-0 kubenswrapper[8678]: I1204 00:45:46.262306 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gm92" event={"ID":"0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13","Type":"ContainerDied","Data":"7a0394dbc52d2005020d5795113ee4eaafc48dd61f3f74124a98582b587be777"} Dec 04 00:45:46.262500 master-0 kubenswrapper[8678]: I1204 00:45:46.262358 8678 scope.go:117] "RemoveContainer" containerID="5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff" Dec 04 00:45:46.266023 master-0 kubenswrapper[8678]: I1204 00:45:46.265972 8678 generic.go:334] "Generic (PLEG): container finished" podID="20b72b56-e3de-447b-9f30-79e0295770da" containerID="e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452" exitCode=0 Dec 04 00:45:46.266088 master-0 kubenswrapper[8678]: I1204 00:45:46.266032 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh4gp" Dec 04 00:45:46.266176 master-0 kubenswrapper[8678]: I1204 00:45:46.266035 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerDied","Data":"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452"} Dec 04 00:45:46.266214 master-0 kubenswrapper[8678]: I1204 00:45:46.266188 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh4gp" event={"ID":"20b72b56-e3de-447b-9f30-79e0295770da","Type":"ContainerDied","Data":"e0ce2f76225fa03e652d00ee11c0ac6ef9f9a76a191b63cea8fef6c0c65d6cab"} Dec 04 00:45:46.275242 master-0 kubenswrapper[8678]: I1204 00:45:46.275184 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:46.282057 master-0 kubenswrapper[8678]: I1204 00:45:46.282010 8678 scope.go:117] "RemoveContainer" containerID="1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13" Dec 04 00:45:46.302296 master-0 kubenswrapper[8678]: I1204 00:45:46.302162 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:45:46.310508 master-0 kubenswrapper[8678]: I1204 00:45:46.310463 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:46.314739 master-0 kubenswrapper[8678]: I1204 00:45:46.314675 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-4gm92"] Dec 04 00:45:46.323351 master-0 kubenswrapper[8678]: I1204 00:45:46.323257 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:46.328623 master-0 kubenswrapper[8678]: I1204 00:45:46.328560 8678 scope.go:117] "RemoveContainer" containerID="54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81" Dec 04 00:45:46.328879 master-0 kubenswrapper[8678]: I1204 00:45:46.328817 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh4gp"] Dec 04 00:45:46.352220 master-0 kubenswrapper[8678]: I1204 00:45:46.352121 8678 scope.go:117] "RemoveContainer" containerID="5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff" Dec 04 00:45:46.353718 master-0 kubenswrapper[8678]: E1204 00:45:46.353662 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff\": container with ID starting with 5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff not found: ID does not exist" containerID="5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff" Dec 04 00:45:46.353788 master-0 kubenswrapper[8678]: I1204 00:45:46.353733 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff"} err="failed to get container status \"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff\": rpc error: code = NotFound desc = could not find container \"5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff\": container with ID starting with 5e9fbf1a2db0aa0a5e5b0d8fdcceff6f24ddfde35c60fd47b06ee78d8b8d2dff not found: ID does not exist" Dec 04 00:45:46.353788 master-0 kubenswrapper[8678]: I1204 00:45:46.353777 8678 scope.go:117] "RemoveContainer" containerID="1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13" Dec 04 00:45:46.354326 master-0 kubenswrapper[8678]: E1204 00:45:46.354301 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13\": container with ID starting with 1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13 not found: ID does not exist" containerID="1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13" Dec 04 00:45:46.354379 master-0 kubenswrapper[8678]: I1204 00:45:46.354332 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13"} err="failed to get container status \"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13\": rpc error: code = NotFound desc = could not find container \"1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13\": container with ID starting with 1d9d5f023ad00045626aef74727114cb7d2392fdbb52a1136ba60a9964aa6e13 not found: ID does not exist" Dec 04 00:45:46.354379 master-0 kubenswrapper[8678]: I1204 00:45:46.354351 8678 scope.go:117] "RemoveContainer" containerID="54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81" Dec 04 00:45:46.354774 master-0 kubenswrapper[8678]: E1204 00:45:46.354732 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81\": container with ID starting with 54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81 not found: ID does not exist" containerID="54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81" Dec 04 00:45:46.354823 master-0 kubenswrapper[8678]: I1204 00:45:46.354788 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81"} err="failed to get container status \"54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81\": rpc error: code = NotFound desc = could not find container \"54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81\": container with ID starting with 54d027c607279b29e93affb25cf71a1753e92fb009b5b1865fee492b83fa4f81 not found: ID does not exist" Dec 04 00:45:46.354864 master-0 kubenswrapper[8678]: I1204 00:45:46.354829 8678 scope.go:117] "RemoveContainer" containerID="e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452" Dec 04 00:45:46.370971 master-0 kubenswrapper[8678]: I1204 00:45:46.370882 8678 scope.go:117] "RemoveContainer" containerID="b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105" Dec 04 00:45:46.388894 master-0 kubenswrapper[8678]: I1204 00:45:46.388854 8678 scope.go:117] "RemoveContainer" containerID="38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a" Dec 04 00:45:46.409462 master-0 kubenswrapper[8678]: I1204 00:45:46.409412 8678 scope.go:117] "RemoveContainer" containerID="e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452" Dec 04 00:45:46.410306 master-0 kubenswrapper[8678]: E1204 00:45:46.410263 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452\": container with ID starting with e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452 not found: ID does not exist" containerID="e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452" Dec 04 00:45:46.410378 master-0 kubenswrapper[8678]: I1204 00:45:46.410307 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452"} err="failed to get container status \"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452\": rpc error: code = NotFound desc = could not find container \"e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452\": container with ID starting with e9e0ac11cfd6d61b64b897c055bb9fd4ed3ac83778fef3e342da3972eaa55452 not found: ID does not exist" Dec 04 00:45:46.410378 master-0 kubenswrapper[8678]: I1204 00:45:46.410335 8678 scope.go:117] "RemoveContainer" containerID="b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105" Dec 04 00:45:46.410743 master-0 kubenswrapper[8678]: E1204 00:45:46.410706 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105\": container with ID starting with b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105 not found: ID does not exist" containerID="b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105" Dec 04 00:45:46.410743 master-0 kubenswrapper[8678]: I1204 00:45:46.410732 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105"} err="failed to get container status \"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105\": rpc error: code = NotFound desc = could not find container \"b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105\": container with ID starting with b7de6fd50d0f88141c589ec43924a6ed493237a37bfa0e9c0d0aae10f92e4105 not found: ID does not exist" Dec 04 00:45:46.410832 master-0 kubenswrapper[8678]: I1204 00:45:46.410747 8678 scope.go:117] "RemoveContainer" containerID="38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a" Dec 04 00:45:46.411083 master-0 kubenswrapper[8678]: E1204 00:45:46.411049 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a\": container with ID starting with 38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a not found: ID does not exist" containerID="38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a" Dec 04 00:45:46.411083 master-0 kubenswrapper[8678]: I1204 00:45:46.411074 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a"} err="failed to get container status \"38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a\": rpc error: code = NotFound desc = could not find container \"38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a\": container with ID starting with 38c468a014034e8dbba7c03fb9e197f1d50f3f1a1b8fb01ee19b64a2199dcf9a not found: ID does not exist" Dec 04 00:45:46.524983 master-0 kubenswrapper[8678]: I1204 00:45:46.522710 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:46.524983 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:46.524983 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:46.524983 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:46.524983 master-0 kubenswrapper[8678]: I1204 00:45:46.522787 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:46.735142 master-0 kubenswrapper[8678]: I1204 00:45:46.735075 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht"] Dec 04 00:45:46.741619 master-0 kubenswrapper[8678]: W1204 00:45:46.741557 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb3966e_d567_4d7b_957e_ea3c3bf313cb.slice/crio-084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978 WatchSource:0}: Error finding container 084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978: Status 404 returned error can't find the container with id 084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978 Dec 04 00:45:46.860125 master-0 kubenswrapper[8678]: I1204 00:45:46.860048 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" path="/var/lib/kubelet/pods/0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13/volumes" Dec 04 00:45:46.860776 master-0 kubenswrapper[8678]: I1204 00:45:46.860714 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c89b21f-9c26-4d2c-829a-75519d1070d1" path="/var/lib/kubelet/pods/1c89b21f-9c26-4d2c-829a-75519d1070d1/volumes" Dec 04 00:45:46.861495 master-0 kubenswrapper[8678]: I1204 00:45:46.861467 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20b72b56-e3de-447b-9f30-79e0295770da" path="/var/lib/kubelet/pods/20b72b56-e3de-447b-9f30-79e0295770da/volumes" Dec 04 00:45:47.287256 master-0 kubenswrapper[8678]: I1204 00:45:47.287154 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"13804bca-a33b-4517-ae8d-dfedee8dbd49","Type":"ContainerStarted","Data":"a10c30ea77e728a6ce0b426dc2060c5b670abc57ba283cb49abfbb016d339e4e"} Dec 04 00:45:47.287256 master-0 kubenswrapper[8678]: I1204 00:45:47.287233 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"13804bca-a33b-4517-ae8d-dfedee8dbd49","Type":"ContainerStarted","Data":"df037a350007e31122fa96bb68342bb9838c3581e30daa0d1d12b775b6483e82"} Dec 04 00:45:47.290314 master-0 kubenswrapper[8678]: I1204 00:45:47.290175 8678 generic.go:334] "Generic (PLEG): container finished" podID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerID="274339ba78590b378384fabf9e945e17f757b313a617429d755e31ef00625b28" exitCode=0 Dec 04 00:45:47.290614 master-0 kubenswrapper[8678]: I1204 00:45:47.290425 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" event={"ID":"9eb3966e-d567-4d7b-957e-ea3c3bf313cb","Type":"ContainerDied","Data":"274339ba78590b378384fabf9e945e17f757b313a617429d755e31ef00625b28"} Dec 04 00:45:47.290711 master-0 kubenswrapper[8678]: I1204 00:45:47.290628 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" event={"ID":"9eb3966e-d567-4d7b-957e-ea3c3bf313cb","Type":"ContainerStarted","Data":"084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978"} Dec 04 00:45:47.317376 master-0 kubenswrapper[8678]: I1204 00:45:47.317221 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-2-master-0" podStartSLOduration=3.3171822349999998 podStartE2EDuration="3.317182235s" podCreationTimestamp="2025-12-04 00:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:45:47.311958676 +0000 UTC m=+930.638691242" watchObservedRunningTime="2025-12-04 00:45:47.317182235 +0000 UTC m=+930.643914791" Dec 04 00:45:47.523573 master-0 kubenswrapper[8678]: I1204 00:45:47.523493 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:47.523573 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:47.523573 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:47.523573 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:47.523887 master-0 kubenswrapper[8678]: I1204 00:45:47.523593 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:48.523615 master-0 kubenswrapper[8678]: I1204 00:45:48.523031 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:48.523615 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:48.523615 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:48.523615 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:48.523615 master-0 kubenswrapper[8678]: I1204 00:45:48.523119 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:48.580478 master-0 kubenswrapper[8678]: I1204 00:45:48.580431 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:48.626739 master-0 kubenswrapper[8678]: I1204 00:45:48.626686 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:48.667801 master-0 kubenswrapper[8678]: I1204 00:45:48.667725 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:48.675324 master-0 kubenswrapper[8678]: I1204 00:45:48.675272 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume\") pod \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " Dec 04 00:45:48.675454 master-0 kubenswrapper[8678]: I1204 00:45:48.675335 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxgmm\" (UniqueName: \"kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm\") pod \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " Dec 04 00:45:48.675454 master-0 kubenswrapper[8678]: I1204 00:45:48.675396 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume\") pod \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\" (UID: \"9eb3966e-d567-4d7b-957e-ea3c3bf313cb\") " Dec 04 00:45:48.676665 master-0 kubenswrapper[8678]: I1204 00:45:48.676636 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume" (OuterVolumeSpecName: "config-volume") pod "9eb3966e-d567-4d7b-957e-ea3c3bf313cb" (UID: "9eb3966e-d567-4d7b-957e-ea3c3bf313cb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:45:48.679033 master-0 kubenswrapper[8678]: I1204 00:45:48.678997 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "9eb3966e-d567-4d7b-957e-ea3c3bf313cb" (UID: "9eb3966e-d567-4d7b-957e-ea3c3bf313cb"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:45:48.680207 master-0 kubenswrapper[8678]: I1204 00:45:48.680170 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm" (OuterVolumeSpecName: "kube-api-access-fxgmm") pod "9eb3966e-d567-4d7b-957e-ea3c3bf313cb" (UID: "9eb3966e-d567-4d7b-957e-ea3c3bf313cb"). InnerVolumeSpecName "kube-api-access-fxgmm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:45:48.777354 master-0 kubenswrapper[8678]: I1204 00:45:48.777260 8678 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:48.777354 master-0 kubenswrapper[8678]: I1204 00:45:48.777313 8678 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:48.777354 master-0 kubenswrapper[8678]: I1204 00:45:48.777326 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fxgmm\" (UniqueName: \"kubernetes.io/projected/9eb3966e-d567-4d7b-957e-ea3c3bf313cb-kube-api-access-fxgmm\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:49.311462 master-0 kubenswrapper[8678]: I1204 00:45:49.311294 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" event={"ID":"9eb3966e-d567-4d7b-957e-ea3c3bf313cb","Type":"ContainerDied","Data":"084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978"} Dec 04 00:45:49.311462 master-0 kubenswrapper[8678]: I1204 00:45:49.311376 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978" Dec 04 00:45:49.311462 master-0 kubenswrapper[8678]: I1204 00:45:49.311322 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:45:49.522879 master-0 kubenswrapper[8678]: I1204 00:45:49.522799 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:49.522879 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:49.522879 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:49.522879 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:49.523186 master-0 kubenswrapper[8678]: I1204 00:45:49.522915 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:49.915985 master-0 kubenswrapper[8678]: I1204 00:45:49.915132 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:45:49.953836 master-0 kubenswrapper[8678]: I1204 00:45:49.953735 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:45:50.522809 master-0 kubenswrapper[8678]: I1204 00:45:50.522559 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:50.522809 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:50.522809 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:50.522809 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:50.522809 master-0 kubenswrapper[8678]: I1204 00:45:50.522642 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:50.850022 master-0 kubenswrapper[8678]: I1204 00:45:50.849906 8678 scope.go:117] "RemoveContainer" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" Dec 04 00:45:51.328340 master-0 kubenswrapper[8678]: I1204 00:45:51.328271 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/4.log" Dec 04 00:45:51.328895 master-0 kubenswrapper[8678]: I1204 00:45:51.328639 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" event={"ID":"c0f3ded2-925e-4d86-9c91-55b5df9f28ab","Type":"ContainerStarted","Data":"f9267b82111962ce6f5fd0e315c45da095a14bf1f38cc9b3cf7dd6fbe679b088"} Dec 04 00:45:51.521709 master-0 kubenswrapper[8678]: I1204 00:45:51.521530 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:51.521709 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:51.521709 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:51.521709 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:51.521709 master-0 kubenswrapper[8678]: I1204 00:45:51.521686 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:51.872947 master-0 kubenswrapper[8678]: I1204 00:45:51.872833 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:51.873418 master-0 kubenswrapper[8678]: I1204 00:45:51.873325 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-nh2ml" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="registry-server" containerID="cri-o://8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41" gracePeriod=2 Dec 04 00:45:52.326886 master-0 kubenswrapper[8678]: I1204 00:45:52.326837 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:52.336120 master-0 kubenswrapper[8678]: I1204 00:45:52.336081 8678 generic.go:334] "Generic (PLEG): container finished" podID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerID="8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41" exitCode=0 Dec 04 00:45:52.336610 master-0 kubenswrapper[8678]: I1204 00:45:52.336139 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerDied","Data":"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41"} Dec 04 00:45:52.336610 master-0 kubenswrapper[8678]: I1204 00:45:52.336186 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nh2ml" Dec 04 00:45:52.336610 master-0 kubenswrapper[8678]: I1204 00:45:52.336221 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nh2ml" event={"ID":"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f","Type":"ContainerDied","Data":"7a9fd92af0c16332dc19f09fbf4afd04dd2976dc0756cc11d07f972573f1e206"} Dec 04 00:45:52.336610 master-0 kubenswrapper[8678]: I1204 00:45:52.336255 8678 scope.go:117] "RemoveContainer" containerID="8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41" Dec 04 00:45:52.380635 master-0 kubenswrapper[8678]: I1204 00:45:52.380576 8678 scope.go:117] "RemoveContainer" containerID="8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4" Dec 04 00:45:52.405570 master-0 kubenswrapper[8678]: I1204 00:45:52.405514 8678 scope.go:117] "RemoveContainer" containerID="7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e" Dec 04 00:45:52.433876 master-0 kubenswrapper[8678]: I1204 00:45:52.433842 8678 scope.go:117] "RemoveContainer" containerID="8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41" Dec 04 00:45:52.434602 master-0 kubenswrapper[8678]: E1204 00:45:52.434553 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41\": container with ID starting with 8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41 not found: ID does not exist" containerID="8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41" Dec 04 00:45:52.434661 master-0 kubenswrapper[8678]: I1204 00:45:52.434609 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41"} err="failed to get container status \"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41\": rpc error: code = NotFound desc = could not find container \"8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41\": container with ID starting with 8d2007f85fdda06f0b30b1e61c2a7692b8ca69255623e7bfa26e1dcaa3d28b41 not found: ID does not exist" Dec 04 00:45:52.434661 master-0 kubenswrapper[8678]: I1204 00:45:52.434644 8678 scope.go:117] "RemoveContainer" containerID="8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4" Dec 04 00:45:52.435130 master-0 kubenswrapper[8678]: E1204 00:45:52.435094 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4\": container with ID starting with 8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4 not found: ID does not exist" containerID="8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4" Dec 04 00:45:52.435186 master-0 kubenswrapper[8678]: I1204 00:45:52.435129 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4"} err="failed to get container status \"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4\": rpc error: code = NotFound desc = could not find container \"8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4\": container with ID starting with 8b72ebaff70d693394746de139994face33f36152d0371ce5e1a3b87fc9796a4 not found: ID does not exist" Dec 04 00:45:52.435186 master-0 kubenswrapper[8678]: I1204 00:45:52.435147 8678 scope.go:117] "RemoveContainer" containerID="7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e" Dec 04 00:45:52.435613 master-0 kubenswrapper[8678]: E1204 00:45:52.435536 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e\": container with ID starting with 7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e not found: ID does not exist" containerID="7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e" Dec 04 00:45:52.435678 master-0 kubenswrapper[8678]: I1204 00:45:52.435624 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e"} err="failed to get container status \"7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e\": rpc error: code = NotFound desc = could not find container \"7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e\": container with ID starting with 7f59669b23d8ac3d513bb26fcf29dd1125814472eff3884649f17cc15353083e not found: ID does not exist" Dec 04 00:45:52.442343 master-0 kubenswrapper[8678]: I1204 00:45:52.442302 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbdhv\" (UniqueName: \"kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv\") pod \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " Dec 04 00:45:52.442508 master-0 kubenswrapper[8678]: I1204 00:45:52.442422 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities\") pod \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " Dec 04 00:45:52.442676 master-0 kubenswrapper[8678]: I1204 00:45:52.442527 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content\") pod \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\" (UID: \"97707d9a-e2ef-4c4e-9dbc-67b64a988e9f\") " Dec 04 00:45:52.443303 master-0 kubenswrapper[8678]: I1204 00:45:52.443250 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities" (OuterVolumeSpecName: "utilities") pod "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" (UID: "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:52.445907 master-0 kubenswrapper[8678]: I1204 00:45:52.445889 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv" (OuterVolumeSpecName: "kube-api-access-lbdhv") pod "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" (UID: "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f"). InnerVolumeSpecName "kube-api-access-lbdhv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:45:52.523494 master-0 kubenswrapper[8678]: I1204 00:45:52.523419 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:52.523494 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:52.523494 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:52.523494 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:52.523984 master-0 kubenswrapper[8678]: I1204 00:45:52.523505 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:52.544894 master-0 kubenswrapper[8678]: I1204 00:45:52.544718 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lbdhv\" (UniqueName: \"kubernetes.io/projected/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-kube-api-access-lbdhv\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:52.544894 master-0 kubenswrapper[8678]: I1204 00:45:52.544780 8678 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:52.578562 master-0 kubenswrapper[8678]: I1204 00:45:52.578451 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" (UID: "97707d9a-e2ef-4c4e-9dbc-67b64a988e9f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:45:52.646817 master-0 kubenswrapper[8678]: I1204 00:45:52.646740 8678 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:45:52.708159 master-0 kubenswrapper[8678]: I1204 00:45:52.708057 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:52.715383 master-0 kubenswrapper[8678]: I1204 00:45:52.715322 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-nh2ml"] Dec 04 00:45:52.862497 master-0 kubenswrapper[8678]: I1204 00:45:52.862389 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" path="/var/lib/kubelet/pods/97707d9a-e2ef-4c4e-9dbc-67b64a988e9f/volumes" Dec 04 00:45:53.524317 master-0 kubenswrapper[8678]: I1204 00:45:53.524245 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:53.524317 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:53.524317 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:53.524317 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:53.525481 master-0 kubenswrapper[8678]: I1204 00:45:53.524333 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:54.523040 master-0 kubenswrapper[8678]: I1204 00:45:54.522965 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:54.523040 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:54.523040 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:54.523040 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:54.523666 master-0 kubenswrapper[8678]: I1204 00:45:54.523620 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:55.523404 master-0 kubenswrapper[8678]: I1204 00:45:55.523335 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:55.523404 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:55.523404 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:55.523404 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:55.525478 master-0 kubenswrapper[8678]: I1204 00:45:55.523417 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:56.523400 master-0 kubenswrapper[8678]: I1204 00:45:56.523309 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:56.523400 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:56.523400 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:56.523400 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:56.524163 master-0 kubenswrapper[8678]: I1204 00:45:56.523408 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:56.852795 master-0 kubenswrapper[8678]: I1204 00:45:56.852730 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:45:56.853117 master-0 kubenswrapper[8678]: E1204 00:45:56.853044 8678 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-86897dd478-8zdrm_openshift-cluster-storage-operator(dc7bfc47-972c-4493-8372-f211c6645ff5)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" podUID="dc7bfc47-972c-4493-8372-f211c6645ff5" Dec 04 00:45:57.523334 master-0 kubenswrapper[8678]: I1204 00:45:57.523249 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:57.523334 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:57.523334 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:57.523334 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:57.524087 master-0 kubenswrapper[8678]: I1204 00:45:57.523357 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:58.522839 master-0 kubenswrapper[8678]: I1204 00:45:58.522753 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:58.522839 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:58.522839 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:58.522839 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:58.522839 master-0 kubenswrapper[8678]: I1204 00:45:58.522844 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:45:58.771520 master-0 kubenswrapper[8678]: I1204 00:45:58.771434 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:45:58.772505 master-0 kubenswrapper[8678]: I1204 00:45:58.771712 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/installer-2-master-0" podUID="13804bca-a33b-4517-ae8d-dfedee8dbd49" containerName="installer" containerID="cri-o://a10c30ea77e728a6ce0b426dc2060c5b670abc57ba283cb49abfbb016d339e4e" gracePeriod=30 Dec 04 00:45:59.523970 master-0 kubenswrapper[8678]: I1204 00:45:59.523847 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:45:59.523970 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:45:59.523970 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:45:59.523970 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:45:59.524494 master-0 kubenswrapper[8678]: I1204 00:45:59.523994 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:00.522312 master-0 kubenswrapper[8678]: I1204 00:46:00.522213 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:00.522312 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:00.522312 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:00.522312 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:00.523056 master-0 kubenswrapper[8678]: I1204 00:46:00.522321 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:01.523619 master-0 kubenswrapper[8678]: I1204 00:46:01.523543 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:01.523619 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:01.523619 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:01.523619 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:01.524241 master-0 kubenswrapper[8678]: I1204 00:46:01.523660 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:02.176453 master-0 kubenswrapper[8678]: I1204 00:46:02.176370 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 00:46:02.176716 master-0 kubenswrapper[8678]: E1204 00:46:02.176692 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="registry-server" Dec 04 00:46:02.176716 master-0 kubenswrapper[8678]: I1204 00:46:02.176710 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="registry-server" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: E1204 00:46:02.176730 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="extract-content" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: I1204 00:46:02.176739 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="extract-content" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: E1204 00:46:02.176754 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="extract-utilities" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: I1204 00:46:02.176763 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="extract-utilities" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: E1204 00:46:02.176778 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="registry-server" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: I1204 00:46:02.176785 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="registry-server" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: E1204 00:46:02.176804 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="extract-content" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: I1204 00:46:02.176811 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="extract-content" Dec 04 00:46:02.176812 master-0 kubenswrapper[8678]: E1204 00:46:02.176823 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="extract-content" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.176832 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="extract-content" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: E1204 00:46:02.176850 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.176859 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: E1204 00:46:02.176868 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="registry-server" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.176876 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="registry-server" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: E1204 00:46:02.176892 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="extract-utilities" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.176902 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="extract-utilities" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: E1204 00:46:02.176913 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="extract-utilities" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.176921 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="extract-utilities" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.177117 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="0bd9a2d6-b0d1-4ce5-b80f-fe7e3f5b1a13" containerName="registry-server" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.177141 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="97707d9a-e2ef-4c4e-9dbc-67b64a988e9f" containerName="registry-server" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.177162 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="20b72b56-e3de-447b-9f30-79e0295770da" containerName="registry-server" Dec 04 00:46:02.177369 master-0 kubenswrapper[8678]: I1204 00:46:02.177178 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:46:02.178105 master-0 kubenswrapper[8678]: I1204 00:46:02.177698 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.194310 master-0 kubenswrapper[8678]: I1204 00:46:02.194199 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 00:46:02.231185 master-0 kubenswrapper[8678]: I1204 00:46:02.231051 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.231185 master-0 kubenswrapper[8678]: I1204 00:46:02.231166 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.231595 master-0 kubenswrapper[8678]: I1204 00:46:02.231389 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.333536 master-0 kubenswrapper[8678]: I1204 00:46:02.333440 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.333808 master-0 kubenswrapper[8678]: I1204 00:46:02.333598 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.333808 master-0 kubenswrapper[8678]: I1204 00:46:02.333620 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.333808 master-0 kubenswrapper[8678]: I1204 00:46:02.333716 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.333808 master-0 kubenswrapper[8678]: I1204 00:46:02.333656 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.366125 master-0 kubenswrapper[8678]: I1204 00:46:02.366064 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.505046 master-0 kubenswrapper[8678]: I1204 00:46:02.504861 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:46:02.523565 master-0 kubenswrapper[8678]: I1204 00:46:02.523435 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:02.523565 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:02.523565 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:02.523565 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:02.524846 master-0 kubenswrapper[8678]: I1204 00:46:02.523607 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:02.524846 master-0 kubenswrapper[8678]: I1204 00:46:02.523703 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:46:02.525117 master-0 kubenswrapper[8678]: I1204 00:46:02.525048 8678 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="router" containerStatusID={"Type":"cri-o","ID":"8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f"} pod="openshift-ingress/router-default-54f97f57-x27s4" containerMessage="Container router failed startup probe, will be restarted" Dec 04 00:46:02.525327 master-0 kubenswrapper[8678]: I1204 00:46:02.525148 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" containerID="cri-o://8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f" gracePeriod=3600 Dec 04 00:46:02.991683 master-0 kubenswrapper[8678]: I1204 00:46:02.991586 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 00:46:02.998356 master-0 kubenswrapper[8678]: W1204 00:46:02.998276 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda37027d2_eeb1_416b_b67e_7ee233c42d04.slice/crio-360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b WatchSource:0}: Error finding container 360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b: Status 404 returned error can't find the container with id 360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b Dec 04 00:46:03.434291 master-0 kubenswrapper[8678]: I1204 00:46:03.434193 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"a37027d2-eeb1-416b-b67e-7ee233c42d04","Type":"ContainerStarted","Data":"360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b"} Dec 04 00:46:04.447237 master-0 kubenswrapper[8678]: I1204 00:46:04.447119 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"a37027d2-eeb1-416b-b67e-7ee233c42d04","Type":"ContainerStarted","Data":"03291911fb6f9dd6f3d49f195b4325b3023f0ac3bdc20d2e3a5c7c5ac9c1f3fd"} Dec 04 00:46:05.853039 master-0 kubenswrapper[8678]: I1204 00:46:05.852921 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:46:05.854697 master-0 kubenswrapper[8678]: I1204 00:46:05.854290 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:46:05.876539 master-0 kubenswrapper[8678]: I1204 00:46:05.876395 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-3-master-0" podStartSLOduration=3.876362658 podStartE2EDuration="3.876362658s" podCreationTimestamp="2025-12-04 00:46:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:46:04.493587779 +0000 UTC m=+947.820320375" watchObservedRunningTime="2025-12-04 00:46:05.876362658 +0000 UTC m=+949.203095254" Dec 04 00:46:05.884240 master-0 kubenswrapper[8678]: I1204 00:46:05.884140 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:46:05.884597 master-0 kubenswrapper[8678]: I1204 00:46:05.884552 8678 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-etcd/etcd-master-0" Dec 04 00:46:05.888536 master-0 kubenswrapper[8678]: I1204 00:46:05.888381 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:46:05.921295 master-0 kubenswrapper[8678]: I1204 00:46:05.921226 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 00:46:06.468257 master-0 kubenswrapper[8678]: I1204 00:46:06.468137 8678 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:46:06.468257 master-0 kubenswrapper[8678]: I1204 00:46:06.468195 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="693f7c69-cd80-43b4-95ee-51e2b032b8a3" Dec 04 00:46:06.890788 master-0 kubenswrapper[8678]: I1204 00:46:06.890714 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=1.890690312 podStartE2EDuration="1.890690312s" podCreationTimestamp="2025-12-04 00:46:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:46:06.886802429 +0000 UTC m=+950.213535075" watchObservedRunningTime="2025-12-04 00:46:06.890690312 +0000 UTC m=+950.217422878" Dec 04 00:46:10.850772 master-0 kubenswrapper[8678]: I1204 00:46:10.850666 8678 scope.go:117] "RemoveContainer" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" Dec 04 00:46:11.509237 master-0 kubenswrapper[8678]: I1204 00:46:11.509157 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/4.log" Dec 04 00:46:11.509609 master-0 kubenswrapper[8678]: I1204 00:46:11.509265 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" event={"ID":"dc7bfc47-972c-4493-8372-f211c6645ff5","Type":"ContainerStarted","Data":"178281e31904b4a8906fad83b88f6a5e3b5acdfd46b75316ad70502b056d6f76"} Dec 04 00:46:16.833036 master-0 kubenswrapper[8678]: I1204 00:46:16.832977 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-mm754"] Dec 04 00:46:16.833876 master-0 kubenswrapper[8678]: I1204 00:46:16.833860 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.835769 master-0 kubenswrapper[8678]: I1204 00:46:16.835723 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"default-dockercfg-pjtpn" Dec 04 00:46:16.839994 master-0 kubenswrapper[8678]: I1204 00:46:16.839915 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-sysctl-allowlist" Dec 04 00:46:16.879740 master-0 kubenswrapper[8678]: I1204 00:46:16.879688 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.879740 master-0 kubenswrapper[8678]: I1204 00:46:16.879744 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68w4s\" (UniqueName: \"kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.880013 master-0 kubenswrapper[8678]: I1204 00:46:16.879941 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.880216 master-0 kubenswrapper[8678]: I1204 00:46:16.880180 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981402 master-0 kubenswrapper[8678]: I1204 00:46:16.981336 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981631 master-0 kubenswrapper[8678]: I1204 00:46:16.981427 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981631 master-0 kubenswrapper[8678]: I1204 00:46:16.981482 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981631 master-0 kubenswrapper[8678]: I1204 00:46:16.981514 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68w4s\" (UniqueName: \"kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981631 master-0 kubenswrapper[8678]: I1204 00:46:16.981544 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.981956 master-0 kubenswrapper[8678]: I1204 00:46:16.981919 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:16.982531 master-0 kubenswrapper[8678]: I1204 00:46:16.982483 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:17.001836 master-0 kubenswrapper[8678]: I1204 00:46:17.001745 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68w4s\" (UniqueName: \"kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s\") pod \"cni-sysctl-allowlist-ds-mm754\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:17.152247 master-0 kubenswrapper[8678]: I1204 00:46:17.152168 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:17.178049 master-0 kubenswrapper[8678]: W1204 00:46:17.177971 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209dd49e_188c_4bb6_9a8c_7225a41213ff.slice/crio-c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b WatchSource:0}: Error finding container c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b: Status 404 returned error can't find the container with id c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b Dec 04 00:46:17.561431 master-0 kubenswrapper[8678]: I1204 00:46:17.561367 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" event={"ID":"209dd49e-188c-4bb6-9a8c-7225a41213ff","Type":"ContainerStarted","Data":"c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b"} Dec 04 00:46:17.564084 master-0 kubenswrapper[8678]: I1204 00:46:17.564049 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-2-master-0_13804bca-a33b-4517-ae8d-dfedee8dbd49/installer/0.log" Dec 04 00:46:17.564170 master-0 kubenswrapper[8678]: I1204 00:46:17.564102 8678 generic.go:334] "Generic (PLEG): container finished" podID="13804bca-a33b-4517-ae8d-dfedee8dbd49" containerID="a10c30ea77e728a6ce0b426dc2060c5b670abc57ba283cb49abfbb016d339e4e" exitCode=1 Dec 04 00:46:17.564170 master-0 kubenswrapper[8678]: I1204 00:46:17.564132 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"13804bca-a33b-4517-ae8d-dfedee8dbd49","Type":"ContainerDied","Data":"a10c30ea77e728a6ce0b426dc2060c5b670abc57ba283cb49abfbb016d339e4e"} Dec 04 00:46:17.809601 master-0 kubenswrapper[8678]: I1204 00:46:17.809538 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-2-master-0_13804bca-a33b-4517-ae8d-dfedee8dbd49/installer/0.log" Dec 04 00:46:17.809841 master-0 kubenswrapper[8678]: I1204 00:46:17.809643 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:46:17.902319 master-0 kubenswrapper[8678]: I1204 00:46:17.902217 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir\") pod \"13804bca-a33b-4517-ae8d-dfedee8dbd49\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.902386 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock\") pod \"13804bca-a33b-4517-ae8d-dfedee8dbd49\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.902392 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "13804bca-a33b-4517-ae8d-dfedee8dbd49" (UID: "13804bca-a33b-4517-ae8d-dfedee8dbd49"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.902531 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock" (OuterVolumeSpecName: "var-lock") pod "13804bca-a33b-4517-ae8d-dfedee8dbd49" (UID: "13804bca-a33b-4517-ae8d-dfedee8dbd49"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.902594 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access\") pod \"13804bca-a33b-4517-ae8d-dfedee8dbd49\" (UID: \"13804bca-a33b-4517-ae8d-dfedee8dbd49\") " Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.903020 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:17.903062 master-0 kubenswrapper[8678]: I1204 00:46:17.903049 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/13804bca-a33b-4517-ae8d-dfedee8dbd49-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:17.906156 master-0 kubenswrapper[8678]: I1204 00:46:17.905670 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "13804bca-a33b-4517-ae8d-dfedee8dbd49" (UID: "13804bca-a33b-4517-ae8d-dfedee8dbd49"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:46:18.004914 master-0 kubenswrapper[8678]: I1204 00:46:18.004802 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/13804bca-a33b-4517-ae8d-dfedee8dbd49-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:18.575658 master-0 kubenswrapper[8678]: I1204 00:46:18.575491 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" event={"ID":"209dd49e-188c-4bb6-9a8c-7225a41213ff","Type":"ContainerStarted","Data":"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2"} Dec 04 00:46:18.575658 master-0 kubenswrapper[8678]: I1204 00:46:18.575678 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:18.578206 master-0 kubenswrapper[8678]: I1204 00:46:18.578134 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-2-master-0_13804bca-a33b-4517-ae8d-dfedee8dbd49/installer/0.log" Dec 04 00:46:18.578386 master-0 kubenswrapper[8678]: I1204 00:46:18.578234 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"13804bca-a33b-4517-ae8d-dfedee8dbd49","Type":"ContainerDied","Data":"df037a350007e31122fa96bb68342bb9838c3581e30daa0d1d12b775b6483e82"} Dec 04 00:46:18.578386 master-0 kubenswrapper[8678]: I1204 00:46:18.578288 8678 scope.go:117] "RemoveContainer" containerID="a10c30ea77e728a6ce0b426dc2060c5b670abc57ba283cb49abfbb016d339e4e" Dec 04 00:46:18.578386 master-0 kubenswrapper[8678]: I1204 00:46:18.578328 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 00:46:18.601191 master-0 kubenswrapper[8678]: I1204 00:46:18.601080 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" podStartSLOduration=2.601061529 podStartE2EDuration="2.601061529s" podCreationTimestamp="2025-12-04 00:46:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:46:18.598107934 +0000 UTC m=+961.924840560" watchObservedRunningTime="2025-12-04 00:46:18.601061529 +0000 UTC m=+961.927794095" Dec 04 00:46:18.615909 master-0 kubenswrapper[8678]: I1204 00:46:18.615792 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:18.638884 master-0 kubenswrapper[8678]: I1204 00:46:18.638751 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:46:18.646513 master-0 kubenswrapper[8678]: I1204 00:46:18.646422 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 00:46:18.773852 master-0 kubenswrapper[8678]: I1204 00:46:18.773761 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-mm754"] Dec 04 00:46:18.863543 master-0 kubenswrapper[8678]: I1204 00:46:18.863415 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13804bca-a33b-4517-ae8d-dfedee8dbd49" path="/var/lib/kubelet/pods/13804bca-a33b-4517-ae8d-dfedee8dbd49/volumes" Dec 04 00:46:20.596237 master-0 kubenswrapper[8678]: I1204 00:46:20.596108 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" gracePeriod=30 Dec 04 00:46:26.557541 master-0 kubenswrapper[8678]: I1204 00:46:26.557448 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-5bdcc987c4-s85ld"] Dec 04 00:46:26.558247 master-0 kubenswrapper[8678]: E1204 00:46:26.557788 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13804bca-a33b-4517-ae8d-dfedee8dbd49" containerName="installer" Dec 04 00:46:26.558247 master-0 kubenswrapper[8678]: I1204 00:46:26.557804 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="13804bca-a33b-4517-ae8d-dfedee8dbd49" containerName="installer" Dec 04 00:46:26.558247 master-0 kubenswrapper[8678]: I1204 00:46:26.557976 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="13804bca-a33b-4517-ae8d-dfedee8dbd49" containerName="installer" Dec 04 00:46:26.558839 master-0 kubenswrapper[8678]: I1204 00:46:26.558788 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.561660 master-0 kubenswrapper[8678]: I1204 00:46:26.561597 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-sk926" Dec 04 00:46:26.578610 master-0 kubenswrapper[8678]: I1204 00:46:26.578514 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-5bdcc987c4-s85ld"] Dec 04 00:46:26.652350 master-0 kubenswrapper[8678]: I1204 00:46:26.652293 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jms7r\" (UniqueName: \"kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.652350 master-0 kubenswrapper[8678]: I1204 00:46:26.652336 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.753325 master-0 kubenswrapper[8678]: I1204 00:46:26.753248 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jms7r\" (UniqueName: \"kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.753325 master-0 kubenswrapper[8678]: I1204 00:46:26.753311 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.756586 master-0 kubenswrapper[8678]: I1204 00:46:26.756543 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.775699 master-0 kubenswrapper[8678]: I1204 00:46:26.775655 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jms7r\" (UniqueName: \"kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:26.901353 master-0 kubenswrapper[8678]: I1204 00:46:26.901291 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:46:27.156851 master-0 kubenswrapper[8678]: E1204 00:46:27.156645 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:27.159203 master-0 kubenswrapper[8678]: E1204 00:46:27.159150 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:27.160745 master-0 kubenswrapper[8678]: E1204 00:46:27.160640 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:27.160846 master-0 kubenswrapper[8678]: E1204 00:46:27.160749 8678 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:46:27.326031 master-0 kubenswrapper[8678]: I1204 00:46:27.325871 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-5bdcc987c4-s85ld"] Dec 04 00:46:27.332815 master-0 kubenswrapper[8678]: W1204 00:46:27.332723 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20835c26_301c_423e_b534_ec2a5e5af953.slice/crio-0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b WatchSource:0}: Error finding container 0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b: Status 404 returned error can't find the container with id 0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b Dec 04 00:46:27.649621 master-0 kubenswrapper[8678]: I1204 00:46:27.649522 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" event={"ID":"20835c26-301c-423e-b534-ec2a5e5af953","Type":"ContainerStarted","Data":"898b4342720893493baeb850d9b848f93c3c01be92e9a59712c593506f6476a9"} Dec 04 00:46:27.649621 master-0 kubenswrapper[8678]: I1204 00:46:27.649593 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" event={"ID":"20835c26-301c-423e-b534-ec2a5e5af953","Type":"ContainerStarted","Data":"0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b"} Dec 04 00:46:28.666122 master-0 kubenswrapper[8678]: I1204 00:46:28.666035 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" event={"ID":"20835c26-301c-423e-b534-ec2a5e5af953","Type":"ContainerStarted","Data":"e7e87ab50dd3901e9b70c59bb3239c4f7276a1afcb15e08b3051704fa8a958a1"} Dec 04 00:46:28.689897 master-0 kubenswrapper[8678]: I1204 00:46:28.689801 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" podStartSLOduration=2.689769658 podStartE2EDuration="2.689769658s" podCreationTimestamp="2025-12-04 00:46:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:46:28.686593056 +0000 UTC m=+972.013325672" watchObservedRunningTime="2025-12-04 00:46:28.689769658 +0000 UTC m=+972.016502244" Dec 04 00:46:28.733118 master-0 kubenswrapper[8678]: I1204 00:46:28.732998 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:46:28.733503 master-0 kubenswrapper[8678]: I1204 00:46:28.733447 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="multus-admission-controller" containerID="cri-o://f5fd45065f6028b9bd37b848d95f0635563ba5e83e0c91f9cb776f679ba44b4b" gracePeriod=30 Dec 04 00:46:28.733663 master-0 kubenswrapper[8678]: I1204 00:46:28.733581 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="kube-rbac-proxy" containerID="cri-o://d62bd69369e5368a4619ac055f16012c8f68ba6882c98f721292b2e4eeb9e3e0" gracePeriod=30 Dec 04 00:46:29.699511 master-0 kubenswrapper[8678]: I1204 00:46:29.699434 8678 generic.go:334] "Generic (PLEG): container finished" podID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerID="d62bd69369e5368a4619ac055f16012c8f68ba6882c98f721292b2e4eeb9e3e0" exitCode=0 Dec 04 00:46:29.700072 master-0 kubenswrapper[8678]: I1204 00:46:29.699512 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerDied","Data":"d62bd69369e5368a4619ac055f16012c8f68ba6882c98f721292b2e4eeb9e3e0"} Dec 04 00:46:37.156855 master-0 kubenswrapper[8678]: E1204 00:46:37.156706 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:37.159921 master-0 kubenswrapper[8678]: E1204 00:46:37.159836 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:37.162519 master-0 kubenswrapper[8678]: E1204 00:46:37.162454 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:37.162592 master-0 kubenswrapper[8678]: E1204 00:46:37.162527 8678 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:46:43.584401 master-0 kubenswrapper[8678]: I1204 00:46:43.584261 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 00:46:43.585317 master-0 kubenswrapper[8678]: I1204 00:46:43.585284 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.588333 master-0 kubenswrapper[8678]: I1204 00:46:43.588279 8678 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-xwbnk" Dec 04 00:46:43.589022 master-0 kubenswrapper[8678]: I1204 00:46:43.588991 8678 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 00:46:43.598818 master-0 kubenswrapper[8678]: I1204 00:46:43.598719 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 00:46:43.622326 master-0 kubenswrapper[8678]: I1204 00:46:43.622270 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.622558 master-0 kubenswrapper[8678]: I1204 00:46:43.622542 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.622635 master-0 kubenswrapper[8678]: I1204 00:46:43.622623 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.724664 master-0 kubenswrapper[8678]: I1204 00:46:43.724604 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.724664 master-0 kubenswrapper[8678]: I1204 00:46:43.724651 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.724664 master-0 kubenswrapper[8678]: I1204 00:46:43.724687 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.725159 master-0 kubenswrapper[8678]: I1204 00:46:43.724789 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.725159 master-0 kubenswrapper[8678]: I1204 00:46:43.724846 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.740505 master-0 kubenswrapper[8678]: I1204 00:46:43.740475 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:43.906697 master-0 kubenswrapper[8678]: I1204 00:46:43.906594 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:46:44.365245 master-0 kubenswrapper[8678]: I1204 00:46:44.365171 8678 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 00:46:44.372204 master-0 kubenswrapper[8678]: W1204 00:46:44.372130 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb95b14d5_c3da_4aa7_9574_5cafff04192a.slice/crio-bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd WatchSource:0}: Error finding container bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd: Status 404 returned error can't find the container with id bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd Dec 04 00:46:44.840996 master-0 kubenswrapper[8678]: I1204 00:46:44.840877 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"b95b14d5-c3da-4aa7-9574-5cafff04192a","Type":"ContainerStarted","Data":"2cb11c1b461354eecb97801e0c4dd71a6f034656001e21b3f9f5eedfbcec7e60"} Dec 04 00:46:44.840996 master-0 kubenswrapper[8678]: I1204 00:46:44.840972 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"b95b14d5-c3da-4aa7-9574-5cafff04192a","Type":"ContainerStarted","Data":"bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd"} Dec 04 00:46:44.942577 master-0 kubenswrapper[8678]: I1204 00:46:44.942352 8678 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-3-master-0" podStartSLOduration=1.9423054610000001 podStartE2EDuration="1.942305461s" podCreationTimestamp="2025-12-04 00:46:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:46:44.941676023 +0000 UTC m=+988.268408629" watchObservedRunningTime="2025-12-04 00:46:44.942305461 +0000 UTC m=+988.269038017" Dec 04 00:46:47.156157 master-0 kubenswrapper[8678]: E1204 00:46:47.156063 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:47.160174 master-0 kubenswrapper[8678]: E1204 00:46:47.160080 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:47.163899 master-0 kubenswrapper[8678]: E1204 00:46:47.163772 8678 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" cmd=["/bin/bash","-c","test -f /ready/ready"] Dec 04 00:46:47.164050 master-0 kubenswrapper[8678]: E1204 00:46:47.163945 8678 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:46:48.876501 master-0 kubenswrapper[8678]: I1204 00:46:48.876415 8678 generic.go:334] "Generic (PLEG): container finished" podID="83e0d056-186c-4067-b586-14fe2970fcc0" containerID="8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f" exitCode=0 Dec 04 00:46:48.877385 master-0 kubenswrapper[8678]: I1204 00:46:48.876505 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerDied","Data":"8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f"} Dec 04 00:46:48.877385 master-0 kubenswrapper[8678]: I1204 00:46:48.876582 8678 scope.go:117] "RemoveContainer" containerID="47057a1d8a7d09b2dd4333784cfa0bd42c711a49196a82222315438202103d7f" Dec 04 00:46:49.887314 master-0 kubenswrapper[8678]: I1204 00:46:49.887213 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f97f57-x27s4" event={"ID":"83e0d056-186c-4067-b586-14fe2970fcc0","Type":"ContainerStarted","Data":"302ad2b3a07324922973f44e07963264ad41056d3ba3748f59060c569ce39771"} Dec 04 00:46:50.520620 master-0 kubenswrapper[8678]: I1204 00:46:50.520533 8678 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:46:50.520620 master-0 kubenswrapper[8678]: I1204 00:46:50.520624 8678 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:46:50.525188 master-0 kubenswrapper[8678]: I1204 00:46:50.525133 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:50.525188 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:50.525188 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:50.525188 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:50.525761 master-0 kubenswrapper[8678]: I1204 00:46:50.525706 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:50.744986 master-0 kubenswrapper[8678]: I1204 00:46:50.744852 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-mm754_209dd49e-188c-4bb6-9a8c-7225a41213ff/kube-multus-additional-cni-plugins/0.log" Dec 04 00:46:50.745391 master-0 kubenswrapper[8678]: I1204 00:46:50.745363 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:50.851701 master-0 kubenswrapper[8678]: I1204 00:46:50.851641 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir\") pod \"209dd49e-188c-4bb6-9a8c-7225a41213ff\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " Dec 04 00:46:50.852243 master-0 kubenswrapper[8678]: I1204 00:46:50.851865 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "209dd49e-188c-4bb6-9a8c-7225a41213ff" (UID: "209dd49e-188c-4bb6-9a8c-7225a41213ff"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:46:50.852243 master-0 kubenswrapper[8678]: I1204 00:46:50.852179 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready\") pod \"209dd49e-188c-4bb6-9a8c-7225a41213ff\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " Dec 04 00:46:50.852415 master-0 kubenswrapper[8678]: I1204 00:46:50.852392 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist\") pod \"209dd49e-188c-4bb6-9a8c-7225a41213ff\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " Dec 04 00:46:50.852563 master-0 kubenswrapper[8678]: I1204 00:46:50.852510 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68w4s\" (UniqueName: \"kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s\") pod \"209dd49e-188c-4bb6-9a8c-7225a41213ff\" (UID: \"209dd49e-188c-4bb6-9a8c-7225a41213ff\") " Dec 04 00:46:50.853224 master-0 kubenswrapper[8678]: I1204 00:46:50.853187 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready" (OuterVolumeSpecName: "ready") pod "209dd49e-188c-4bb6-9a8c-7225a41213ff" (UID: "209dd49e-188c-4bb6-9a8c-7225a41213ff"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:46:50.853409 master-0 kubenswrapper[8678]: I1204 00:46:50.853340 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "209dd49e-188c-4bb6-9a8c-7225a41213ff" (UID: "209dd49e-188c-4bb6-9a8c-7225a41213ff"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:46:50.853510 master-0 kubenswrapper[8678]: I1204 00:46:50.853255 8678 reconciler_common.go:293] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/209dd49e-188c-4bb6-9a8c-7225a41213ff-tuning-conf-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:50.856726 master-0 kubenswrapper[8678]: I1204 00:46:50.856578 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s" (OuterVolumeSpecName: "kube-api-access-68w4s") pod "209dd49e-188c-4bb6-9a8c-7225a41213ff" (UID: "209dd49e-188c-4bb6-9a8c-7225a41213ff"). InnerVolumeSpecName "kube-api-access-68w4s". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:46:50.900276 master-0 kubenswrapper[8678]: I1204 00:46:50.900218 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-mm754_209dd49e-188c-4bb6-9a8c-7225a41213ff/kube-multus-additional-cni-plugins/0.log" Dec 04 00:46:50.900849 master-0 kubenswrapper[8678]: I1204 00:46:50.900283 8678 generic.go:334] "Generic (PLEG): container finished" podID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" exitCode=137 Dec 04 00:46:50.900914 master-0 kubenswrapper[8678]: I1204 00:46:50.900871 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" Dec 04 00:46:50.901112 master-0 kubenswrapper[8678]: I1204 00:46:50.901052 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" event={"ID":"209dd49e-188c-4bb6-9a8c-7225a41213ff","Type":"ContainerDied","Data":"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2"} Dec 04 00:46:50.901442 master-0 kubenswrapper[8678]: I1204 00:46:50.901414 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-mm754" event={"ID":"209dd49e-188c-4bb6-9a8c-7225a41213ff","Type":"ContainerDied","Data":"c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b"} Dec 04 00:46:50.901602 master-0 kubenswrapper[8678]: I1204 00:46:50.901541 8678 scope.go:117] "RemoveContainer" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" Dec 04 00:46:50.931526 master-0 kubenswrapper[8678]: I1204 00:46:50.931455 8678 scope.go:117] "RemoveContainer" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" Dec 04 00:46:50.932986 master-0 kubenswrapper[8678]: E1204 00:46:50.932069 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2\": container with ID starting with d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2 not found: ID does not exist" containerID="d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2" Dec 04 00:46:50.932986 master-0 kubenswrapper[8678]: I1204 00:46:50.932119 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2"} err="failed to get container status \"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2\": rpc error: code = NotFound desc = could not find container \"d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2\": container with ID starting with d978278605b943f264c155a8d1ed606b1a808543773489f9893b6fac73563cf2 not found: ID does not exist" Dec 04 00:46:50.939964 master-0 kubenswrapper[8678]: I1204 00:46:50.939889 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-mm754"] Dec 04 00:46:50.945093 master-0 kubenswrapper[8678]: I1204 00:46:50.945039 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-mm754"] Dec 04 00:46:50.954656 master-0 kubenswrapper[8678]: I1204 00:46:50.954603 8678 reconciler_common.go:293] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/209dd49e-188c-4bb6-9a8c-7225a41213ff-cni-sysctl-allowlist\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:50.954656 master-0 kubenswrapper[8678]: I1204 00:46:50.954633 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68w4s\" (UniqueName: \"kubernetes.io/projected/209dd49e-188c-4bb6-9a8c-7225a41213ff-kube-api-access-68w4s\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:50.954656 master-0 kubenswrapper[8678]: I1204 00:46:50.954647 8678 reconciler_common.go:293] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/209dd49e-188c-4bb6-9a8c-7225a41213ff-ready\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:51.525176 master-0 kubenswrapper[8678]: I1204 00:46:51.525051 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:51.525176 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:51.525176 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:51.525176 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:51.525176 master-0 kubenswrapper[8678]: I1204 00:46:51.525133 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:52.522957 master-0 kubenswrapper[8678]: I1204 00:46:52.522858 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:52.522957 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:52.522957 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:52.522957 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:52.524032 master-0 kubenswrapper[8678]: I1204 00:46:52.523012 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:52.865733 master-0 kubenswrapper[8678]: I1204 00:46:52.865600 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" path="/var/lib/kubelet/pods/209dd49e-188c-4bb6-9a8c-7225a41213ff/volumes" Dec 04 00:46:53.523384 master-0 kubenswrapper[8678]: I1204 00:46:53.523332 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:53.523384 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:53.523384 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:53.523384 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:53.524236 master-0 kubenswrapper[8678]: I1204 00:46:53.524155 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:54.522624 master-0 kubenswrapper[8678]: I1204 00:46:54.522551 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:54.522624 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:54.522624 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:54.522624 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:54.523166 master-0 kubenswrapper[8678]: I1204 00:46:54.522642 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:55.522858 master-0 kubenswrapper[8678]: I1204 00:46:55.522786 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:55.522858 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:55.522858 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:55.522858 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:55.523990 master-0 kubenswrapper[8678]: I1204 00:46:55.522860 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:56.523308 master-0 kubenswrapper[8678]: I1204 00:46:56.523225 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:56.523308 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:56.523308 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:56.523308 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:56.524357 master-0 kubenswrapper[8678]: I1204 00:46:56.523354 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:57.522891 master-0 kubenswrapper[8678]: I1204 00:46:57.522806 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:57.522891 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:57.522891 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:57.522891 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:57.523374 master-0 kubenswrapper[8678]: I1204 00:46:57.522894 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:58.523561 master-0 kubenswrapper[8678]: I1204 00:46:58.523444 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:58.523561 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:58.523561 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:58.523561 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:58.524608 master-0 kubenswrapper[8678]: I1204 00:46:58.523572 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:58.983083 master-0 kubenswrapper[8678]: I1204 00:46:58.982917 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-78ddcf56f9-x5jff_b57073bf-c556-4ac2-a0a5-522e4360d493/multus-admission-controller/0.log" Dec 04 00:46:58.983083 master-0 kubenswrapper[8678]: I1204 00:46:58.982998 8678 generic.go:334] "Generic (PLEG): container finished" podID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerID="f5fd45065f6028b9bd37b848d95f0635563ba5e83e0c91f9cb776f679ba44b4b" exitCode=137 Dec 04 00:46:58.983083 master-0 kubenswrapper[8678]: I1204 00:46:58.983037 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerDied","Data":"f5fd45065f6028b9bd37b848d95f0635563ba5e83e0c91f9cb776f679ba44b4b"} Dec 04 00:46:59.158776 master-0 kubenswrapper[8678]: I1204 00:46:59.158700 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-78ddcf56f9-x5jff_b57073bf-c556-4ac2-a0a5-522e4360d493/multus-admission-controller/0.log" Dec 04 00:46:59.159300 master-0 kubenswrapper[8678]: I1204 00:46:59.158815 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:46:59.200401 master-0 kubenswrapper[8678]: I1204 00:46:59.200290 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") pod \"b57073bf-c556-4ac2-a0a5-522e4360d493\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " Dec 04 00:46:59.200636 master-0 kubenswrapper[8678]: I1204 00:46:59.200528 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") pod \"b57073bf-c556-4ac2-a0a5-522e4360d493\" (UID: \"b57073bf-c556-4ac2-a0a5-522e4360d493\") " Dec 04 00:46:59.204074 master-0 kubenswrapper[8678]: I1204 00:46:59.204010 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7" (OuterVolumeSpecName: "kube-api-access-69lk7") pod "b57073bf-c556-4ac2-a0a5-522e4360d493" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493"). InnerVolumeSpecName "kube-api-access-69lk7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:46:59.206691 master-0 kubenswrapper[8678]: I1204 00:46:59.206615 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "b57073bf-c556-4ac2-a0a5-522e4360d493" (UID: "b57073bf-c556-4ac2-a0a5-522e4360d493"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:46:59.302142 master-0 kubenswrapper[8678]: I1204 00:46:59.302030 8678 reconciler_common.go:293] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/b57073bf-c556-4ac2-a0a5-522e4360d493-webhook-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:59.302142 master-0 kubenswrapper[8678]: I1204 00:46:59.302086 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-69lk7\" (UniqueName: \"kubernetes.io/projected/b57073bf-c556-4ac2-a0a5-522e4360d493-kube-api-access-69lk7\") on node \"master-0\" DevicePath \"\"" Dec 04 00:46:59.523392 master-0 kubenswrapper[8678]: I1204 00:46:59.523204 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:46:59.523392 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:46:59.523392 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:46:59.523392 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:46:59.523392 master-0 kubenswrapper[8678]: I1204 00:46:59.523292 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:46:59.995416 master-0 kubenswrapper[8678]: I1204 00:46:59.995352 8678 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-78ddcf56f9-x5jff_b57073bf-c556-4ac2-a0a5-522e4360d493/multus-admission-controller/0.log" Dec 04 00:46:59.995758 master-0 kubenswrapper[8678]: I1204 00:46:59.995465 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" event={"ID":"b57073bf-c556-4ac2-a0a5-522e4360d493","Type":"ContainerDied","Data":"e4b83ab4443aa0c31704f38f77c4aaefe8bb38a88f809f9098c0a8032fdc6bbc"} Dec 04 00:46:59.995758 master-0 kubenswrapper[8678]: I1204 00:46:59.995533 8678 scope.go:117] "RemoveContainer" containerID="d62bd69369e5368a4619ac055f16012c8f68ba6882c98f721292b2e4eeb9e3e0" Dec 04 00:46:59.995758 master-0 kubenswrapper[8678]: I1204 00:46:59.995605 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-78ddcf56f9-x5jff" Dec 04 00:47:00.017476 master-0 kubenswrapper[8678]: I1204 00:47:00.017414 8678 scope.go:117] "RemoveContainer" containerID="f5fd45065f6028b9bd37b848d95f0635563ba5e83e0c91f9cb776f679ba44b4b" Dec 04 00:47:00.049999 master-0 kubenswrapper[8678]: I1204 00:47:00.049913 8678 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:47:00.057501 master-0 kubenswrapper[8678]: I1204 00:47:00.057417 8678 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-multus/multus-admission-controller-78ddcf56f9-x5jff"] Dec 04 00:47:00.100496 master-0 kubenswrapper[8678]: E1204 00:47:00.100395 8678 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57073bf_c556_4ac2_a0a5_522e4360d493.slice/crio-e4b83ab4443aa0c31704f38f77c4aaefe8bb38a88f809f9098c0a8032fdc6bbc\": RecentStats: unable to find data in memory cache]" Dec 04 00:47:00.523483 master-0 kubenswrapper[8678]: I1204 00:47:00.523393 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:00.523483 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:00.523483 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:00.523483 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:00.524610 master-0 kubenswrapper[8678]: I1204 00:47:00.523493 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:00.867976 master-0 kubenswrapper[8678]: I1204 00:47:00.867878 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" path="/var/lib/kubelet/pods/b57073bf-c556-4ac2-a0a5-522e4360d493/volumes" Dec 04 00:47:01.484592 master-0 kubenswrapper[8678]: I1204 00:47:01.484499 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:47:01.485120 master-0 kubenswrapper[8678]: E1204 00:47:01.485060 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="multus-admission-controller" Dec 04 00:47:01.485120 master-0 kubenswrapper[8678]: I1204 00:47:01.485101 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="multus-admission-controller" Dec 04 00:47:01.485379 master-0 kubenswrapper[8678]: E1204 00:47:01.485158 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:47:01.485379 master-0 kubenswrapper[8678]: I1204 00:47:01.485175 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:47:01.485379 master-0 kubenswrapper[8678]: E1204 00:47:01.485215 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="kube-rbac-proxy" Dec 04 00:47:01.485379 master-0 kubenswrapper[8678]: I1204 00:47:01.485231 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="kube-rbac-proxy" Dec 04 00:47:01.485732 master-0 kubenswrapper[8678]: I1204 00:47:01.485506 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="multus-admission-controller" Dec 04 00:47:01.485732 master-0 kubenswrapper[8678]: I1204 00:47:01.485613 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="b57073bf-c556-4ac2-a0a5-522e4360d493" containerName="kube-rbac-proxy" Dec 04 00:47:01.485732 master-0 kubenswrapper[8678]: I1204 00:47:01.485666 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="209dd49e-188c-4bb6-9a8c-7225a41213ff" containerName="kube-multus-additional-cni-plugins" Dec 04 00:47:01.486560 master-0 kubenswrapper[8678]: I1204 00:47:01.486502 8678 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 00:47:01.486759 master-0 kubenswrapper[8678]: I1204 00:47:01.486690 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.487076 master-0 kubenswrapper[8678]: I1204 00:47:01.487008 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver" containerID="cri-o://a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b" gracePeriod=15 Dec 04 00:47:01.489487 master-0 kubenswrapper[8678]: I1204 00:47:01.487189 8678 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be" gracePeriod=15 Dec 04 00:47:01.489487 master-0 kubenswrapper[8678]: I1204 00:47:01.488188 8678 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:47:01.489487 master-0 kubenswrapper[8678]: E1204 00:47:01.489306 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13238af3704fe583f617f61e755cf4c2" containerName="setup" Dec 04 00:47:01.489487 master-0 kubenswrapper[8678]: I1204 00:47:01.489350 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="13238af3704fe583f617f61e755cf4c2" containerName="setup" Dec 04 00:47:01.489487 master-0 kubenswrapper[8678]: E1204 00:47:01.489448 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver" Dec 04 00:47:01.490203 master-0 kubenswrapper[8678]: I1204 00:47:01.489520 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver" Dec 04 00:47:01.490203 master-0 kubenswrapper[8678]: E1204 00:47:01.489626 8678 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver-insecure-readyz" Dec 04 00:47:01.490203 master-0 kubenswrapper[8678]: I1204 00:47:01.489651 8678 state_mem.go:107] "Deleted CPUSet assignment" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver-insecure-readyz" Dec 04 00:47:01.490666 master-0 kubenswrapper[8678]: I1204 00:47:01.490444 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver-insecure-readyz" Dec 04 00:47:01.491007 master-0 kubenswrapper[8678]: I1204 00:47:01.490750 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="13238af3704fe583f617f61e755cf4c2" containerName="setup" Dec 04 00:47:01.491007 master-0 kubenswrapper[8678]: I1204 00:47:01.490982 8678 memory_manager.go:354] "RemoveStaleState removing state" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver" Dec 04 00:47:01.495797 master-0 kubenswrapper[8678]: I1204 00:47:01.495720 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.524072 master-0 kubenswrapper[8678]: I1204 00:47:01.524002 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:01.524072 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:01.524072 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:01.524072 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:01.524697 master-0 kubenswrapper[8678]: I1204 00:47:01.524087 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:01.551694 master-0 kubenswrapper[8678]: I1204 00:47:01.551599 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.551721 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.551791 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.551833 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.552201 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.552341 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.552467 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.552570 8678 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: E1204 00:47:01.553657 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.556836 master-0 kubenswrapper[8678]: I1204 00:47:01.555450 8678 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:47:01.653989 master-0 kubenswrapper[8678]: I1204 00:47:01.653832 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.653989 master-0 kubenswrapper[8678]: I1204 00:47:01.654010 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654028 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654085 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654144 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654190 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654421 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654558 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654623 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654689 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654702 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654627 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.654915 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.654920 master-0 kubenswrapper[8678]: I1204 00:47:01.655023 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.657050 master-0 kubenswrapper[8678]: I1204 00:47:01.655106 8678 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.657050 master-0 kubenswrapper[8678]: I1204 00:47:01.655204 8678 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.846199 master-0 kubenswrapper[8678]: I1204 00:47:01.846138 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:01.855206 master-0 kubenswrapper[8678]: I1204 00:47:01.855158 8678 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:01.899594 master-0 kubenswrapper[8678]: W1204 00:47:01.899500 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbad610cd8689b0972c02840bb486a62.slice/crio-3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf WatchSource:0}: Error finding container 3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf: Status 404 returned error can't find the container with id 3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf Dec 04 00:47:01.903398 master-0 kubenswrapper[8678]: W1204 00:47:01.903269 8678 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382c2026eb84cf3d7672e1fe1646be64.slice/crio-4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599 WatchSource:0}: Error finding container 4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599: Status 404 returned error can't find the container with id 4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599 Dec 04 00:47:01.905826 master-0 kubenswrapper[8678]: E1204 00:47:01.905638 8678 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187ddca30fe44c42 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:cbad610cd8689b0972c02840bb486a62,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:47:01.903502402 +0000 UTC m=+1005.230234988,LastTimestamp:2025-12-04 00:47:01.903502402 +0000 UTC m=+1005.230234988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:47:02.016382 master-0 kubenswrapper[8678]: I1204 00:47:02.016312 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599"} Dec 04 00:47:02.018421 master-0 kubenswrapper[8678]: I1204 00:47:02.018376 8678 generic.go:334] "Generic (PLEG): container finished" podID="13238af3704fe583f617f61e755cf4c2" containerID="155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be" exitCode=0 Dec 04 00:47:02.019873 master-0 kubenswrapper[8678]: I1204 00:47:02.019808 8678 generic.go:334] "Generic (PLEG): container finished" podID="a37027d2-eeb1-416b-b67e-7ee233c42d04" containerID="03291911fb6f9dd6f3d49f195b4325b3023f0ac3bdc20d2e3a5c7c5ac9c1f3fd" exitCode=0 Dec 04 00:47:02.019961 master-0 kubenswrapper[8678]: I1204 00:47:02.019874 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"a37027d2-eeb1-416b-b67e-7ee233c42d04","Type":"ContainerDied","Data":"03291911fb6f9dd6f3d49f195b4325b3023f0ac3bdc20d2e3a5c7c5ac9c1f3fd"} Dec 04 00:47:02.021173 master-0 kubenswrapper[8678]: I1204 00:47:02.021117 8678 status_manager.go:851] "Failed to get status for pod" podUID="cbad610cd8689b0972c02840bb486a62" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:02.021247 master-0 kubenswrapper[8678]: I1204 00:47:02.021203 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"cbad610cd8689b0972c02840bb486a62","Type":"ContainerStarted","Data":"3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf"} Dec 04 00:47:02.021816 master-0 kubenswrapper[8678]: I1204 00:47:02.021777 8678 status_manager.go:851] "Failed to get status for pod" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:02.224252 master-0 kubenswrapper[8678]: I1204 00:47:02.224132 8678 patch_prober.go:28] interesting pod/bootstrap-kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.32.10:6443/readyz\": dial tcp 192.168.32.10:6443: connect: connection refused" start-of-body= Dec 04 00:47:02.224432 master-0 kubenswrapper[8678]: I1204 00:47:02.224371 8678 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="13238af3704fe583f617f61e755cf4c2" containerName="kube-apiserver" probeResult="failure" output="Get \"https://192.168.32.10:6443/readyz\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:02.524439 master-0 kubenswrapper[8678]: I1204 00:47:02.524227 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:02.524439 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:02.524439 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:02.524439 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:02.524439 master-0 kubenswrapper[8678]: I1204 00:47:02.524356 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:03.034914 master-0 kubenswrapper[8678]: I1204 00:47:03.034852 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"cbad610cd8689b0972c02840bb486a62","Type":"ContainerStarted","Data":"5d0a33c64da0b1dd5560e6a19900c4795c94210bc6ff9cbffed5612130d3fbf2"} Dec 04 00:47:03.036898 master-0 kubenswrapper[8678]: I1204 00:47:03.036825 8678 status_manager.go:851] "Failed to get status for pod" podUID="cbad610cd8689b0972c02840bb486a62" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.038210 master-0 kubenswrapper[8678]: I1204 00:47:03.038160 8678 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15" exitCode=0 Dec 04 00:47:03.038405 master-0 kubenswrapper[8678]: I1204 00:47:03.038362 8678 status_manager.go:851] "Failed to get status for pod" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.038625 master-0 kubenswrapper[8678]: I1204 00:47:03.038398 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerDied","Data":"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15"} Dec 04 00:47:03.040198 master-0 kubenswrapper[8678]: E1204 00:47:03.040176 8678 kubelet.go:1929] "Failed creating a mirror pod for" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:03.040434 master-0 kubenswrapper[8678]: I1204 00:47:03.040332 8678 status_manager.go:851] "Failed to get status for pod" podUID="cbad610cd8689b0972c02840bb486a62" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.041279 master-0 kubenswrapper[8678]: I1204 00:47:03.041256 8678 status_manager.go:851] "Failed to get status for pod" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.371653 master-0 kubenswrapper[8678]: I1204 00:47:03.371599 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:03.372821 master-0 kubenswrapper[8678]: I1204 00:47:03.372764 8678 status_manager.go:851] "Failed to get status for pod" podUID="cbad610cd8689b0972c02840bb486a62" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.373440 master-0 kubenswrapper[8678]: I1204 00:47:03.373402 8678 status_manager.go:851] "Failed to get status for pod" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:47:03.486260 master-0 kubenswrapper[8678]: I1204 00:47:03.486191 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:47:03.486372 master-0 kubenswrapper[8678]: I1204 00:47:03.486271 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:47:03.486372 master-0 kubenswrapper[8678]: I1204 00:47:03.486331 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:47:03.486488 master-0 kubenswrapper[8678]: I1204 00:47:03.486428 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.486624 master-0 kubenswrapper[8678]: I1204 00:47:03.486593 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock" (OuterVolumeSpecName: "var-lock") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.487078 master-0 kubenswrapper[8678]: I1204 00:47:03.486971 8678 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.487078 master-0 kubenswrapper[8678]: I1204 00:47:03.486999 8678 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.492971 master-0 kubenswrapper[8678]: I1204 00:47:03.489034 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:47:03.522020 master-0 kubenswrapper[8678]: I1204 00:47:03.521961 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:03.522020 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:03.522020 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:03.522020 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:03.522352 master-0 kubenswrapper[8678]: I1204 00:47:03.522048 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:03.615874 master-0 kubenswrapper[8678]: I1204 00:47:03.614499 8678 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.789358 master-0 kubenswrapper[8678]: I1204 00:47:03.789309 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817285 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817333 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817409 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817423 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817470 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817468 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs" (OuterVolumeSpecName: "logs") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817524 8678 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") pod \"13238af3704fe583f617f61e755cf4c2\" (UID: \"13238af3704fe583f617f61e755cf4c2\") " Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817546 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud" (OuterVolumeSpecName: "etc-kubernetes-cloud") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "etc-kubernetes-cloud". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817580 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets" (OuterVolumeSpecName: "secrets") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "secrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817650 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config" (OuterVolumeSpecName: "config") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817674 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.817702 8678 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host" (OuterVolumeSpecName: "ssl-certs-host") pod "13238af3704fe583f617f61e755cf4c2" (UID: "13238af3704fe583f617f61e755cf4c2"). InnerVolumeSpecName "ssl-certs-host". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818790 8678 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818810 8678 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818853 8678 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818865 8678 reconciler_common.go:293] "Volume detached for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-secrets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818877 8678 reconciler_common.go:293] "Volume detached for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-ssl-certs-host\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:03.819752 master-0 kubenswrapper[8678]: I1204 00:47:03.818964 8678 reconciler_common.go:293] "Volume detached for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/13238af3704fe583f617f61e755cf4c2-etc-kubernetes-cloud\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:04.051044 master-0 kubenswrapper[8678]: I1204 00:47:04.050991 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:04.051724 master-0 kubenswrapper[8678]: I1204 00:47:04.051673 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"a37027d2-eeb1-416b-b67e-7ee233c42d04","Type":"ContainerDied","Data":"360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b"} Dec 04 00:47:04.051801 master-0 kubenswrapper[8678]: I1204 00:47:04.051734 8678 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b" Dec 04 00:47:04.055672 master-0 kubenswrapper[8678]: I1204 00:47:04.055509 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1"} Dec 04 00:47:04.055672 master-0 kubenswrapper[8678]: I1204 00:47:04.055538 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e"} Dec 04 00:47:04.055672 master-0 kubenswrapper[8678]: I1204 00:47:04.055549 8678 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4"} Dec 04 00:47:04.059546 master-0 kubenswrapper[8678]: I1204 00:47:04.059494 8678 generic.go:334] "Generic (PLEG): container finished" podID="13238af3704fe583f617f61e755cf4c2" containerID="a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b" exitCode=0 Dec 04 00:47:04.060438 master-0 kubenswrapper[8678]: I1204 00:47:04.059561 8678 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 00:47:04.060438 master-0 kubenswrapper[8678]: I1204 00:47:04.059569 8678 scope.go:117] "RemoveContainer" containerID="155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be" Dec 04 00:47:04.119183 master-0 kubenswrapper[8678]: I1204 00:47:04.119146 8678 scope.go:117] "RemoveContainer" containerID="a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b" Dec 04 00:47:04.136216 master-0 kubenswrapper[8678]: I1204 00:47:04.136183 8678 scope.go:117] "RemoveContainer" containerID="87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899" Dec 04 00:47:04.170056 master-0 kubenswrapper[8678]: I1204 00:47:04.169426 8678 scope.go:117] "RemoveContainer" containerID="155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be" Dec 04 00:47:04.170882 master-0 kubenswrapper[8678]: E1204 00:47:04.170775 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be\": container with ID starting with 155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be not found: ID does not exist" containerID="155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be" Dec 04 00:47:04.170882 master-0 kubenswrapper[8678]: I1204 00:47:04.170811 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be"} err="failed to get container status \"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be\": rpc error: code = NotFound desc = could not find container \"155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be\": container with ID starting with 155401188bdaa758cb625fd83800a1cc8680101965069a1932fb93b2bc9478be not found: ID does not exist" Dec 04 00:47:04.170882 master-0 kubenswrapper[8678]: I1204 00:47:04.170837 8678 scope.go:117] "RemoveContainer" containerID="a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b" Dec 04 00:47:04.171354 master-0 kubenswrapper[8678]: E1204 00:47:04.171179 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b\": container with ID starting with a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b not found: ID does not exist" containerID="a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b" Dec 04 00:47:04.171354 master-0 kubenswrapper[8678]: I1204 00:47:04.171205 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b"} err="failed to get container status \"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b\": rpc error: code = NotFound desc = could not find container \"a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b\": container with ID starting with a8f60c19e6a7f956bc68757b1d721c8246e2c8a923e26638b9646d2778301c6b not found: ID does not exist" Dec 04 00:47:04.171354 master-0 kubenswrapper[8678]: I1204 00:47:04.171225 8678 scope.go:117] "RemoveContainer" containerID="87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899" Dec 04 00:47:04.172227 master-0 kubenswrapper[8678]: E1204 00:47:04.172176 8678 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899\": container with ID starting with 87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899 not found: ID does not exist" containerID="87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899" Dec 04 00:47:04.172227 master-0 kubenswrapper[8678]: I1204 00:47:04.172199 8678 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899"} err="failed to get container status \"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899\": rpc error: code = NotFound desc = could not find container \"87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899\": container with ID starting with 87118252efbefcabfd0dc19cb19f6a4dd17419d94dd39087747893490b78a899 not found: ID does not exist" Dec 04 00:47:04.526587 master-0 kubenswrapper[8678]: I1204 00:47:04.525544 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:04.526587 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:04.526587 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:04.526587 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:04.526587 master-0 kubenswrapper[8678]: I1204 00:47:04.525614 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:04.862791 master-0 kubenswrapper[8678]: I1204 00:47:04.862733 8678 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13238af3704fe583f617f61e755cf4c2" path="/var/lib/kubelet/pods/13238af3704fe583f617f61e755cf4c2/volumes" Dec 04 00:47:04.863901 master-0 kubenswrapper[8678]: I1204 00:47:04.863884 8678 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="" Dec 04 00:47:05.523149 master-0 kubenswrapper[8678]: I1204 00:47:05.523028 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:05.523149 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:05.523149 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:05.523149 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:05.523484 master-0 kubenswrapper[8678]: I1204 00:47:05.523170 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:06.523966 master-0 kubenswrapper[8678]: I1204 00:47:06.523830 8678 patch_prober.go:28] interesting pod/router-default-54f97f57-x27s4 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Dec 04 00:47:06.523966 master-0 kubenswrapper[8678]: [-]has-synced failed: reason withheld Dec 04 00:47:06.523966 master-0 kubenswrapper[8678]: [+]process-running ok Dec 04 00:47:06.523966 master-0 kubenswrapper[8678]: healthz check failed Dec 04 00:47:06.523966 master-0 kubenswrapper[8678]: I1204 00:47:06.523960 8678 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-54f97f57-x27s4" podUID="83e0d056-186c-4067-b586-14fe2970fcc0" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:47:07.441833 master-0 systemd[1]: Stopping Kubernetes Kubelet... Dec 04 00:47:07.479112 master-0 systemd[1]: kubelet.service: Deactivated successfully. Dec 04 00:47:07.479396 master-0 systemd[1]: Stopped Kubernetes Kubelet. Dec 04 00:47:07.481804 master-0 systemd[1]: kubelet.service: Consumed 2min 46.388s CPU time. Dec 04 00:47:07.506719 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 00:47:07.670840 master-0 kubenswrapper[33142]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:47:07.670840 master-0 kubenswrapper[33142]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 00:47:07.670840 master-0 kubenswrapper[33142]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:47:07.670840 master-0 kubenswrapper[33142]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:47:07.670840 master-0 kubenswrapper[33142]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 00:47:07.671909 master-0 kubenswrapper[33142]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 00:47:07.671909 master-0 kubenswrapper[33142]: I1204 00:47:07.671006 33142 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676170 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676204 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676209 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676214 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676218 33142 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676223 33142 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676228 33142 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676233 33142 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676238 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676242 33142 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676246 33142 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676249 33142 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676253 33142 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676257 33142 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676260 33142 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676265 33142 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676268 33142 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676272 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:47:07.676284 master-0 kubenswrapper[33142]: W1204 00:47:07.676275 33142 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676279 33142 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676283 33142 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676287 33142 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676292 33142 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676296 33142 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676301 33142 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676305 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676309 33142 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676313 33142 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676318 33142 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676322 33142 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676326 33142 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676331 33142 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676335 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676352 33142 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676359 33142 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676365 33142 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676370 33142 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676375 33142 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:47:07.678337 master-0 kubenswrapper[33142]: W1204 00:47:07.676379 33142 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676385 33142 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676390 33142 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676396 33142 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676401 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676406 33142 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676410 33142 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676414 33142 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676419 33142 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676423 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676427 33142 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676431 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676435 33142 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676440 33142 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676445 33142 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676450 33142 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676454 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676459 33142 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676463 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:47:07.678889 master-0 kubenswrapper[33142]: W1204 00:47:07.676467 33142 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676471 33142 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676475 33142 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676479 33142 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676483 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676486 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676491 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676497 33142 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676506 33142 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676509 33142 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676514 33142 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676518 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676522 33142 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676525 33142 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: W1204 00:47:07.676529 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676647 33142 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676658 33142 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676666 33142 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676673 33142 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676679 33142 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676684 33142 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 00:47:07.679398 master-0 kubenswrapper[33142]: I1204 00:47:07.676691 33142 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676697 33142 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676702 33142 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676707 33142 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676712 33142 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676718 33142 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676724 33142 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676728 33142 flags.go:64] FLAG: --cgroup-root="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676733 33142 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676737 33142 flags.go:64] FLAG: --client-ca-file="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676741 33142 flags.go:64] FLAG: --cloud-config="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676746 33142 flags.go:64] FLAG: --cloud-provider="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.676750 33142 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678072 33142 flags.go:64] FLAG: --cluster-domain="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678079 33142 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678083 33142 flags.go:64] FLAG: --config-dir="" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678088 33142 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678093 33142 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678099 33142 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678104 33142 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678108 33142 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678113 33142 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678118 33142 flags.go:64] FLAG: --contention-profiling="false" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678122 33142 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678126 33142 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 00:47:07.679938 master-0 kubenswrapper[33142]: I1204 00:47:07.678131 33142 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678135 33142 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678141 33142 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678145 33142 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678150 33142 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678154 33142 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678158 33142 flags.go:64] FLAG: --enable-server="true" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678163 33142 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678168 33142 flags.go:64] FLAG: --event-burst="100" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678174 33142 flags.go:64] FLAG: --event-qps="50" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678178 33142 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678183 33142 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678187 33142 flags.go:64] FLAG: --eviction-hard="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678197 33142 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678201 33142 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678207 33142 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678211 33142 flags.go:64] FLAG: --eviction-soft="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678215 33142 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678220 33142 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678224 33142 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678229 33142 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678233 33142 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678237 33142 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678241 33142 flags.go:64] FLAG: --feature-gates="" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678247 33142 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 00:47:07.680553 master-0 kubenswrapper[33142]: I1204 00:47:07.678251 33142 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678256 33142 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678260 33142 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678265 33142 flags.go:64] FLAG: --healthz-port="10248" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678271 33142 flags.go:64] FLAG: --help="false" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678275 33142 flags.go:64] FLAG: --hostname-override="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678279 33142 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678284 33142 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678288 33142 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678292 33142 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678297 33142 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678301 33142 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678305 33142 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678310 33142 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678314 33142 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678318 33142 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678323 33142 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678327 33142 flags.go:64] FLAG: --kube-reserved="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678331 33142 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678337 33142 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678343 33142 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678349 33142 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678355 33142 flags.go:64] FLAG: --lock-file="" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678361 33142 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678367 33142 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 00:47:07.681335 master-0 kubenswrapper[33142]: I1204 00:47:07.678373 33142 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678385 33142 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678392 33142 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678398 33142 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678403 33142 flags.go:64] FLAG: --logging-format="text" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678408 33142 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678412 33142 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678417 33142 flags.go:64] FLAG: --manifest-url="" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678421 33142 flags.go:64] FLAG: --manifest-url-header="" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678434 33142 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678439 33142 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678444 33142 flags.go:64] FLAG: --max-pods="110" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678449 33142 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678459 33142 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678464 33142 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678468 33142 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678473 33142 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678477 33142 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678482 33142 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678494 33142 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678499 33142 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678503 33142 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678507 33142 flags.go:64] FLAG: --pod-cidr="" Dec 04 00:47:07.682348 master-0 kubenswrapper[33142]: I1204 00:47:07.678512 33142 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fff930cf757e23d388d86d05942b76e44d3bda5e387b299c239e4d12545d26dd" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678521 33142 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678525 33142 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678529 33142 flags.go:64] FLAG: --pods-per-core="0" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678533 33142 flags.go:64] FLAG: --port="10250" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678538 33142 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678558 33142 flags.go:64] FLAG: --provider-id="" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678563 33142 flags.go:64] FLAG: --qos-reserved="" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678567 33142 flags.go:64] FLAG: --read-only-port="10255" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678571 33142 flags.go:64] FLAG: --register-node="true" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678576 33142 flags.go:64] FLAG: --register-schedulable="true" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678580 33142 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678588 33142 flags.go:64] FLAG: --registry-burst="10" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678592 33142 flags.go:64] FLAG: --registry-qps="5" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678598 33142 flags.go:64] FLAG: --reserved-cpus="" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678602 33142 flags.go:64] FLAG: --reserved-memory="" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678608 33142 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678617 33142 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678835 33142 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678846 33142 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678852 33142 flags.go:64] FLAG: --runonce="false" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678857 33142 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678863 33142 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678868 33142 flags.go:64] FLAG: --seccomp-default="false" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678872 33142 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678876 33142 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 00:47:07.683831 master-0 kubenswrapper[33142]: I1204 00:47:07.678882 33142 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678887 33142 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678892 33142 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678896 33142 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678903 33142 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678909 33142 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678915 33142 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678921 33142 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678946 33142 flags.go:64] FLAG: --system-cgroups="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678951 33142 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678961 33142 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678966 33142 flags.go:64] FLAG: --tls-cert-file="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678972 33142 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678979 33142 flags.go:64] FLAG: --tls-min-version="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678983 33142 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678987 33142 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678992 33142 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.678996 33142 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.679001 33142 flags.go:64] FLAG: --v="2" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.679008 33142 flags.go:64] FLAG: --version="false" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.679014 33142 flags.go:64] FLAG: --vmodule="" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.679020 33142 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: I1204 00:47:07.679024 33142 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: W1204 00:47:07.679168 33142 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: W1204 00:47:07.679178 33142 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:47:07.684536 master-0 kubenswrapper[33142]: W1204 00:47:07.679183 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679188 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679193 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679198 33142 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679203 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679207 33142 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679211 33142 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679216 33142 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679220 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679225 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679230 33142 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679235 33142 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679240 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679244 33142 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679252 33142 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679257 33142 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679261 33142 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679265 33142 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679269 33142 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679273 33142 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:47:07.685324 master-0 kubenswrapper[33142]: W1204 00:47:07.679277 33142 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679280 33142 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679284 33142 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679287 33142 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679291 33142 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679295 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679298 33142 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679302 33142 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679306 33142 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679309 33142 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679317 33142 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679322 33142 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679326 33142 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679330 33142 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679334 33142 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679339 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679344 33142 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679349 33142 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679354 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679359 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:47:07.685847 master-0 kubenswrapper[33142]: W1204 00:47:07.679364 33142 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679369 33142 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679373 33142 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679378 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679384 33142 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679390 33142 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679397 33142 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679403 33142 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679408 33142 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679414 33142 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679420 33142 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679425 33142 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679430 33142 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679434 33142 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679440 33142 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679446 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679451 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679456 33142 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679463 33142 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:47:07.686393 master-0 kubenswrapper[33142]: W1204 00:47:07.679468 33142 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679473 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679477 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679483 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679488 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679492 33142 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679497 33142 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679502 33142 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679507 33142 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679512 33142 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: W1204 00:47:07.679517 33142 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:47:07.686868 master-0 kubenswrapper[33142]: I1204 00:47:07.679533 33142 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:47:07.687185 master-0 kubenswrapper[33142]: I1204 00:47:07.687093 33142 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 00:47:07.687185 master-0 kubenswrapper[33142]: I1204 00:47:07.687141 33142 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 00:47:07.687315 master-0 kubenswrapper[33142]: W1204 00:47:07.687280 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:47:07.687315 master-0 kubenswrapper[33142]: W1204 00:47:07.687305 33142 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687314 33142 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687325 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687334 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687342 33142 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687351 33142 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:47:07.687380 master-0 kubenswrapper[33142]: W1204 00:47:07.687362 33142 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687381 33142 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687399 33142 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687411 33142 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687422 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687431 33142 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687442 33142 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687453 33142 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687463 33142 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687474 33142 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687484 33142 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687493 33142 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687501 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687509 33142 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687517 33142 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687524 33142 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687532 33142 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687540 33142 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687548 33142 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687556 33142 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:47:07.687551 master-0 kubenswrapper[33142]: W1204 00:47:07.687565 33142 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687574 33142 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687583 33142 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687591 33142 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687603 33142 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687613 33142 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687621 33142 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687635 33142 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687644 33142 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687654 33142 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687664 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687673 33142 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687681 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687689 33142 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687697 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687705 33142 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687713 33142 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687787 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687800 33142 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:47:07.688129 master-0 kubenswrapper[33142]: W1204 00:47:07.687809 33142 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687818 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687826 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687834 33142 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687842 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687853 33142 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687867 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687876 33142 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687887 33142 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687896 33142 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687905 33142 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687913 33142 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687922 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687951 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687961 33142 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687972 33142 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687982 33142 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687990 33142 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.687998 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:47:07.688619 master-0 kubenswrapper[33142]: W1204 00:47:07.688006 33142 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688014 33142 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688022 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688030 33142 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688038 33142 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688048 33142 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688056 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: I1204 00:47:07.688070 33142 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688412 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688438 33142 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688449 33142 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688458 33142 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688466 33142 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688474 33142 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688481 33142 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 00:47:07.689122 master-0 kubenswrapper[33142]: W1204 00:47:07.688490 33142 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688500 33142 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688508 33142 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688515 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688523 33142 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688531 33142 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688540 33142 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688547 33142 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688555 33142 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688566 33142 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688577 33142 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688587 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688595 33142 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688606 33142 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688616 33142 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688625 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688634 33142 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688643 33142 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688652 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 00:47:07.689598 master-0 kubenswrapper[33142]: W1204 00:47:07.688660 33142 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688669 33142 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688677 33142 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688685 33142 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688693 33142 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688704 33142 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688713 33142 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688723 33142 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688732 33142 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688740 33142 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688749 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688757 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688764 33142 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688773 33142 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688782 33142 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688790 33142 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688798 33142 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688806 33142 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688814 33142 feature_gate.go:330] unrecognized feature gate: Example Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688823 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 00:47:07.690091 master-0 kubenswrapper[33142]: W1204 00:47:07.688831 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688838 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688846 33142 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688854 33142 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688863 33142 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688871 33142 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688879 33142 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688887 33142 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688895 33142 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688904 33142 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688911 33142 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688919 33142 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688951 33142 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688962 33142 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688973 33142 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688983 33142 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.688992 33142 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.689002 33142 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.689010 33142 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.689019 33142 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 00:47:07.690570 master-0 kubenswrapper[33142]: W1204 00:47:07.689028 33142 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: W1204 00:47:07.689036 33142 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: W1204 00:47:07.689046 33142 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: W1204 00:47:07.689056 33142 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: W1204 00:47:07.689064 33142 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: W1204 00:47:07.689072 33142 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: I1204 00:47:07.689088 33142 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 00:47:07.691083 master-0 kubenswrapper[33142]: I1204 00:47:07.689537 33142 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 00:47:07.692719 master-0 kubenswrapper[33142]: I1204 00:47:07.692679 33142 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Dec 04 00:47:07.692907 master-0 kubenswrapper[33142]: I1204 00:47:07.692875 33142 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Dec 04 00:47:07.693410 master-0 kubenswrapper[33142]: I1204 00:47:07.693378 33142 server.go:997] "Starting client certificate rotation" Dec 04 00:47:07.693410 master-0 kubenswrapper[33142]: I1204 00:47:07.693406 33142 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 00:47:07.693733 master-0 kubenswrapper[33142]: I1204 00:47:07.693633 33142 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 21:06:24.501997974 +0000 UTC Dec 04 00:47:07.693810 master-0 kubenswrapper[33142]: I1204 00:47:07.693730 33142 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 20h19m16.808272262s for next certificate rotation Dec 04 00:47:07.694848 master-0 kubenswrapper[33142]: I1204 00:47:07.694813 33142 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:47:07.697942 master-0 kubenswrapper[33142]: I1204 00:47:07.697877 33142 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 00:47:07.701076 master-0 kubenswrapper[33142]: I1204 00:47:07.701029 33142 log.go:25] "Validated CRI v1 runtime API" Dec 04 00:47:07.711675 master-0 kubenswrapper[33142]: I1204 00:47:07.711623 33142 log.go:25] "Validated CRI v1 image API" Dec 04 00:47:07.713222 master-0 kubenswrapper[33142]: I1204 00:47:07.713179 33142 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 00:47:07.732642 master-0 kubenswrapper[33142]: I1204 00:47:07.732553 33142 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4 b7c19a61-c15a-446d-937b-5d5c941bb8bc:/dev/vda3] Dec 04 00:47:07.734528 master-0 kubenswrapper[33142]: I1204 00:47:07.732620 33142 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b/userdata/shm major:0 minor:429 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b/userdata/shm major:0 minor:781 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a/userdata/shm major:0 minor:1494 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4/userdata/shm major:0 minor:605 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a/userdata/shm major:0 minor:1146 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5/userdata/shm major:0 minor:1410 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/278f4b6d18c3dff2a31d66fba4e29fab6ef18d7c261452df63497a5c531805a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/278f4b6d18c3dff2a31d66fba4e29fab6ef18d7c261452df63497a5c531805a2/userdata/shm major:0 minor:435 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a98a5d982257969db8c53b7549324edfb17072359c4ef2f1b840f5a2439be7f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a98a5d982257969db8c53b7549324edfb17072359c4ef2f1b840f5a2439be7f/userdata/shm major:0 minor:778 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e/userdata/shm major:0 minor:1140 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d5b8039b2e09b8e957343170e87c62b622821dee52fef43a91e443c213a1a25/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d5b8039b2e09b8e957343170e87c62b622821dee52fef43a91e443c213a1a25/userdata/shm major:0 minor:597 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2dc8ab6f03770ec3fcd4c4d814b86bb98342fbc4e33aae0acbc9f87f7007ddb9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2dc8ab6f03770ec3fcd4c4d814b86bb98342fbc4e33aae0acbc9f87f7007ddb9/userdata/shm major:0 minor:1379 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/33cf50dddcd93f720ca2efeba9e6e7f9c2f4ad9ce4ace46bbe2653eb9453a59c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/33cf50dddcd93f720ca2efeba9e6e7f9c2f4ad9ce4ace46bbe2653eb9453a59c/userdata/shm major:0 minor:783 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd/userdata/shm major:0 minor:556 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c/userdata/shm major:0 minor:1022 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3/userdata/shm major:0 minor:495 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d1087838ccc2ee2e43fbcfa144379af98284af1351e708a321b3441c8c85b24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d1087838ccc2ee2e43fbcfa144379af98284af1351e708a321b3441c8c85b24/userdata/shm major:0 minor:1462 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3e0105457378e7432c177589892734a13bb9dfef188b04685e76db7bf4f09429/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3e0105457378e7432c177589892734a13bb9dfef188b04685e76db7bf4f09429/userdata/shm major:0 minor:1156 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3e687558ac9303feb73670490b1fecaf558fff432fa6eb10eb8333dd042f763b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3e687558ac9303feb73670490b1fecaf558fff432fa6eb10eb8333dd042f763b/userdata/shm major:0 minor:46 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3fe4a6cd4cada46a728249b8c43a7c74f080b5f782c7415dc019cf4f1ea4ead6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3fe4a6cd4cada46a728249b8c43a7c74f080b5f782c7415dc019cf4f1ea4ead6/userdata/shm major:0 minor:780 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c/userdata/shm major:0 minor:1416 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm major:0 minor:305 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4b85650970d13e0eaa60992e9aecaaeb5440711d6216154b4b078601628c8c28/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4b85650970d13e0eaa60992e9aecaaeb5440711d6216154b4b078601628c8c28/userdata/shm major:0 minor:1144 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c88563b57a2b2f50e432a799c6dad94f7e66dc14230becc3dfc6c5396080ec0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c88563b57a2b2f50e432a799c6dad94f7e66dc14230becc3dfc6c5396080ec0/userdata/shm major:0 minor:1157 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78/userdata/shm major:0 minor:1132 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4ee3dd7cd38da2c920657ce4d7b82c0b34d9d38275312a1c0eadf1bcf0b5d640/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4ee3dd7cd38da2c920657ce4d7b82c0b34d9d38275312a1c0eadf1bcf0b5d640/userdata/shm major:0 minor:486 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52f656c6701b64f3eb5181c0b0fd4550d4b20ce73f741ff988f2cd1ac210fc50/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52f656c6701b64f3eb5181c0b0fd4550d4b20ce73f741ff988f2cd1ac210fc50/userdata/shm major:0 minor:784 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827/userdata/shm major:0 minor:755 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e0b72e52dac150f1ad995043cf07f60db4f72faeed42d70d8fc4c8e258d6073/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e0b72e52dac150f1ad995043cf07f60db4f72faeed42d70d8fc4c8e258d6073/userdata/shm major:0 minor:488 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm major:0 minor:351 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e77c62a2273f76fc1c8f39342ac07511df3a8595262b77b7ecf8729a4463d81/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e77c62a2273f76fc1c8f39342ac07511df3a8595262b77b7ecf8729a4463d81/userdata/shm major:0 minor:1134 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm major:0 minor:337 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020/userdata/shm major:0 minor:1500 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2/userdata/shm major:0 minor:1017 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a/userdata/shm major:0 minor:782 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875/userdata/shm major:0 minor:1362 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm major:0 minor:160 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96f9ea3b5bc4d360e73058baf8b809abcaa5af378d5ddb713a2a0d58b0fd9a1f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96f9ea3b5bc4d360e73058baf8b809abcaa5af378d5ddb713a2a0d58b0fd9a1f/userdata/shm major:0 minor:1141 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9da438f00be81852193cf6977b4578eadeb8e58d253dc4eeb7ed8920cb7c25d8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9da438f00be81852193cf6977b4578eadeb8e58d253dc4eeb7ed8920cb7c25d8/userdata/shm major:0 minor:1150 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046/userdata/shm major:0 minor:411 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a2fd3bdb7364347566a428315934c8eb45e73b343f9ec75b13c63365c3f03f2f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a2fd3bdb7364347566a428315934c8eb45e73b343f9ec75b13c63365c3f03f2f/userdata/shm major:0 minor:1412 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm major:0 minor:128 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d/userdata/shm major:0 minor:628 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b/userdata/shm major:0 minor:1578 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b4d5da9639ac64af8c6b49afd056c92bbfb29caf48793701f25d367ee5d81bc3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b4d5da9639ac64af8c6b49afd056c92bbfb29caf48793701f25d367ee5d81bc3/userdata/shm major:0 minor:379 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b67b9d50d899e5a64493410038447a1d3c6621b8f7e5bf837d77b9ba67d41a60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b67b9d50d899e5a64493410038447a1d3c6621b8f7e5bf837d77b9ba67d41a60/userdata/shm major:0 minor:630 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b7107932acd9800ab6a9aa8488d291eca64c4817c02b99a03d6afcb4c6aa5306/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b7107932acd9800ab6a9aa8488d291eca64c4817c02b99a03d6afcb4c6aa5306/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm major:0 minor:345 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b7f9fde08392c65ce1c3c95f566f8400383b906d186df46ad254525d83c87159/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b7f9fde08392c65ce1c3c95f566f8400383b906d186df46ad254525d83c87159/userdata/shm major:0 minor:629 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5/userdata/shm major:0 minor:761 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd/userdata/shm major:0 minor:926 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2/userdata/shm major:0 minor:416 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548/userdata/shm major:0 minor:466 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm major:0 minor:143 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885/userdata/shm major:0 minor:939 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1cc6b47032858a9f23cf1250d8519a8904fc0784c3d5cd13c71b398db1efb64/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1cc6b47032858a9f23cf1250d8519a8904fc0784c3d5cd13c71b398db1efb64/userdata/shm major:0 minor:1496 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4939b21289b30f741e5b063601cba30ecee1e657055a7fef29dabdb7ced8760/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4939b21289b30f741e5b063601cba30ecee1e657055a7fef29dabdb7ced8760/userdata/shm major:0 minor:635 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c/userdata/shm major:0 minor:497 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm major:0 minor:179 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938/userdata/shm major:0 minor:610 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f192f85af4cbdeff0073384888cdf9db08a401d3269e978db43452b2b4dfc4b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f192f85af4cbdeff0073384888cdf9db08a401d3269e978db43452b2b4dfc4b2/userdata/shm major:0 minor:1154 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm major:0 minor:176 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c/userdata/shm major:0 minor:140 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf/userdata/shm major:0 minor:1409 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm major:0 minor:132 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~projected/kube-api-access major:0 minor:779 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~secret/serving-cert major:0 minor:777 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md:{mountpoint:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/060f2a39-e40c-495b-885d-5acd967e6c25/volumes/kubernetes.io~projected/kube-api-access-9kssf:{mountpoint:/var/lib/kubelet/pods/060f2a39-e40c-495b-885d-5acd967e6c25/volumes/kubernetes.io~projected/kube-api-access-9kssf major:0 minor:386 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9:{mountpoint:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9 major:0 minor:175 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert major:0 minor:174 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~projected/kube-api-access-xbks2:{mountpoint:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~projected/kube-api-access-xbks2 major:0 minor:1490 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:1487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:1485 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~projected/kube-api-access-h6tj6:{mountpoint:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~projected/kube-api-access-h6tj6 major:0 minor:1130 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cert major:0 minor:922 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls:{mountpoint:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls major:0 minor:768 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~projected/kube-api-access-jms7r:{mountpoint:/var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~projected/kube-api-access-jms7r major:0 minor:428 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~secret/webhook-certs:{mountpoint:/var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~secret/webhook-certs major:0 minor:405 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:586 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/tmp major:0 minor:587 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~projected/kube-api-access-588cp:{mountpoint:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~projected/kube-api-access-588cp major:0 minor:588 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq:{mountpoint:/var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~projected/kube-api-access-khxjm:{mountpoint:/var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~projected/kube-api-access-khxjm major:0 minor:503 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~secret/signing-key major:0 minor:502 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c:{mountpoint:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c major:0 minor:157 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert major:0 minor:156 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf:{mountpoint:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~projected/kube-api-access-wmjvf:{mountpoint:/var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~projected/kube-api-access-wmjvf major:0 minor:410 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf:{mountpoint:/var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf major:0 minor:142 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~projected/kube-api-access-k4vtt:{mountpoint:/var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~projected/kube-api-access-k4vtt major:0 minor:1327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~secret/proxy-tls:{mountpoint:/var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~secret/proxy-tls major:0 minor:1326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e5012fe-fc48-4b6d-a075-fa94266ba90d/volumes/kubernetes.io~projected/kube-api-access-g42cq:{mountpoint:/var/lib/kubelet/pods/3e5012fe-fc48-4b6d-a075-fa94266ba90d/volumes/kubernetes.io~projected/kube-api-access-g42cq major:0 minor:1402 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk:{mountpoint:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~secret/image-registry-operator-tls:{mountpoint:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~secret/image-registry-operator-tls major:0 minor:601 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/ca-certs:{mountpoint:/var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/ca-certs major:0 minor:553 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/kube-api-access-rznm9:{mountpoint:/var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/kube-api-access-rznm9 major:0 minor:620 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps:{mountpoint:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~projected/kube-api-access-nctgw:{mountpoint:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~projected/kube-api-access-nctgw major:0 minor:1489 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:1486 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:1488 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~projected/kube-api-access-5rb5q:{mountpoint:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~projected/kube-api-access-5rb5q major:0 minor:624 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/encryption-config:{mountpoint:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/encryption-config major:0 minor:623 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/etcd-client major:0 minor:622 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/serving-cert major:0 minor:621 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~projected/kube-api-access-2jn9h:{mountpoint:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~projected/kube-api-access-2jn9h major:0 minor:1577 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:1574 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:1576 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:1575 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~projected/kube-api-access-f8559:{mountpoint:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~projected/kube-api-access-f8559 major:0 minor:1042 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/apiservice-cert:{mountpoint:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/apiservice-cert major:0 minor:977 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/webhook-cert major:0 minor:980 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~projected/kube-api-access-k9v27:{mountpoint:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~projected/kube-api-access-k9v27 major:0 minor:1493 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:1492 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:1491 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~projected/kube-api-access-9zdwv:{mountpoint:/var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~projected/kube-api-access-9zdwv major:0 minor:1043 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~secret/machine-approver-tls:{mountpoint:/var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~secret/machine-approver-tls major:0 minor:701 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2:{mountpoint:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2 major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:24 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr major:0 minor:178 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:168 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bf75491-0c03-4e02-9074-c9be808badd4/volumes/kubernetes.io~projected/kube-api-access-qt7lk:{mountpoint:/var/lib/kubelet/pods/6bf75491-0c03-4e02-9074-c9be808badd4/volumes/kubernetes.io~projected/kube-api-access-qt7lk major:0 minor:1019 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~projected/kube-api-access-68d85:{mountpoint:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~projected/kube-api-access-68d85 major:0 minor:1461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/certs:{mountpoint:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/certs major:0 minor:1460 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/node-bootstrap-token:{mountpoint:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/node-bootstrap-token major:0 minor:1459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~projected/kube-api-access-xdnml:{mountpoint:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~projected/kube-api-access-xdnml major:0 minor:616 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/encryption-config:{mountpoint:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/encryption-config major:0 minor:524 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/etcd-client major:0 minor:534 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/serving-cert major:0 minor:523 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d3c9170-b36d-4052-8ae9-9e549611dbd8/volumes/kubernetes.io~projected/kube-api-access-gwvj6:{mountpoint:/var/lib/kubelet/pods/7d3c9170-b36d-4052-8ae9-9e549611dbd8/volumes/kubernetes.io~projected/kube-api-access-gwvj6 major:0 minor:496 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e83f444-49e8-40b5-9a58-3128002f28c9/volumes/kubernetes.io~projected/kube-api-access-fd68g:{mountpoint:/var/lib/kubelet/pods/7e83f444-49e8-40b5-9a58-3128002f28c9/volumes/kubernetes.io~projected/kube-api-access-fd68g major:0 minor:987 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~projected/kube-api-access-p2g6h:{mountpoint:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~projected/kube-api-access-p2g6h major:0 minor:1407 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/default-certificate major:0 minor:1403 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/metrics-certs major:0 minor:1406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/stats-auth major:0 minor:1404 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87adb521-b8d3-4201-b775-50c8c03956fc/volumes/kubernetes.io~projected/kube-api-access-sslx5:{mountpoint:/var/lib/kubelet/pods/87adb521-b8d3-4201-b775-50c8c03956fc/volumes/kubernetes.io~projected/kube-api-access-sslx5 major:0 minor:1016 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~projected/kube-api-access-76wg7:{mountpoint:/var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~projected/kube-api-access-76wg7 major:0 minor:1040 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~secret/proxy-tls:{mountpoint:/var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~secret/proxy-tls major:0 minor:979 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~projected/kube-api-access-56gxb:{mountpoint:/var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~projected/kube-api-access-56gxb major:0 minor:440 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2:{mountpoint:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~projected/kube-api-access-fvdw4:{mountpoint:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~projected/kube-api-access-fvdw4 major:0 minor:1401 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:1400 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:1408 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~projected/kube-api-access-cfcxz:{mountpoint:/var/lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~projected/kube-api-access-cfcxz major:0 minor:983 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/ Dec 04 00:47:07.734854 master-0 kubenswrapper[33142]: lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:976 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~projected/kube-api-access-j7vtf:{mountpoint:/var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~projected/kube-api-access-j7vtf major:0 minor:1045 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert major:0 minor:982 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/975f6a6f-1fbb-49e1-8a0a-722586355364/volumes/kubernetes.io~projected/kube-api-access-jt9j7:{mountpoint:/var/lib/kubelet/pods/975f6a6f-1fbb-49e1-8a0a-722586355364/volumes/kubernetes.io~projected/kube-api-access-jt9j7 major:0 minor:985 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd:{mountpoint:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd major:0 minor:153 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~secret/metrics-certs major:0 minor:776 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~projected/kube-api-access-bnmjf:{mountpoint:/var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~projected/kube-api-access-bnmjf major:0 minor:727 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls:{mountpoint:/var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls major:0 minor:988 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq:{mountpoint:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~secret/marketplace-operator-metrics:{mountpoint:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~secret/marketplace-operator-metrics major:0 minor:771 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc:{mountpoint:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc major:0 minor:126 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls major:0 minor:124 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn:{mountpoint:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/srv-cert:{mountpoint:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/srv-cert major:0 minor:773 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~projected/kube-api-access-vg2zj:{mountpoint:/var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~projected/kube-api-access-vg2zj major:0 minor:109 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls:{mountpoint:/var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls major:0 minor:108 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b95b14d5-c3da-4aa7-9574-5cafff04192a/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/b95b14d5-c3da-4aa7-9574-5cafff04192a/volumes/kubernetes.io~projected/kube-api-access major:0 minor:896 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~projected/kube-api-access-58w7s:{mountpoint:/var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~projected/kube-api-access-58w7s major:0 minor:1047 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~secret/cert major:0 minor:928 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/ca-certs:{mountpoint:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/ca-certs major:0 minor:618 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/kube-api-access-25sts:{mountpoint:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/kube-api-access-25sts major:0 minor:619 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~secret/catalogserver-certs:{mountpoint:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~secret/catalogserver-certs major:0 minor:617 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl:{mountpoint:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~secret/metrics-tls major:0 minor:596 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg:{mountpoint:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~secret/package-server-manager-serving-cert:{mountpoint:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~secret/package-server-manager-serving-cert major:0 minor:774 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr:{mountpoint:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/apiservice-cert:{mountpoint:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/apiservice-cert major:0 minor:555 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/node-tuning-operator-tls:{mountpoint:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/node-tuning-operator-tls major:0 minor:554 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd208ca4-eb77-49a9-87a9-e0a617526e5d/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/cd208ca4-eb77-49a9-87a9-e0a617526e5d/volumes/kubernetes.io~secret/tls-certificates major:0 minor:1405 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq:{mountpoint:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp:{mountpoint:/var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp major:0 minor:125 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc7bfc47-972c-4493-8372-f211c6645ff5/volumes/kubernetes.io~projected/kube-api-access-pc2xd:{mountpoint:/var/lib/kubelet/pods/dc7bfc47-972c-4493-8372-f211c6645ff5/volumes/kubernetes.io~projected/kube-api-access-pc2xd major:0 minor:487 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm:{mountpoint:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~projected/kube-api-access-9rd8w:{mountpoint:/var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~projected/kube-api-access-9rd8w major:0 minor:465 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~secret/cert major:0 minor:464 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~projected/kube-api-access-xtxx7:{mountpoint:/var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~projected/kube-api-access-xtxx7 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~projected/kube-api-access-pv8dv:{mountpoint:/var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~projected/kube-api-access-pv8dv major:0 minor:1131 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~secret/serving-cert major:0 minor:868 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p:{mountpoint:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~secret/metrics-tls major:0 minor:600 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~projected/kube-api-access-tg7nz:{mountpoint:/var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~projected/kube-api-access-tg7nz major:0 minor:686 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~secret/machine-api-operator-tls:{mountpoint:/var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~secret/machine-api-operator-tls major:0 minor:415 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e85684df-0014-4d28-9b00-9c6a6942cc94/volumes/kubernetes.io~projected/kube-api-access-ssjgh:{mountpoint:/var/lib/kubelet/pods/e85684df-0014-4d28-9b00-9c6a6942cc94/volumes/kubernetes.io~projected/kube-api-access-ssjgh major:0 minor:754 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m:{mountpoint:/var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~projected/kube-api-access-s89j7:{mountpoint:/var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~projected/kube-api-access-s89j7 major:0 minor:746 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~secret/metrics-tls major:0 minor:753 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m:{mountpoint:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:772 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~projected/kube-api-access-qlsmd:{mountpoint:/var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~projected/kube-api-access-qlsmd major:0 minor:1355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~secret/proxy-tls:{mountpoint:/var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~secret/proxy-tls major:0 minor:1354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq:{mountpoint:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/srv-cert:{mountpoint:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/srv-cert major:0 minor:770 fsType:tmpfs blockSize:0} overlay_0-1020:{mountpoint:/var/lib/containers/storage/overlay/0839d1907f72210c88baafb067264fd029c2d659c8ad378d51d5f145bad78d0e/merged major:0 minor:1020 fsType:overlay blockSize:0} overlay_0-1024:{mountpoint:/var/lib/containers/storage/overlay/91cef2b4e549e8c6376a79e4247a618b8fb227a8e64b23649999cd708db267a7/merged major:0 minor:1024 fsType:overlay blockSize:0} overlay_0-1030:{mountpoint:/var/lib/containers/storage/overlay/80202fe1a492794ee06a55892f1c4b8ac52799d240dd3de36ff0a01c4021eda0/merged major:0 minor:1030 fsType:overlay blockSize:0} overlay_0-1034:{mountpoint:/var/lib/containers/storage/overlay/64c687f5810417488fe41d1c4b51dd0e2f361786d70a9bed4430b93a8a4d3f16/merged major:0 minor:1034 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/651a0d78ab43d82b049a4d24494cc78a15b1d757f967f916fb811f9eee96eb7d/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-1055:{mountpoint:/var/lib/containers/storage/overlay/2c717801211f3ab9161c98abc737c735a0dec400d9901a09077433079ba18662/merged major:0 minor:1055 fsType:overlay blockSize:0} overlay_0-1059:{mountpoint:/var/lib/containers/storage/overlay/f5451de5daa70d52ef635f5ff0dc49b4a32ef667fc8e01e566034dfa27d21b36/merged major:0 minor:1059 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/da908d8698069b2bae326a0bc8329edc39c83a9961d5201fbc49451be26ee0f9/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-1061:{mountpoint:/var/lib/containers/storage/overlay/0f1145ac34423182a1c8f7921299f86c9b026fa9b8d1953023c41dfde49b4a51/merged major:0 minor:1061 fsType:overlay blockSize:0} overlay_0-1065:{mountpoint:/var/lib/containers/storage/overlay/4780a0787dcc55d08e9aa4a2d6817033070a45c60814d3fa9408d75673235afd/merged major:0 minor:1065 fsType:overlay blockSize:0} overlay_0-1069:{mountpoint:/var/lib/containers/storage/overlay/dc46df23638a6a17ff5d225fc79f4e7f67bb4a92bea8a89e94d44a0da46572e1/merged major:0 minor:1069 fsType:overlay blockSize:0} overlay_0-1072:{mountpoint:/var/lib/containers/storage/overlay/e356c91fa75a2850bfb6004ac0626a110970fbc64629cf805db4420339de4d3d/merged major:0 minor:1072 fsType:overlay blockSize:0} overlay_0-1078:{mountpoint:/var/lib/containers/storage/overlay/eccceb49c28e30f641bcbefbf7952876dfba62188cb2f3c22839a63c89eb0376/merged major:0 minor:1078 fsType:overlay blockSize:0} overlay_0-1080:{mountpoint:/var/lib/containers/storage/overlay/6ef9071fc7701bab342616646cd7b500a677fea551ecaad5a915e966682ee5bc/merged major:0 minor:1080 fsType:overlay blockSize:0} overlay_0-1084:{mountpoint:/var/lib/containers/storage/overlay/d2ec8173869e5baeeaacf14d6fc423356580172e67e1f4dd6d277a2be1301c5f/merged major:0 minor:1084 fsType:overlay blockSize:0} overlay_0-1099:{mountpoint:/var/lib/containers/storage/overlay/9f6e15acf8d6decfb42a30d878cf8b6bdd7927b5647b5e3fdae22bb4a0477a3d/merged major:0 minor:1099 fsType:overlay blockSize:0} overlay_0-110:{mountpoint:/var/lib/containers/storage/overlay/d0c96e3a9f0e1060e4c8583c1db4a0c78e0d36800d7cb218c1043456d2112c08/merged major:0 minor:110 fsType:overlay blockSize:0} overlay_0-1101:{mountpoint:/var/lib/containers/storage/overlay/4e06ef17afa4362e10f294de12eac69e10a2072776d5b12941bdaecb3187b3bc/merged major:0 minor:1101 fsType:overlay blockSize:0} overlay_0-1108:{mountpoint:/var/lib/containers/storage/overlay/3b8413ad6686394f7fab46612773b8598ab8af41b7ae12fd7dde629d20d495cb/merged major:0 minor:1108 fsType:overlay blockSize:0} overlay_0-1112:{mountpoint:/var/lib/containers/storage/overlay/4d8f7896dc4976f7874240cdcc076ae369c1b9b3f6f051c1a15d9d3b72241689/merged major:0 minor:1112 fsType:overlay blockSize:0} overlay_0-1114:{mountpoint:/var/lib/containers/storage/overlay/a780b6ab3a6d07b561783c230e188710f5c9f489619eda33acbe8e7b7ce8cd87/merged major:0 minor:1114 fsType:overlay blockSize:0} overlay_0-112:{mountpoint:/var/lib/containers/storage/overlay/e615fe1fa963ff502cadbf8b5856fba039ea67bec53de751c062da7e8bf96795/merged major:0 minor:112 fsType:overlay blockSize:0} overlay_0-1136:{mountpoint:/var/lib/containers/storage/overlay/5fec1939f79ee7d4ffd1b2f72dbbbb86ca7a19bd1f108af5c4474613d8c8e290/merged major:0 minor:1136 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7b54a6356324a40de65bb5a05d4d97a4bc25263c640da39f00887a654bba4d30/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-1148:{mountpoint:/var/lib/containers/storage/overlay/12ad56a477b03388b12f19a086035ff1cc5afdd65dc5fca7426254bb9aadc9b3/merged major:0 minor:1148 fsType:overlay blockSize:0} overlay_0-1151:{mountpoint:/var/lib/containers/storage/overlay/570460f698a2194a0a7d7adcb7efb83bd13711b6645328d5d31ffb1ac80f7217/merged major:0 minor:1151 fsType:overlay blockSize:0} overlay_0-116:{mountpoint:/var/lib/containers/storage/overlay/3ff9a9f8485247ed4609cef3a12fb81c0e022be9f4a0ed5dad9943f24c15e14c/merged major:0 minor:116 fsType:overlay blockSize:0} overlay_0-1162:{mountpoint:/var/lib/containers/storage/overlay/a9b488124010f887ce162bba9b8b89155e4ab02437443b2e0b229f29034f5f22/merged major:0 minor:1162 fsType:overlay blockSize:0} overlay_0-1168:{mountpoint:/var/lib/containers/storage/overlay/bc7d3cb9f9f06929334bbc5b73fe4aa01d8058886ec3482ca39b41649cd32ecb/merged major:0 minor:1168 fsType:overlay blockSize:0} overlay_0-1170:{mountpoint:/var/lib/containers/storage/overlay/a48adfe6d9f26978d4e1dd46a313d57c41442cb82c97171c46ab4c10eb7665b0/merged major:0 minor:1170 fsType:overlay blockSize:0} overlay_0-1172:{mountpoint:/var/lib/containers/storage/overlay/145c15cdac6bfddb271312ec3201c19fc00332d20e626e85f3bc66c94bd986b3/merged major:0 minor:1172 fsType:overlay blockSize:0} overlay_0-1174:{mountpoint:/var/lib/containers/storage/overlay/995fb56ee1cb68e7b9e2b0a72345a1fd214c217b811d588e689a75a141871bf1/merged major:0 minor:1174 fsType:overlay blockSize:0} overlay_0-1176:{mountpoint:/var/lib/containers/storage/overlay/8dc749e871d4763d105afde3b12478f3a14f394625ffe7d1e61e224535ede55d/merged major:0 minor:1176 fsType:overlay blockSize:0} overlay_0-118:{mountpoint:/var/lib/containers/storage/overlay/6bcc0cf3293b6d2c0e18076bfa80bd6ead2ef46228ba5f811f05cb657818658a/merged major:0 minor:118 fsType:overlay blockSize:0} overlay_0-1192:{mountpoint:/var/lib/containers/storage/overlay/e59b14b85dd79e45e824e7e121fd80576ea6f15c1606d182e3536a069bab4502/merged major:0 minor:1192 fsType:overlay blockSize:0} overlay_0-1194:{mountpoint:/var/lib/containers/storage/overlay/f943c21b4c6ba2d283b88fab98dc237dd1eee9e11e77bd77d1b0a00062471d6d/merged major:0 minor:1194 fsType:overlay blockSize:0} overlay_0-1196:{mountpoint:/var/lib/containers/storage/overlay/88f29e918d183b94ee9ca7b07dc9295e694deeb96dd00f3ae8ff34d3b2aa00b7/merged major:0 minor:1196 fsType:overlay blockSize:0} overlay_0-120:{mountpoint:/var/lib/containers/storage/overlay/38ca7b7ac6db2dfb5d5c9fd1efee25ea9c89870a8d40b05c2a59733d92a3b494/merged major:0 minor:120 fsType:overlay blockSize:0} overlay_0-1205:{mountpoint:/var/lib/containers/storage/overlay/8f8d633297de04c3077a519960fe75867fd02d2c36fa78425b175e0ede8d38ac/merged major:0 minor:1205 fsType:overlay blockSize:0} overlay_0-1207:{mountpoint:/var/lib/containers/storage/overlay/d343caa69c103103bdf5249a37f6bf4750c64d0c5de808d9716fea64e147a8df/merged major:0 minor:1207 fsType:overlay blockSize:0} overlay_0-1220:{mountpoint:/var/lib/containers/storage/overlay/c3800526731635c94d2cfb966706b0e500501d8d464c351e21f483b7cecce31e/merged major:0 minor:1220 fsType:overlay blockSize:0} overlay_0-1222:{mountpoint:/var/lib/containers/storage/overlay/1318a6d9d97c9c0bcc0c1ba94ef03ebd7a4d0d7453f1827d92627cd7db5ed922/merged major:0 minor:1222 fsType:overlay blockSize:0} overlay_0-1224:{mountpoint:/var/lib/containers/storage/overlay/0e1b66eba8fd51e0583f763e85d0f8429312e7ba4a05113858255f502935cfe5/merged major:0 minor:1224 fsType:overlay blockSize:0} overlay_0-1226:{mountpoint:/var/lib/containers/storage/overlay/30af98b81286869f4484f06568a5a269d6276cb236d52d3b502cbb7976c7a9ee/merged major:0 minor:1226 fsType:overlay blockSize:0} overlay_0-1231:{mountpoint:/var/lib/containers/storage/overlay/b20c5380ac460761a9836d122b18870675aa9c70b2f6619dd2a4ee8fbf611256/merged major:0 minor:1231 fsType:overlay blockSize:0} overlay_0-1240:{mountpoint:/var/lib/containers/storage/overlay/e8affe8c9e970be1a81a9855b3b78471f407ec12b0bd4b82e7a2752725be3655/merged major:0 minor:1240 fsType:overlay blockSize:0} overlay_0-1252:{mountpoint:/var/lib/containers/storage/overlay/74c64a78e6f7a4e5f10904cd791335f3d70d781a8f66d00163e53791cf0c3715/merged major:0 minor:1252 fsType:overlay blockSize:0} overlay_0-1255:{mountpoint:/var/lib/containers/storage/overlay/07221169aa021f9e47b97d6659d862adc10148875d34e7f2c7026e9a3d59a2ab/merged major:0 minor:1255 fsType:overlay blockSize:0} overlay_0-1263:{mountpoint:/var/lib/containers/storage/overlay/5dfcda6253ecf1c412bac8ba2bf406488a38293ea5fea57a584652e54b971851/merged major:0 minor:1263 fsType:overlay blockSize:0} overlay_0-1278:{mountpoint:/var/lib/containers/storage/overlay/f144e6defc7db862c1cc9f13dcf572a21934357c74eb9b98e42f3efb12d4e766/merged major:0 minor:1278 fsType:overlay blockSize:0} overlay_0-1280:{mountpoint:/var/lib/containers/storage/overlay/350d74c479f815ffd0195c2d96cc36ad6629a2598b4eed93c012b63f8fb6c8c9/merged major:0 minor:1280 fsType:overlay blockSize:0} overlay_0-1282:{mountpoint:/var/lib/containers/storage/overlay/4c5302fe2c1aab63caaf0e5cad5f4fd39cc9a5e8e0913c79f9e8cf8b55d93b89/merged major:0 minor:1282 fsType:overlay blockSize:0} overlay_0-1284:{mountpoint:/var/lib/containers/storage/overlay/0c866a0853c981232b357c5e25317cbdc1dd2fca31eb194ec42f6bf3fc7c7d80/merged major:0 minor:1284 fsType:overlay blockSize:0} overlay_0-130:{mountpoint:/var/lib/containers/storage/overlay/b92bfb81a8d279c699176863d47600946534a2cfd6a5a0f94c1cfb9d5bb8bfdf/merged major:0 minor:130 fsType:overlay blockSize:0} overlay_0-1308:{mountpoint:/var/lib/containers/storage/overlay/6f610e9d7da44101164346c375b0525ae74187658dcf810d9b42c59497cf1124/merged major:0 minor:1308 fsType:overlay blockSize:0} overlay_0-1309:{mountpoint:/var/lib/containers/storage/overlay/6e204bc2a70a9453e7be39e34b7be0722e66be0341d09e6753f0facb544590d6/merged major:0 minor:1309 fsType:overlay blockSize:0} overlay_0-1312:{mountpoint:/var/lib/containers/storage/overlay/7deb1e5136b28b5d072c8fbb4bb9ec6e8332a6c3c01952328a1f695210eec092/merged major:0 minor:1312 fsType:overlay blockSize:0} overlay_0-1316:{mountpoint:/var/lib/containers/storage/overlay/9786217b90515c7792787008db042e44ddabdaec22765446dad2a9b66b5e0653/merged major:0 minor:1316 fsType:overlay blockSize:0} overlay_0-1318:{mountpoint:/var/lib/containers/storage/overlay/044d0259cc562ca5881192d7d50fda7b607f28ecbb200d5c834ef7c18034b679/merged major:0 minor:1318 fsType:overlay blockSize:0} overlay_0-1331:{mountpoint:/var/lib/containers/storage/overlay/f3517111fc76dbb5016af251cbae812f160914cb5c708b4c0346827af0da5711/merged major:0 minor:1331 fsType:overlay blockSize:0} overlay_0-1336:{mountpoint:/var/lib/containers/storage/overlay/746897797a3eba7521ba20acd665573a7a90fa88b6582929f656d0c6da945b8e/merged major:0 minor:1336 fsType:overlay blockSize:0} overlay_0-1338:{mountpoint:/var/lib/containers/storage/overlay/b62d51e11ee7a6866cc6486e7ffc4b39f1d443baac6e6726defcdae636f718e1/merged major:0 minor:1338 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2494831df530bd6d51346448ef08bfa7a1e735b9c5556c4f5d784c16c5c3af08/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/1a7a1848bc7f5a9b01ccbf4a4b958d0bea769711af3956ab6d1c5e42771a0202/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-1364:{mountpoint:/var/lib/containers/storage/overlay/4da745d227ced4f971a39c457f269e9444cb72f76fd4bab6c0384643442b3f7f/merged major:0 minor:1364 fsType:overlay blockSize:0} overlay_0-1366:{mountpoint:/var/lib/containers/storage/overlay/b72ab663ea376edd5f85f42ae3b12241336ceb91ffa9fa5cc289d9dd8b8d4b92/merged major:0 minor:1366 fsType:overlay blockSize:0} overlay_0-1371:{mountpoint:/var/lib/containers/storage/overlay/949c7c2de036e64d609e76d1a64a8bc0eccb195b98ef4b8e2846b9627fd9eadf/merged major:0 minor:1371 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/496cf9c2d8a222bda00cb47b6f2a24a5b4bad2cc3fe01ac85cadb0ba5c8474a0/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-1381:{mountpoint:/var/lib/containers/storage/overlay/d6eea6e37e93a743cc1bdd949a87dfe86bb84cff0782b33edf59596e84565296/merged major:0 minor:1381 fsType:overlay blockSize:0} overlay_0-1383:{mountpoint:/var/lib/containers/storage/overlay/223802bffaefb90e52c318711c0a6a8878fa4038fefa5c7ae335846994fa1268/merged major:0 minor:1383 fsType:overlay blockSize:0} overlay_0-1392:{mountpoint:/var/lib/containers/storage/overlay/5be2038cbece73d2d9a4172ab82f801f5a62a718202dcaf54ae14f7263075334/merged major:0 minor:1392 fsType:overlay blockSize:0} overlay_0-1414:{mountpoint:/var/lib/containers/storage/overlay/cfac4333a7d4a103508f017db9ecbf9217fd84708011777f72141160ac66750d/merged major:0 minor:1414 fsType:overlay blockSize:0} overlay_0-1419:{mountpoint:/var/lib/containers/storage/overlay/25643eb94e0ab0f648a2cda1715e5fc01121d5f042517e172b20ce93edcd3407/merged major:0 minor:1419 fsType:overlay blockSize:0} overlay_0-1420:{mountpoint:/var/lib/containers/storage/overlay/86228ad361d8dc79be776461614e3b16a6d23c166f6aea3f417b32172af586c0/merged major:0 minor:1420 fsType:overlay blockSize:0} overlay_0-1422:{mountpoint:/var/lib/containers/storage/overlay/9d1684d45686a55cf0285fccc47b359af0fc0cd0bdb4e8d753ba127abfd02288/merged major:0 minor:1422 fsType:overlay blockSize:0} overlay_0-1424:{mountpoint:/var/lib/containers/storage/overlay/737762ceda34f9aa74b034cd65830228f274e356741695579e383bb64829fc20/merged major:0 minor:1424 fsType:overlay blockSize:0} overlay_0-1430:{mountpoint:/var/lib/containers/storage/overlay/9bec28975711de179e62ea7508b538bd0772f986d46f033864880dcccb429137/merged major:0 minor:1430 fsType:overlay blockSize:0} overlay_0-1442:{mountpoint:/var/lib/containers/storage/overlay/97c494b18df229cb294aec5a154aac183b3c54279477fd9fbace992adefd3d7a/merged major:0 minor:1442 fsType:overlay blockSize:0} overlay_0-145:{mountpoint:/var/lib/containers/storage/overlay/7cae7dd4c9cedda4929bc8bd9564536adc2343bbe4f54a6848552323b79ad451/merged major:0 minor:145 fsType:overlay blockSize:0} overlay_0-1457:{mountpoint:/var/lib/containers/storage/overlay/9fa1a37e72ecba4c69814829b18c2f8b3f3fb32c4b2516c292249b22699e76b4/merged major:0 minor:1457 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/835679931d8c84985c7468c8c52a0a1415d497e48ac0514beead552e255b210c/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-1464:{mountpoint:/var/lib/containers/storage/overlay/6ae973ea53cc00140f221fd7602b24ad729fc4e9abb20112247cffcc2062732b/merged major:0 minor:1464 fsType:overlay blockSize:0} overlay_0-1466:{mountpoint:/var/lib/containers/storage/overlay/707687defbb3b46aa0ec10825b6e4cec6dbe2ffcd6a7ff54af5554c2106617ea/merged major:0 minor:1466 fsType:overlay blockSize:0} overlay_0-1468:{mountpoint:/var/lib/containers/storage/overlay/dd7dc30c1180e1a6f812f9105bc3b8f13b815969f63aead4c9470e430e5b119b/merged major:0 minor:1468 fsType:overlay blockSize:0} overlay_0-1477:{mountpoint:/var/lib/containers/storage/overlay/6cf25e18fe56b6e61fa9100954e96be1546bb973b6afa4a359f01f379588b975/merged major:0 minor:1477 fsType:overlay blockSize:0} overlay_0-148:{mountpoint:/var/lib/containers/storage/overlay/ff63875273fad72757b98b76cf088c6e936fede1df3af90381c3fad113da4630/merged major:0 minor:148 fsType:overlay blockSize:0} overlay_0-1498:{mountpoint:/var/lib/containers/storage/overlay/56c01b43a875f21aab0e1dfc7998dad276df089009a4e3ed604581eaf26fd23f/merged major:0 minor:1498 fsType:overlay blockSize:0} overlay_0-150:{mountpoint:/var/lib/containers/storage/overlay/860aa0f158ed58a0180a50f6ea467ea667e0b61f48e1a975d95c228693de49df/merged major:0 minor:150 fsType:overlay blockSize:0} overlay_0-1502:{mountpoint:/var/lib/containers/storage/overlay/b69eba83481087b906b157457b53e0677665216e609abdd57f50724f2656c0b6/merged major:0 minor:1502 fsType:overlay blockSize:0} overlay_0-1504:{mountpoint:/var/lib/containers/storage/overlay/2f07d6ec0ad672d0ccf20dedd0ba898db235f395e96b7ee16123074c0a4803fd/merged major:0 minor:1504 fsType:overlay blockSize:0} overlay_0-1506:{mountpoint:/var/lib/containers/storage/overlay/981ce52bedc7fb3ae92fef8c96752f3231afe52dd0eb4ebd354db02c719143f1/merged major:0 minor:1506 fsType:overlay blockSize:0} overlay_0-1515:{mountpoint:/var/lib/containers/storage/overlay/d0752fbcb2950279b198aa920137b23f56f8bb815aa72100fd931a4c1d1eb70e/merged major:0 minor:1515 fsType:overlay blockSize:0} overlay_0-1523:{mountpoint:/var/lib/containers/storage/overlay/af0e87ef213b635fdfc73ef4151e34a268d86807969b2b55ee19719e6adef234/merged major:0 minor:1523 fsType:overlay blockSize:0} overlay_0-1525:{mountpoint:/var/lib/containers/storage/overlay/70a88e0ac65d8f1d978e7b0ab78e3d8161ecaf254976221936b8178acd5c4f63/merged major:0 minor:1525 fsType:overlay blockSize:0} overlay_0-1527:{mountpoint:/var/lib/containers/storage/overlay/ed3d92e9f7338bb44b9a6e422d62421ad3a3aae980c65b794a5346fdf01f351e/merged major:0 minor:1527 fsType:overlay blockSize:0} overlay_0-1533:{mountpoint:/var/lib/containers/storage/overlay/d16351d46ca5097779e5b7d9f075d510f60120383bb8d3e3d19e3d2701e99f17/merged major:0 minor:1533 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/98115827c0c5aa59d8ce3941f59b79ffdcfb7b2f7ecff3e7b7b5a227d3cba149/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-1545:{mountpoint:/var/lib/containers/storage/overlay/54f2bab1165d0b0b586a7a09fc68d1d7a1d30480a9649bfaf17c6cb8df55c058/merged major:0 minor:1545 fsType:overlay blockSize:0} overlay_0-1558:{mountpoint:/var/lib/containers/storage/overlay/0eedb4afd77e591a88baddc1d46a902c0b9740948dffc4bc6118b6475f2b9b46/merged major:0 minor:1558 fsType:overlay blockSize:0} overlay_0-1566:{mountpoint:/var/lib/containers/storage/overlay/9c88512a89e8351497c341233082da7e2e38a6f3da856a2cdc35b9b6a397b0a2/merged major:0 minor:1566 fsType:overlay blockSize:0} overlay_0-158:{mountpoint:/var/lib/containers/storage/overlay/34cf6f7471a9d703712b7fdf7f12ed7feb153e9806f4386fb79fad6fdd1dc57f/merged major:0 minor:158 fsType:overlay blockSize:0} overlay_0-1580:{mountpoint:/var/lib/containers/storage/overlay/f4aa7ed3701dd87754547fd909ccb92c726894201936abc82f04f9c5140fa3a9/merged major:0 minor:1580 fsType:overlay blockSize:0} overlay_0-1582:{mountpoint:/var/lib/containers/storage/overlay/c859206e078500eb4589d0fbf705d4e52cb26c732a9f411b91a7423e0e18a7ef/merged major:0 minor:1582 fsType:overlay blockSize:0} overlay_0-1598:{mountpoint:/var/lib/containers/storage/overlay/397d57c1b7712f863208722e409660208faafd32a6d0fce8226e7c58ff0b53a2/merged major:0 minor:1598 fsType:overlay blockSize:0} overlay_0-1603:{mountpoint:/var/lib/containers/storage/overlay/99f61a6475b68d0ce92c1d0baca92e250196070ab597dedc92589a5264e60d7b/merged major:0 minor:1603 fsType:overlay blockSize:0} overlay_0-1610:{mountpoint:/var/lib/containers/storage/overlay/0ee768a8cbfdb37e63e1760fbc5231e96bc71e5a11e0a9198416cac2520fedfd/merged major:0 minor:1610 fsType:overlay blockSize:0} overlay_0-1611:{mountpoint:/var/lib/containers/storage/overlay/945c324d80961d614db2ab8ad04f3be19db7867539789ab99893bcb3d38c1a84/merged major:0 minor:1611 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8b2f7e32212b2d0edec9387c7c5eb460875498c99614397b7e4a39c68e9423b7/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-1622:{mountpoint:/var/lib/containers/storage/overlay/393ffebfeb8a01423b45c21c5a5b923138e849efec54fc587502a11877f6ff1b/merged major:0 minor:1622 fsType:overlay blockSize:0} overlay_0-1627:{mountpoint:/var/lib/containers/storage/overlay/f0864b18b88e224cf0ef4e04ab6df96621c5bac7a06eb681ac8c27a47973d449/merged major:0 minor:1627 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/97b58d2040f141a6504dfec0a41719a34bba4ca5012db019fcbac655cb32f253/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-1647:{mountpoint:/var/lib/containers/storage/overlay/5b28f8d8d0786ff412b514082ef9038c09140cbb5df651ba7c7e18bcc8f046a1/merged major:0 minor:1647 fsType:overlay blockSize:0} overlay_0-1651:{mountpoint:/var/lib/containers/storage/overlay/06dc1d8e0197b0319ff7a0b09f75d432c64618a53e1968a51ece4b59f07a145b/merged major:0 minor:1651 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/4e0258771668381317191545a0d7adaf55468fb34ccbd54120405736527f8839/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-1682:{mountpoint:/var/lib/containers/storage/overlay/0b965a02166b54817396e6003b970577299c9af854be03836b16eb0e60444f02/merged major:0 minor:1682 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/b863dffb08a620601c0a96a84ab122c3e0c415002328b17b16ccb0455b885478/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-181:{mountpoint:/var/lib/containers/storage/overlay/c480ad07b14accba0b24af36c37b0c165c6b8ead33a7377d6abd43ff0d7fa705/merged major:0 minor:181 fsType:overlay blockSize:0} overlay_0-189:{mountpoint:/var/lib/containers/storage/overlay/8aaf9aae64ebd576adde6844b10559999f3c99671fdfb8eb278b8be5f8c8f372/merged major:0 minor:189 fsType:overlay blockSize:0} overlay_0-191:{mountpoint:/var/lib/containers/storage/overlay/7bde766ed52b565191b425051cb40825e0ebdc685b96d99c9329b155b9dd054c/merged major:0 minor:191 fsType:overlay blockSize:0} overlay_0-193:{mountpoint:/var/lib/containers/storage/overlay/2faa4b47fdbb31ab16f2653c5ebc1e6a06aed24f3e0dc6b4bf783d48166cc515/merged major:0 minor:193 fsType:overlay blockSize:0} overlay_0-195:{mountpoint:/var/lib/containers/storage/overlay/ff8fc2b62453e95199dc5897af1b70b3c546394282b2c547ec38ac977122097d/merged major:0 minor:195 fsType:overlay blockSize:0} overlay_0-199:{mountpoint:/var/lib/containers/storage/overlay/ef26eafd57a4553efa9ca26ef1513cad8b48a8ff172ef073f83d58dc303914b4/merged major:0 minor:199 fsType:overlay blockSize:0} overlay_0-205:{mountpoint:/var/lib/containers/storage/overlay/c9fdf61e8e5db830d415ba6849fcf0ce6bb757c89a34df50e18470face05f16b/merged major:0 minor:205 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/814db187119cdbc58b74ca7737f03c663d1ea2f264fbd07a655808a1dfc620a1/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/db8f318ac49b5c86f97709939fed045e446ed03c902b1df9d1fca89a348891f7/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/ca41322bc95b1ea83116da75ab31bbad7b80796b633b3581ac5ef63c255c725a/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/fe3ce3fe1451ad1a199add3f38ebea560b725e80c3f120325a0fc4344e907458/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-223:{mountpoint:/var/lib/containers/storage/overlay/381ea0ce2ae1e48e1ec186c2ee0f1f245271f38c5630e2c986f491d6e991bcaf/merged major:0 minor:223 fsType:overlay blockSize:0} overlay_0-224:{mountpoint:/var/lib/containers/storage/overlay/8e48128b3982e07cd7ce271547fd32fe3b683c5a578e309afe293deac1b6bd07/merged major:0 minor:224 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/f9614dbf45fce1fbd3be52a2fafa2aff587601e437f3aa66c078f5226a0394af/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/96aa2c9e3e2073d12befeb4f0cc4f5d36c30dec85b65fde54ae804d09ee72383/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/58ca04b53d95cf4432b59b7417fa3ba0edc92084674af0c19c5a4224dc1bb5d1/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/d24efa17d1560497383e7580a08cb890a376e46c630794c78e228f2b1508a7b2/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/1bde17dc99822b363880a528667d7e58e5bdfc1b0f7dcf14e769f84604c82568/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/7f49045c5c1696bacb7dcea03e543dfd0148db156bd4194e8680c768e6e7489b/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/b6902602c58635345afa001000cfebc0161b90cef6d693032232500101a6e291/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/c95cf22a88650facd96bd1c821db13e71042fad6f07b1458481a1535d640284f/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/56797a7898d855894f069a31027121974f6a737947863baabfbf44d5a61daccc/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/8b397ff5f10175fcff7a8014f574e1817fed53a9b1049ddbafaf1f8fa254d17c/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/0f685ed7fe8c5137d7b32391574902cc7889da45bffd9c525ee9ed7496d5afce/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/7594a4be2d14ee40680ec7cd367d89771b3ada3ebc521b547d8aafd73b84aa9b/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/68f9549c7ff0dd7a4431f95da1b923520470cc3d646bda455f9ccccd5d50164e/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/533000ce873b0c1e0c9611075dcfa494f70ff70f7a371516814ebff16083a53d/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/4be00e8db3a77d279c2caa717dd179fe892db075691fba620d6e4cdf3c632747/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/39fe76330c8a13f143bd2346727047afaa5efd33fbd8e41ccdd5198d4b755d28/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/1c48168ff9211069d7f572a7fab385c12934e01b71c00263fbd82687cf7d7251/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/6af428c2e90a829e89e31626152fe1c0b3aaad977370b5d50e9d21049e5c2119/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/db4a89a7275f9cd41e88e8c87ff5ee8802f1a79e12427827afd807f5fcdd738c/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/4ede2c1ea538b3ad28a20b9348c5381d37821a543df2603e3c6a3b932884c3b7/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/98f1a4ff0d6fdfc65faf1c72af86179b1ce114f535e046bddd0940f2c5dc47ad/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/12fbfb88ffc403e4f83f767dd391ac7c753b8bfce2cfaf8e5fd842643edb2840/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/e0a05c1c97798162275b8b1f0a1bc6d3c1a9720a390a3f7d7ff29484c51cb84e/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/52326ae3ee078b3dec9f938e64cd0252f8f5efc1651568cdfd904d6eae481707/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/7e66f9c7580ac516a8716be7dce4ecb9369dd2fdedcdaf0ef540c937f3324f2e/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/e82d3ff573b2bc857b280f882220705e7691394e7e360f5797227da4fccd4acf/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/41c7fcacb7d658a41ba5987d5260655d8abb7f9666b8db3c996272eba2ef4614/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/0a70aaca49ebc88a66af0535a2b132bc817f80a5a1ec6c3d52f5623ef93fdd5b/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/6bd3d6a81a074cd5df95fd42916352ec1ad236e79b5525bc4f07f10ff98091de/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/ffcde282c328225b840b96be583cb99e662660ed796419b55c04f5a76175a9f8/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/c864e5e6f70da420545fabaddd544caf273ca3fb5a211e4f4abbfbf592f6db7a/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/f67972beafc9a3bb650569c7fd34ef91d400cbd6c3f1eba6e08d7e317d7d4849/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/000b6ae29981c019426bf4ea8f14f51e6f3fb5a95bd5ce4114722164188466c7/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/0b716eac9f68d3ec6309c2ad3b16349cdb7267d761ac731f29b2b163c351a096/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/8832edf0b46303b8381cd0027f69ba800ff1e61606f8b4d2a37faa6391483d94/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/7fec5aaba04b9d83b1fb12459924730eaab5601be29d1b17ad84c0dc3a9c0456/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/8ef1f9d2d86facc542252e3bc8ac21c97cb3322dae1892c0398c6f7b72a7b916/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/8e5d097b9f63d9c80d8643e1ff4ab79874fdd659ae4d092520d4b4baddbc5e82/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/f50c91bb78154e60a3941d96cebd99f01efa10c6abb8b9fde2d32c07990952cc/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-43:{mountpoint:/var/lib/containers/storage/overlay/6b49fc329de76e0656a5a714c3a662c4491606c7ee609b7779e4cea51125b1be/merged major:0 minor:43 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/a42ba1711142f82439c2cc425e29d31dc8dded6627c3d35a78f02d2b311a14e7/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/770568ea15e1013a8f00e21f0b3be2100c490e220782e1149500bb2147990168/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-442:{mountpoint:/var/lib/containers/storage/overlay/a2df12ded0b640cf048c80385af0011696d1272b58175cb36957d286c363d9eb/merged major:0 minor:442 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/ee405febff69d358484dc1a4b4a61dc8b0b1f073032250be69796116db5a5e7e/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-444:{mountpoint:/var/lib/containers/storage/overlay/933e654f5188635b0a8438871d9344409b727a45f771a7a6b3e664d626e56935/merged major:0 minor:444 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/8359d96a9f1204b4e84a074e5466ec734222bd163ab17a8dbba81c6299e4684e/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-451:{mountpoint:/var/lib/containers/storage/overlay/8c867ef6f89cc11fc8e26b6711a9710622e1de28f03de462d45eb889efefaa46/merged major:0 minor:451 fsType:overlay blockSize:0} overlay_0-460:{mountpoint:/var/lib/containers/storage/overlay/63258fb14da62c2f10af861a0c1ec515f0 Dec 04 00:47:07.735155 master-0 kubenswrapper[33142]: e2f3c412e9bbea6d2050e3f5e1ec54/merged major:0 minor:460 fsType:overlay blockSize:0} overlay_0-462:{mountpoint:/var/lib/containers/storage/overlay/7a259334dfbb1b0b677ec2317de69206b583777e436dd524c5a9fe5114645569/merged major:0 minor:462 fsType:overlay blockSize:0} overlay_0-467:{mountpoint:/var/lib/containers/storage/overlay/a93bbd8069cabc607a908823dfbc8adcb1bbe567ee3dddfb41959f1d9fa91050/merged major:0 minor:467 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/09c5b28f6dc19e27bcec6bbe5977f8a91e99af84026fbaa9b521985bc8e64b20/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-47:{mountpoint:/var/lib/containers/storage/overlay/f54a064d03eac91726ba6bc6e4ff3b933b497ed080283ece1dce29d7ef208e7e/merged major:0 minor:47 fsType:overlay blockSize:0} overlay_0-479:{mountpoint:/var/lib/containers/storage/overlay/0b87a71e13ae1cd013a6f16027bb92bf1aae25e0b5b3fa227111c4b9c83428db/merged major:0 minor:479 fsType:overlay blockSize:0} overlay_0-484:{mountpoint:/var/lib/containers/storage/overlay/78ce643c3660a6abe5b3f0b41a09dd20aee319340e6bc4e099e6c3e3e24d75a4/merged major:0 minor:484 fsType:overlay blockSize:0} overlay_0-493:{mountpoint:/var/lib/containers/storage/overlay/38548a021488c8b9e0955c1d523474412eef75fd5a8c3aa8a2e814395b66b60d/merged major:0 minor:493 fsType:overlay blockSize:0} overlay_0-499:{mountpoint:/var/lib/containers/storage/overlay/c115c3eec114d52b999cced57f7dec4bb197d78fde577a1d7ae1204bd5d6c070/merged major:0 minor:499 fsType:overlay blockSize:0} overlay_0-50:{mountpoint:/var/lib/containers/storage/overlay/4876e989063078e6034f143379434c155e3afd875a127709cbbe6c698f281790/merged major:0 minor:50 fsType:overlay blockSize:0} overlay_0-506:{mountpoint:/var/lib/containers/storage/overlay/a8104384997c824b271a55a8b59902c10f627059e85041ea38256436a8dda93f/merged major:0 minor:506 fsType:overlay blockSize:0} overlay_0-509:{mountpoint:/var/lib/containers/storage/overlay/3b548fe54a0929ec4eee265286d98754419a8b668afe34d56ca057e0ff7307f3/merged major:0 minor:509 fsType:overlay blockSize:0} overlay_0-511:{mountpoint:/var/lib/containers/storage/overlay/1a4389c53c26a5b95d94f58083e63c0394a4be26342efb03ea7c460cec7e50bf/merged major:0 minor:511 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/1dde5db2afdcd3f254efadcfe4e1e17918ba7d22a6fcebf0953de39b29773a29/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-517:{mountpoint:/var/lib/containers/storage/overlay/0dd3105445a7dedc2f990e1bc6b6ad0841e7f1ce897b0fc712c35786b1fa5015/merged major:0 minor:517 fsType:overlay blockSize:0} overlay_0-519:{mountpoint:/var/lib/containers/storage/overlay/54fd5ded60aa780e6da33ce22f0b8f5a8a932f44f2d459863677306a25ad1b6f/merged major:0 minor:519 fsType:overlay blockSize:0} overlay_0-52:{mountpoint:/var/lib/containers/storage/overlay/71e510f98adb6c8969631027524d275d630b5283585c534d16a85789a5b0b9c3/merged major:0 minor:52 fsType:overlay blockSize:0} overlay_0-520:{mountpoint:/var/lib/containers/storage/overlay/edd0b70f8b03d85b647a0d9c1bc291250c94f5ca359cd4d06629146348b0fff2/merged major:0 minor:520 fsType:overlay blockSize:0} overlay_0-525:{mountpoint:/var/lib/containers/storage/overlay/4534b3fc793edbae4b3ebb68e4249b5f5d6ee4e017fa3ec40f0943dce1ad9dba/merged major:0 minor:525 fsType:overlay blockSize:0} overlay_0-535:{mountpoint:/var/lib/containers/storage/overlay/53acac648185c1491cc511d5e8182603836ae8093c21aac3e415cdce970e1196/merged major:0 minor:535 fsType:overlay blockSize:0} overlay_0-538:{mountpoint:/var/lib/containers/storage/overlay/ae3f17d3c0ff9bc7e5000639969ac605254bd5a5c2873e8d15381c03ea2e60ee/merged major:0 minor:538 fsType:overlay blockSize:0} overlay_0-543:{mountpoint:/var/lib/containers/storage/overlay/b60ac39f3972cb287fc3add91d797e2915fa83b3757b2d30f30fbbb6d04a6a53/merged major:0 minor:543 fsType:overlay blockSize:0} overlay_0-545:{mountpoint:/var/lib/containers/storage/overlay/d83ee54beac6342e7bcbe30bd250689da48992a70c7e1dabd4d0cfef125a792f/merged major:0 minor:545 fsType:overlay blockSize:0} overlay_0-558:{mountpoint:/var/lib/containers/storage/overlay/710d54938b2a75baba1aeb6912fedaef8a8fad72a530f5ce80ebf71679321e59/merged major:0 minor:558 fsType:overlay blockSize:0} overlay_0-56:{mountpoint:/var/lib/containers/storage/overlay/93b34f59825d75595956998f2d790df9d8d898d3e77d0fa9733199fcfe01931c/merged major:0 minor:56 fsType:overlay blockSize:0} overlay_0-562:{mountpoint:/var/lib/containers/storage/overlay/5187b95fa121fdefc9bbaf092d51a36f81952b37d423fe49b4f0a13746d62801/merged major:0 minor:562 fsType:overlay blockSize:0} overlay_0-564:{mountpoint:/var/lib/containers/storage/overlay/d5c5a5029e1a26134b62581cb3127fab587f2cdbf542824944c0ef292ba49141/merged major:0 minor:564 fsType:overlay blockSize:0} overlay_0-571:{mountpoint:/var/lib/containers/storage/overlay/6732403736dbefc2b7ab9391793316d6c513f44282b9269bd98282a7de1dd7a3/merged major:0 minor:571 fsType:overlay blockSize:0} overlay_0-58:{mountpoint:/var/lib/containers/storage/overlay/4dd509af44d727200657abdba88523c7bf5ab684beac1d1a46a8622e418e12c2/merged major:0 minor:58 fsType:overlay blockSize:0} overlay_0-589:{mountpoint:/var/lib/containers/storage/overlay/5ada74ea6bf4d4064884ac04afde38e8586230ce410d51820c512842d48673c8/merged major:0 minor:589 fsType:overlay blockSize:0} overlay_0-591:{mountpoint:/var/lib/containers/storage/overlay/acb3d6f20ba379921dd95877158e1046911f8d3d98bf23a0739d0bff194b1837/merged major:0 minor:591 fsType:overlay blockSize:0} overlay_0-602:{mountpoint:/var/lib/containers/storage/overlay/486bfecb9ff21228e32d4a69bf480d935b53c75b1b190d9b6c655968522cf41c/merged major:0 minor:602 fsType:overlay blockSize:0} overlay_0-61:{mountpoint:/var/lib/containers/storage/overlay/07ef40eab7dc6bed50cbc15d7873c89f57683fb09c7a310e595166b71f03a2b8/merged major:0 minor:61 fsType:overlay blockSize:0} overlay_0-612:{mountpoint:/var/lib/containers/storage/overlay/c43f9f99d1ab8190edc259a0723ec7b17c7ace1a224b659cc7f356698b91bcea/merged major:0 minor:612 fsType:overlay blockSize:0} overlay_0-614:{mountpoint:/var/lib/containers/storage/overlay/b70a37b672f1ab853418e3fb33de2c52fee0a8ab15d030403b6a3355860c0897/merged major:0 minor:614 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/8d9558359199db42355e7aab9b153f00bd49650ecd4f6484e110c73d5956c60e/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-637:{mountpoint:/var/lib/containers/storage/overlay/8af26c672780ddd8bcb0032339f51c1cf6d5f3b5d90f927d0a7a9fde01d0db9d/merged major:0 minor:637 fsType:overlay blockSize:0} overlay_0-639:{mountpoint:/var/lib/containers/storage/overlay/a7d086b842a17600d85426f31f1b926db60adf54648125e60f6fc5aaf75293cc/merged major:0 minor:639 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/39ed5340d3fec4d6ca97818d6328351105c9026a1f9509d07a6d4459178b486a/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-641:{mountpoint:/var/lib/containers/storage/overlay/803ece94a33edd4c887f923018ace8ee00d05ddcb47f172160e10d6190000874/merged major:0 minor:641 fsType:overlay blockSize:0} overlay_0-665:{mountpoint:/var/lib/containers/storage/overlay/89719195cd3c07fdcc68ae627b9d83e4b594ad111da789e735c8da73b3690639/merged major:0 minor:665 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/5eb08deb78f9a756ff48b48f3d3c599c2f3a358ae0573c25a34f8bdad695f984/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-684:{mountpoint:/var/lib/containers/storage/overlay/ca59c9a22536e70500217666d994db391d72d3e8e012f9bc660c40c085a22c32/merged major:0 minor:684 fsType:overlay blockSize:0} overlay_0-688:{mountpoint:/var/lib/containers/storage/overlay/e91cd43c3edaa2cc26d2bab5e17c0cf3499ea0900836f657585e9ea2e22e416b/merged major:0 minor:688 fsType:overlay blockSize:0} overlay_0-692:{mountpoint:/var/lib/containers/storage/overlay/c51da869c21d5dece8a9f5d1231cc93c78d8528a7e5ea53c4fe8695154f5ca49/merged major:0 minor:692 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8e88f170c2e2687fb0043274fc449e9297e2cab1bcd8959f8ffc110dbf90cf40/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-702:{mountpoint:/var/lib/containers/storage/overlay/83060c0ad79bb22e8efeb4fba06823ec30354bc6dacc6051697511c712cb0b42/merged major:0 minor:702 fsType:overlay blockSize:0} overlay_0-704:{mountpoint:/var/lib/containers/storage/overlay/3411af58129a7749c1f37c8939a3802a4c385a6936fac71305ae2e4629f42988/merged major:0 minor:704 fsType:overlay blockSize:0} overlay_0-706:{mountpoint:/var/lib/containers/storage/overlay/fd907cf8bf19d41da8cb0eb7ba4dd5a72fd083655317eec426ad0aead7019223/merged major:0 minor:706 fsType:overlay blockSize:0} overlay_0-708:{mountpoint:/var/lib/containers/storage/overlay/0f72d656482953d59b6a2527b25bfa849839d20842426c47271ad1b9f8322822/merged major:0 minor:708 fsType:overlay blockSize:0} overlay_0-710:{mountpoint:/var/lib/containers/storage/overlay/46cadaf5df7809182b2c54fdb70c4068917b86bbcc3afa01522c03c258ef5a7d/merged major:0 minor:710 fsType:overlay blockSize:0} overlay_0-725:{mountpoint:/var/lib/containers/storage/overlay/784d5a3febdf8b113b1a9a174dde913bda1ceeb7ebe14423b2f646d2151b5d5c/merged major:0 minor:725 fsType:overlay blockSize:0} overlay_0-728:{mountpoint:/var/lib/containers/storage/overlay/cca92448d6cb6bfe22dc4231d9b380605b897c784d15bb7f312565ff8b62a76b/merged major:0 minor:728 fsType:overlay blockSize:0} overlay_0-73:{mountpoint:/var/lib/containers/storage/overlay/b530cff583090bcf1312f7389ae701b88c2613e297fecaa8d99cc6b695436df9/merged major:0 minor:73 fsType:overlay blockSize:0} overlay_0-730:{mountpoint:/var/lib/containers/storage/overlay/410b72866d60c575b5a299036c852519f0a91dd0f4a8bab22cccc49672ae4e14/merged major:0 minor:730 fsType:overlay blockSize:0} overlay_0-75:{mountpoint:/var/lib/containers/storage/overlay/f371b8e58dedafac21fd0573ece9b63d5d47ade098f7483c0325ae5ea6122f4c/merged major:0 minor:75 fsType:overlay blockSize:0} overlay_0-750:{mountpoint:/var/lib/containers/storage/overlay/fc38379e96b368482db7c96b5502fe41e9b0823838402e1ff834b7199eaf7501/merged major:0 minor:750 fsType:overlay blockSize:0} overlay_0-757:{mountpoint:/var/lib/containers/storage/overlay/4d73c207449015ea3da13b88df061363ba7c499ca34de24f6d2497f51bc8e440/merged major:0 minor:757 fsType:overlay blockSize:0} overlay_0-759:{mountpoint:/var/lib/containers/storage/overlay/e22c2157dab85d9e9fb369578b2c0cbd45bc6652de5ab01f7217e3fa6d7d6adc/merged major:0 minor:759 fsType:overlay blockSize:0} overlay_0-766:{mountpoint:/var/lib/containers/storage/overlay/9508bff74016775081650ae2bd4dfe7c692d31a17789c298851881f346054a6d/merged major:0 minor:766 fsType:overlay blockSize:0} overlay_0-77:{mountpoint:/var/lib/containers/storage/overlay/46d3f16623c2e006a2990ecc0cfd8fae2bdc0235ce7a89dcb7b9190f7195e886/merged major:0 minor:77 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/f3d8008581425bc4130c47cba10064ea16416903b263dfcf0f0db85fbe331870/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-785:{mountpoint:/var/lib/containers/storage/overlay/de35026898e7ce30c01a873717cc52d870f468d9a4fb803f080d2ec1eab10094/merged major:0 minor:785 fsType:overlay blockSize:0} overlay_0-793:{mountpoint:/var/lib/containers/storage/overlay/c0cf5a5fe1ad296a3597d609b73dbe688bab7272fb0dda955ca12f9287c0691f/merged major:0 minor:793 fsType:overlay blockSize:0} overlay_0-795:{mountpoint:/var/lib/containers/storage/overlay/9b74fdebc0b08353a5343a68c57a6c2e36235f1172ca12e7937ec3f5c7ff9824/merged major:0 minor:795 fsType:overlay blockSize:0} overlay_0-797:{mountpoint:/var/lib/containers/storage/overlay/18c260a8b16c8954f4ab574a83c1fa9b8b516496c44e007808503627e7eeb413/merged major:0 minor:797 fsType:overlay blockSize:0} overlay_0-799:{mountpoint:/var/lib/containers/storage/overlay/e80d6e3cc649db3a676fb884fe99aa612114d34ab3deb2dd257e3f3d4ea35eed/merged major:0 minor:799 fsType:overlay blockSize:0} overlay_0-803:{mountpoint:/var/lib/containers/storage/overlay/8cdaadb282fba122306621c1cf1cc8f2dc85d639d2f95a6303aed59fe3dc36ce/merged major:0 minor:803 fsType:overlay blockSize:0} overlay_0-805:{mountpoint:/var/lib/containers/storage/overlay/8ed208701da3e147bb7afe268a0dc678751d9bf52515aa8bd6bec9689755c8a9/merged major:0 minor:805 fsType:overlay blockSize:0} overlay_0-807:{mountpoint:/var/lib/containers/storage/overlay/212621e855d534aa310e9cb0601d6da889be69caa23dca7ce22b346eea45e520/merged major:0 minor:807 fsType:overlay blockSize:0} overlay_0-812:{mountpoint:/var/lib/containers/storage/overlay/b49bc3372583edf0f3d947ee34215decb5ee1a336c9442decd28a22a907d5abf/merged major:0 minor:812 fsType:overlay blockSize:0} overlay_0-815:{mountpoint:/var/lib/containers/storage/overlay/41d433171ef85e7cdebb305ba8037a9fbecdb5b90b7dfa32fca052de66766090/merged major:0 minor:815 fsType:overlay blockSize:0} overlay_0-819:{mountpoint:/var/lib/containers/storage/overlay/3a21d9fd759f980af638a74c497bc5a80f9a471fd17d01dd988bbf75d45e25b4/merged major:0 minor:819 fsType:overlay blockSize:0} overlay_0-821:{mountpoint:/var/lib/containers/storage/overlay/90bdcb6881f6a75e608a34aa09c92655939ae9dec52eeef96ae953efe34a825e/merged major:0 minor:821 fsType:overlay blockSize:0} overlay_0-823:{mountpoint:/var/lib/containers/storage/overlay/3d30931cec552d6871c49296a4ab71843453da5ad74ddff6f378d8971ed5fe49/merged major:0 minor:823 fsType:overlay blockSize:0} overlay_0-827:{mountpoint:/var/lib/containers/storage/overlay/cbb5e3b0ae720fd88d2b39b0d0991cf427c658ac6dca8e3fdaa6ef2b1bac4d22/merged major:0 minor:827 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/06e1c4b7273d7ece296aa583ed4abdf9b2b828ccf2df499fc1af5cd474b84a3b/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-835:{mountpoint:/var/lib/containers/storage/overlay/ad551e34b2acfbfd5c7d8b2019a3220a2898b1985858309946c9265a46dac6f1/merged major:0 minor:835 fsType:overlay blockSize:0} overlay_0-844:{mountpoint:/var/lib/containers/storage/overlay/f7dc940bcd2d606bb153e6e3cf9c0322c9bd8d5445c3b7ec2d248b4012456864/merged major:0 minor:844 fsType:overlay blockSize:0} overlay_0-846:{mountpoint:/var/lib/containers/storage/overlay/cf6895a61fe7dbed40b0b9a40b9495fbd6a0800df7a575b0981741c853ae1b7a/merged major:0 minor:846 fsType:overlay blockSize:0} overlay_0-848:{mountpoint:/var/lib/containers/storage/overlay/af690be5b5c7ca1883450cbd48a51f72354b1b3854f3246f8d953a1c6243d988/merged major:0 minor:848 fsType:overlay blockSize:0} overlay_0-850:{mountpoint:/var/lib/containers/storage/overlay/04c131ee9c4f97c11575c174db50f64693a23d1b9fd2afdc08cda6ab1dd810b1/merged major:0 minor:850 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/3f479f9f0f5571fdf716eb587969797e1d0bbffe3f69915be50b459a6ff99a04/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-860:{mountpoint:/var/lib/containers/storage/overlay/73c12189ffdd00f7079753ff7304ed293f853e581d13d964cc0b15896214b41f/merged major:0 minor:860 fsType:overlay blockSize:0} overlay_0-873:{mountpoint:/var/lib/containers/storage/overlay/55a81b74ce2e7955982a24aa6f7e765fdabec47cf32e6d507ff9e5eef72b9faa/merged major:0 minor:873 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5124c671bad426299b045e78bf4a3d4f194d4a57d2ab2597f40616f4e264eab6/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-884:{mountpoint:/var/lib/containers/storage/overlay/af596f62fffe3cb0ab21a63cccf675b389ed909144e04550eb3d12e2272380ea/merged major:0 minor:884 fsType:overlay blockSize:0} overlay_0-895:{mountpoint:/var/lib/containers/storage/overlay/896e74fe308a701936eeb78539168c5d623a1cc7bbae489d01b3bfb10662f770/merged major:0 minor:895 fsType:overlay blockSize:0} overlay_0-900:{mountpoint:/var/lib/containers/storage/overlay/d003440d0b9d26bcd142cd42236631f8fc05cc7e11d090f7c29bf0efb3134cfe/merged major:0 minor:900 fsType:overlay blockSize:0} overlay_0-906:{mountpoint:/var/lib/containers/storage/overlay/3e058d440eaeb303fb8c77116f9c368f9fbbc36afabdc60ee12f0525807ffda6/merged major:0 minor:906 fsType:overlay blockSize:0} overlay_0-930:{mountpoint:/var/lib/containers/storage/overlay/dbfbca4f6a130b943658bf63156bcbd0b98a021c9ea5f0b790093eaaa16889b4/merged major:0 minor:930 fsType:overlay blockSize:0} overlay_0-934:{mountpoint:/var/lib/containers/storage/overlay/ce0ccf27433ca7511db932f246592cacb8550209db00498925d7d309b2f6f094/merged major:0 minor:934 fsType:overlay blockSize:0} overlay_0-936:{mountpoint:/var/lib/containers/storage/overlay/92d44d32c3d2f7fedb3090a5dc560e60f11567c7fd5780ddb9d22a8007a6575e/merged major:0 minor:936 fsType:overlay blockSize:0} overlay_0-941:{mountpoint:/var/lib/containers/storage/overlay/5d72e81af444e6f2d29a634479c4b2313ba3e680fd3bd402c0581201a6e1aff9/merged major:0 minor:941 fsType:overlay blockSize:0} overlay_0-943:{mountpoint:/var/lib/containers/storage/overlay/ff584a8d64bc89d2fced00d0c9f004d92dfc713f7c135bc8e07615e89f590aac/merged major:0 minor:943 fsType:overlay blockSize:0} overlay_0-945:{mountpoint:/var/lib/containers/storage/overlay/bf3b314a0251bbadb3690e50c01fabfa3eef50860c03a260ba7122d10068301b/merged major:0 minor:945 fsType:overlay blockSize:0} overlay_0-95:{mountpoint:/var/lib/containers/storage/overlay/481e2e42dbd17b1c4707ef53569083403de5a32b4e902674d0095322e9a820b9/merged major:0 minor:95 fsType:overlay blockSize:0} overlay_0-952:{mountpoint:/var/lib/containers/storage/overlay/223853f191cd28bb01abd31637d71622f505c5432ac54246022c788d7c265ca0/merged major:0 minor:952 fsType:overlay blockSize:0} overlay_0-957:{mountpoint:/var/lib/containers/storage/overlay/9b111846217d0626f4bc211f4994cf1c4bb13ba70ae48cc97e79a94715cb50da/merged major:0 minor:957 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/096747e58337cc80c4eb8cadd22c63e48530df6f55d66763576533cf5f418f52/merged major:0 minor:96 fsType:overlay blockSize:0} overlay_0-962:{mountpoint:/var/lib/containers/storage/overlay/511d975304faead3e47598a123b7eaf4967f59feb8f24941e7ab2e3e44210d42/merged major:0 minor:962 fsType:overlay blockSize:0} overlay_0-964:{mountpoint:/var/lib/containers/storage/overlay/82a4481397f199262a3acd9f0ce45b41f0e8f3b011ed3dfebc78f12378e1ff7d/merged major:0 minor:964 fsType:overlay blockSize:0} overlay_0-967:{mountpoint:/var/lib/containers/storage/overlay/478fb36abbf97b6b4e9875455d4454b99921a751cd807a3eec6934689ea22adb/merged major:0 minor:967 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/58137f59997e90fc9ad18e53fb727876b47695eb622988ff127fcc13dbfb51e9/merged major:0 minor:98 fsType:overlay blockSize:0} overlay_0-990:{mountpoint:/var/lib/containers/storage/overlay/6f0d72435476030e98b2227726d7733c6bdc210b7ce752006fa66ef16bed13ea/merged major:0 minor:990 fsType:overlay blockSize:0} overlay_0-995:{mountpoint:/var/lib/containers/storage/overlay/0cca83d30d6ebc448aedac2b34d9e1f9df2d2c9c1a072cd0fd1c6db59319176c/merged major:0 minor:995 fsType:overlay blockSize:0}] Dec 04 00:47:07.786579 master-0 kubenswrapper[33142]: I1204 00:47:07.785124 33142 manager.go:217] Machine: {Timestamp:2025-12-04 00:47:07.784110519 +0000 UTC m=+0.186112379 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:eb95431843ee4cf58882520b84731300 SystemUUID:eb954318-43ee-4cf5-8882-520b84731300 BootID:b925b56b-e641-48cc-9935-878f5ab258fa Filesystems:[{Device:/run/containers/storage/overlay-containers/bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2/userdata/shm DeviceMajor:0 DeviceMinor:416 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1252 DeviceMajor:0 DeviceMinor:1252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-750 DeviceMajor:0 DeviceMinor:750 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:308 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert DeviceMajor:0 DeviceMinor:156 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:868 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3e0105457378e7432c177589892734a13bb9dfef188b04685e76db7bf4f09429/userdata/shm DeviceMajor:0 DeviceMinor:1156 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~projected/kube-api-access-59vsq DeviceMajor:0 DeviceMinor:294 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b67b9d50d899e5a64493410038447a1d3c6621b8f7e5bf837d77b9ba67d41a60/userdata/shm DeviceMajor:0 DeviceMinor:630 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~projected/kube-api-access-p2g6h DeviceMajor:0 DeviceMinor:1407 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-191 DeviceMajor:0 DeviceMinor:191 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-793 DeviceMajor:0 DeviceMinor:793 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1263 DeviceMajor:0 DeviceMinor:1263 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-807 DeviceMajor:0 DeviceMinor:807 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b/userdata/shm DeviceMajor:0 DeviceMinor:1578 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1108 DeviceMajor:0 DeviceMinor:1108 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~projected/kube-api-access-9zdwv DeviceMajor:0 DeviceMinor:1043 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f192f85af4cbdeff0073384888cdf9db08a401d3269e978db43452b2b4dfc4b2/userdata/shm DeviceMajor:0 DeviceMinor:1154 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1414 DeviceMajor:0 DeviceMinor:1414 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c5e61395f5259dae0795f685839a5b85e61acaf8cf28df1ea80ec8772166b47b/userdata/shm DeviceMajor:0 DeviceMinor:143 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-945 DeviceMajor:0 DeviceMinor:945 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-990 DeviceMajor:0 DeviceMinor:990 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/srv-cert DeviceMajor:0 DeviceMinor:770 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:779 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-484 DeviceMajor:0 DeviceMinor:484 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-702 DeviceMajor:0 DeviceMinor:702 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~projected/kube-api-access-khxjm DeviceMajor:0 DeviceMinor:503 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:464 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1101 DeviceMajor:0 DeviceMinor:1101 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:534 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6879ac09aaa2d730e48f5ea1c9483a45a6bd6bdf867d7a461fd1a0383e52031a/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/21f59e2f616354c5dce662066adb1adec765fa60d5962ec8b15361b4e51d77d5/userdata/shm DeviceMajor:0 DeviceMinor:1410 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c82e8fd0358774739f3251776273a116e7f10205ffc1866234640ba87153a885/userdata/shm DeviceMajor:0 DeviceMinor:939 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-962 DeviceMajor:0 DeviceMinor:962 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1331 DeviceMajor:0 DeviceMinor:1331 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:596 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:287 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5715fdf3152dd6de7e95c4954902b11521c06efbe12fad66f17c885f68226827/userdata/shm DeviceMajor:0 DeviceMinor:755 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1622 DeviceMajor:0 DeviceMinor:1622 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:124 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-112 DeviceMajor:0 DeviceMinor:112 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e77c62a2273f76fc1c8f39342ac07511df3a8595262b77b7ecf8729a4463d81/userdata/shm DeviceMajor:0 DeviceMinor:1134 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1383 DeviceMajor:0 DeviceMinor:1383 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/666fd82fffc3377dbf8f53f5d6bd61f6ca08b8641a9c181a0466b6931690d020/userdata/shm DeviceMajor:0 DeviceMinor:1500 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-688 DeviceMajor:0 DeviceMinor:688 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-684 DeviceMajor:0 DeviceMinor:684 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~secret/proxy-tls DeviceMajor:0 DeviceMinor:979 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1278 DeviceMajor:0 DeviceMinor:1278 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f52afddf7972bfc9a6a674f8519b70d4653c25e82efb68e4f4101afd3f93c76e/userdata/shm DeviceMajor:0 DeviceMinor:176 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~projected/kube-api-access-bnmjf DeviceMajor:0 DeviceMinor:727 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1080 DeviceMajor:0 DeviceMinor:1080 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1282 DeviceMajor:0 DeviceMinor:1282 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-795 DeviceMajor:0 DeviceMinor:795 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8a5721ad-a077-439a-9ec0-57d90dfb5c14/volumes/kubernetes.io~projected/kube-api-access-9rsg2 DeviceMajor:0 DeviceMinor:298 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-511 DeviceMajor:0 DeviceMinor:511 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96f9ea3b5bc4d360e73058baf8b809abcaa5af378d5ddb713a2a0d58b0fd9a1f/userdata/shm DeviceMajor:0 DeviceMinor:1141 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1466 DeviceMajor:0 DeviceMinor:1466 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert DeviceMajor:0 DeviceMinor:286 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-844 DeviceMajor:0 DeviceMinor:844 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1240 DeviceMajor:0 DeviceMinor:1240 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~projected/kube-api-access-xbks2 DeviceMajor:0 DeviceMinor:1490 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1034 DeviceMajor:0 DeviceMinor:1034 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-591 DeviceMajor:0 DeviceMinor:591 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-821 DeviceMajor:0 DeviceMinor:821 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/36ec0bdcbf1a701c9ece99a34585537dc1c1629a55f30d96130a04f8375f33dd/userdata/shm DeviceMajor:0 DeviceMinor:556 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:314 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ecd0f20504abdfb430741aa3b15576ee18b8330c34c603ab9660ede3b62e13a/userdata/shm DeviceMajor:0 DeviceMinor:1146 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-957 DeviceMajor:0 DeviceMinor:957 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1610 DeviceMajor:0 DeviceMinor:1610 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:313 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-637 DeviceMajor:0 DeviceMinor:637 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2ad96246-c53a-4016-b67d-5e9d66f40d5b/volumes/kubernetes.io~projected/kube-api-access-kpp6c DeviceMajor:0 DeviceMinor:157 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:289 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1162 DeviceMajor:0 DeviceMinor:1162 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:1408 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d8b0bfcb1f254f2965a6d490e639dab33880c6215722caac45545e73f80ceb71/userdata/shm DeviceMajor:0 DeviceMinor:179 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:772 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:922 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-766 DeviceMajor:0 DeviceMinor:766 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:1487 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:587 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1494f0c416806b4e377d14ec0ab5eede83509529997140d5011326ab348d81f4/userdata/shm DeviceMajor:0 DeviceMinor:605 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-803 DeviceMajor:0 DeviceMinor:803 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1582 DeviceMajor:0 DeviceMinor:1582 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1284 DeviceMajor:0 DeviceMinor:1284 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~projected/kube-api-access-5hkrq DeviceMajor:0 DeviceMinor:317 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/285a1e74-1d8e-452e-a5a4-484afc10e10f/volumes/kubernetes.io~projected/kube-api-access-6q4sq DeviceMajor:0 DeviceMinor:293 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/encryption-config DeviceMajor:0 DeviceMinor:623 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/srv-cert DeviceMajor:0 DeviceMinor:773 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~secret/package-server-manager-serving-cert DeviceMajor:0 DeviceMinor:774 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c79edcd7-4399-4ded-9b03-9084ad9e14b4/volumes/kubernetes.io~projected/kube-api-access-ptzsg DeviceMajor:0 DeviceMinor:300 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/d5f22827-c301-4584-b999-0a1cc1033bb5/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:307 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f823aaf13d7c888b824b2c10fc2de66cf8308c6c3494283c72f8adbd8dfee66c/userdata/shm DeviceMajor:0 DeviceMinor:140 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1611 DeviceMajor:0 DeviceMinor:1611 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1318 DeviceMajor:0 DeviceMinor:1318 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-710 DeviceMajor:0 DeviceMinor:710 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:753 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3e5012fe-fc48-4b6d-a075-fa94266ba90d/volumes/kubernetes.io~projected/kube-api-access-g42cq DeviceMajor:0 DeviceMinor:1402 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1457 DeviceMajor:0 DeviceMinor:1457 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-145 DeviceMajor:0 DeviceMinor:145 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b95b14d5-c3da-4aa7-9574-5cafff04192a/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:896 Capacity:200003584 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-110 DeviceMajor:0 DeviceMinor:110 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:311 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-815 DeviceMajor:0 DeviceMinor:815 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1603 DeviceMajor:0 DeviceMinor:1603 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-934 DeviceMajor:0 DeviceMinor:934 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/abfaadf145710790530c02ef8c8dd79a8eb5c62d43843366559b421d6b455c0d/userdata/shm DeviceMajor:0 DeviceMinor:628 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9e44f827971c5de6e2ffd8d00a7ed2a83ed2d5e6d99872714bc47084b5d9938/userdata/shm DeviceMajor:0 DeviceMinor:610 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e85684df-0014-4d28-9b00-9c6a6942cc94/volumes/kubernetes.io~projected/kube-api-access-ssjgh DeviceMajor:0 DeviceMinor:754 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-850 DeviceMajor:0 DeviceMinor:850 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1309 DeviceMajor:0 DeviceMinor:1309 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ffe9d26b-34e2-4506-9c38-69b85ab210a1/volumes/kubernetes.io~projected/kube-api-access-xcpnq DeviceMajor:0 DeviceMinor:292 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1061 DeviceMajor:0 DeviceMinor:1061 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-589 DeviceMajor:0 DeviceMinor:589 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:310 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ca8eddb5-4600-4058-94d2-5d0308c32613/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:315 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-602 DeviceMajor:0 DeviceMinor:602 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-930 DeviceMajor:0 DeviceMinor:930 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~projected/kube-api-access-nctgw DeviceMajor:0 DeviceMinor:1489 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-517 DeviceMajor:0 DeviceMinor:517 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-499 DeviceMajor:0 DeviceMinor:499 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1020 DeviceMajor:0 DeviceMinor:1020 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-205 DeviceMajor:0 DeviceMinor:205 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/947d85cc3ae2c98d718ec3f060f7aafd3ba683f95b4e7bb50cf7e1ef470e1c7a/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert DeviceMajor:0 DeviceMinor:413 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4ee3dd7cd38da2c920657ce4d7b82c0b34d9d38275312a1c0eadf1bcf0b5d640/userdata/shm DeviceMajor:0 DeviceMinor:486 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-77 DeviceMajor:0 DeviceMinor:77 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1207 DeviceMajor:0 DeviceMinor:1207 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1065 DeviceMajor:0 DeviceMinor:1065 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11/volumes/kubernetes.io~projected/kube-api-access-2s4mf DeviceMajor:0 DeviceMinor:302 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/dc7bfc47-972c-4493-8372-f211c6645ff5/volumes/kubernetes.io~projected/kube-api-access-pc2xd DeviceMajor:0 DeviceMinor:487 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52f656c6701b64f3eb5181c0b0fd4550d4b20ce73f741ff988f2cd1ac210fc50/userdata/shm DeviceMajor:0 DeviceMinor:784 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ab2d6d8a059c654f74817818ff397f2a855b895addaa03a832e8c9d5f53052a/userdata/shm DeviceMajor:0 DeviceMinor:1494 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-189 DeviceMajor:0 DeviceMinor:189 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:523 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-43 DeviceMajor:0 DeviceMinor:43 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-848 DeviceMajor:0 DeviceMinor:848 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-964 DeviceMajor:0 DeviceMinor:964 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-150 DeviceMajor:0 DeviceMinor:150 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~secret/proxy-tls DeviceMajor:0 DeviceMinor:1326 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:291 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/004c989d-6ae8-4147-8355-af1118fe6a98/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:777 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/975f6a6f-1fbb-49e1-8a0a-722586355364/volumes/kubernetes.io~projected/kube-api-access-jt9j7 DeviceMajor:0 DeviceMinor:985 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls DeviceMajor:0 DeviceMinor:108 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~secret/webhook-certs DeviceMajor:0 DeviceMinor:405 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:303 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-130 DeviceMajor:0 DeviceMinor:130 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3fe4a6cd4cada46a728249b8c43a7c74f080b5f782c7415dc019cf4f1ea4ead6/userdata/shm DeviceMajor:0 DeviceMinor:780 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1224 DeviceMajor:0 DeviceMinor:1224 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:1403 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1419 DeviceMajor:0 DeviceMinor:1419 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-61 DeviceMajor:0 DeviceMinor:61 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1420 DeviceMajor:0 DeviceMinor:1420 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0844b9edd5dc0a0b63b8d6a005285e78b5673fe5ecdfbae4b1074fa408750c4b/userdata/shm DeviceMajor:0 DeviceMinor:429 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-562 DeviceMajor:0 DeviceMinor:562 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d5b8039b2e09b8e957343170e87c62b622821dee52fef43a91e443c213a1a25/userdata/shm DeviceMajor:0 DeviceMinor:597 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1533 DeviceMajor:0 DeviceMinor:1533 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1316 DeviceMajor:0 DeviceMinor:1316 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/257bffb545b929a1026ed765e629c1d8cb3fe83ab63170852289afc389cd387e/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:976 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1442 DeviceMajor:0 DeviceMinor:1442 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1172 DeviceMajor:0 DeviceMinor:1172 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-571 DeviceMajor:0 DeviceMinor:571 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/dd621016-f4f2-4839-aae0-a804e6023423/volumes/kubernetes.io~projected/kube-api-access-6vpnm DeviceMajor:0 DeviceMinor:327 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1430 DeviceMajor:0 DeviceMinor:1430 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/node-bootstrap-token DeviceMajor:0 DeviceMinor:1459 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-52 DeviceMajor:0 DeviceMinor:52 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-704 DeviceMajor:0 DeviceMinor:704 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/kube-api-access-25sts DeviceMajor:0 DeviceMinor:619 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-759 DeviceMajor:0 DeviceMinor:759 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1168 DeviceMajor:0 DeviceMinor:1168 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1504 DeviceMajor:0 DeviceMinor:1504 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1527 DeviceMajor:0 DeviceMinor:1527 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-520 DeviceMajor:0 DeviceMinor:520 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/6bf75491-0c03-4e02-9074-c9be808badd4/volumes/kubernetes.io~projected/kube-api-access-qt7lk DeviceMajor:0 DeviceMinor:1019 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1078 DeviceMajor:0 DeviceMinor:1078 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-467 DeviceMajor:0 DeviceMinor:467 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1381 DeviceMajor:0 DeviceMinor:1381 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1174 DeviceMajor:0 DeviceMinor:1174 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-860 DeviceMajor:0 DeviceMinor:860 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b900991f-c6ec-45d1-a76b-44aec0f56cde/volumes/kubernetes.io~projected/kube-api-access-vg2zj DeviceMajor:0 DeviceMinor:109 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-56 DeviceMajor:0 DeviceMinor:56 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-952 DeviceMajor:0 DeviceMinor:952 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a2fd3bdb7364347566a428315934c8eb45e73b343f9ec75b13c63365c3f03f2f/userdata/shm DeviceMajor:0 DeviceMinor:1412 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~projected/kube-api-access-fvdw4 DeviceMajor:0 DeviceMinor:1401 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/20835c26-301c-423e-b534-ec2a5e5af953/volumes/kubernetes.io~projected/kube-api-access-jms7r DeviceMajor:0 DeviceMinor:428 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-120 DeviceMajor:0 DeviceMinor:120 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~projected/kube-api-access-5rb5q DeviceMajor:0 DeviceMinor:624 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4b85650970d13e0eaa60992e9aecaaeb5440711d6216154b4b078601628c8c28/userdata/shm DeviceMajor:0 DeviceMinor:1144 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1523 DeviceMajor:0 DeviceMinor:1523 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:621 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/87adb521-b8d3-4201-b775-50c8c03956fc/volumes/kubernetes.io~projected/kube-api-access-sslx5 DeviceMajor:0 DeviceMinor:1016 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d0a498d3e7745b029a9ccbc522382451a9f39458989bae4d146b3807f1e115e/userdata/shm DeviceMajor:0 DeviceMinor:1140 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~secret/certs DeviceMajor:0 DeviceMinor:1460 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1515 DeviceMajor:0 DeviceMinor:1515 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-460 DeviceMajor:0 DeviceMinor:460 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:1576 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/45f9a09db31f40f2dccae53d50be107adfa75353c0d0828f114f7dc60b7d0c6c/userdata/shm DeviceMajor:0 DeviceMinor:1416 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/8d4d3057-9f71-4b07-b463-51cc49d28bf3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:1400 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-199 DeviceMajor:0 DeviceMinor:199 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/33cf50dddcd93f720ca2efeba9e6e7f9c2f4ad9ce4ace46bbe2653eb9453a59c/userdata/shm DeviceMajor:0 DeviceMinor:783 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1136 DeviceMajor:0 DeviceMinor:1136 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff8b5b9303e43fcc883bb2166451abed643509b637da29797f777be961c99f67/userdata/shm DeviceMajor:0 DeviceMinor:132 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:1488 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3e104a8c-66dc-4a9a-836f-656e6f4cc923/volumes/kubernetes.io~projected/kube-api-access-k4vtt DeviceMajor:0 DeviceMinor:1327 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1392 DeviceMajor:0 DeviceMinor:1392 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1502 DeviceMajor:0 DeviceMinor:1502 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1627 DeviceMajor:0 DeviceMinor:1627 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a6a2308d-6d6f-4e8d-a6db-d931a172ed55/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls DeviceMajor:0 DeviceMinor:988 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7d3c9170-b36d-4052-8ae9-9e549611dbd8/volumes/kubernetes.io~projected/kube-api-access-gwvj6 DeviceMajor:0 DeviceMinor:496 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-823 DeviceMajor:0 DeviceMinor:823 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/volumes/kubernetes.io~secret/machine-approver-tls DeviceMajor:0 DeviceMinor:701 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1222 DeviceMajor:0 DeviceMinor:1222 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1231 DeviceMajor:0 DeviceMinor:1231 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:309 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2dc8ab6f03770ec3fcd4c4d814b86bb98342fbc4e33aae0acbc9f87f7007ddb9/userdata/shm DeviceMajor:0 DeviceMinor:1379 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-50 DeviceMajor:0 DeviceMinor:50 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-757 DeviceMajor:0 DeviceMinor:757 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1196 DeviceMajor:0 DeviceMinor:1196 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16/volumes/kubernetes.io~projected/kube-api-access-cfcxz DeviceMajor:0 DeviceMinor:983 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1170 DeviceMajor:0 DeviceMinor:1170 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-58 DeviceMajor:0 DeviceMinor:58 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/088d3a2c938b2889baa23f45b950ce1165fe4aca7c37019fefb262ddeb7dfc3b/userdata/shm DeviceMajor:0 DeviceMinor:781 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b7e6ab5b506ae2c960000c966311ec82b809880475963053bb40c8de107ba951/userdata/shm DeviceMajor:0 DeviceMinor:345 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e0b72e52dac150f1ad995043cf07f60db4f72faeed42d70d8fc4c8e258d6073/userdata/shm DeviceMajor:0 DeviceMinor:488 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-639 DeviceMajor:0 DeviceMinor:639 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1651 DeviceMajor:0 DeviceMinor:1651 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:318 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-509 DeviceMajor:0 DeviceMinor:509 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-827 DeviceMajor:0 DeviceMinor:827 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1220 DeviceMajor:0 DeviceMinor:1220 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1366 DeviceMajor:0 DeviceMinor:1366 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3e687558ac9303feb73670490b1fecaf558fff432fa6eb10eb8333dd042f763b/userdata/shm DeviceMajor:0 DeviceMinor:46 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90ed9daa7cbec3e4d8d6792a88565ca749faabdf92d76bf6ab6deefe4bc7fd47/userdata/shm DeviceMajor:0 DeviceMinor:160 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90e43e605a7b13e8795ad4b65e81907dea72ce3361c3aff37eb15649d2abc875/userdata/shm DeviceMajor:0 DeviceMinor:1362 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/727020b5-1084-48ac-9aed-549e4eabbf81/volumes/kubernetes.io~projected/kube-api-access-68d85 DeviceMajor:0 DeviceMinor:1461 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1338 DeviceMajor:0 DeviceMinor:1338 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~projected/kube-api-access-xtxx7 DeviceMajor:0 DeviceMinor:202 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1205 DeviceMajor:0 DeviceMinor:1205 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1148 DeviceMajor:0 DeviceMinor:1148 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~secret/catalogserver-certs DeviceMajor:0 DeviceMinor:617 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/060f2a39-e40c-495b-885d-5acd967e6c25/volumes/kubernetes.io~projected/kube-api-access-9kssf DeviceMajor:0 DeviceMinor:386 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/kube-api-access-9lrjl DeviceMajor:0 DeviceMinor:295 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/f190ddab-e7d0-4dd6-8bb7-359a02393259/volumes/kubernetes.io~projected/kube-api-access-s89j7 DeviceMajor:0 DeviceMinor:746 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~projected/kube-api-access-j7vtf DeviceMajor:0 DeviceMinor:1045 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-730 DeviceMajor:0 DeviceMinor:730 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1498 DeviceMajor:0 DeviceMinor:1498 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-941 DeviceMajor:0 DeviceMinor:941 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1192 DeviceMajor:0 DeviceMinor:1192 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f2f01d68-92ae-45b8-8501-645e439b5295/volumes/kubernetes.io~projected/kube-api-access-vlv5m DeviceMajor:0 DeviceMinor:299 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-558 DeviceMajor:0 DeviceMinor:558 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-692 DeviceMajor:0 DeviceMinor:692 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-873 DeviceMajor:0 DeviceMinor:873 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1545 DeviceMajor:0 DeviceMinor:1545 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:168 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~projected/kube-api-access-gx5r9 DeviceMajor:0 DeviceMinor:175 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~projected/kube-api-access-fvkp2 DeviceMajor:0 DeviceMinor:301 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-525 DeviceMajor:0 DeviceMinor:525 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1099 DeviceMajor:0 Dev Dec 04 00:47:07.787211 master-0 kubenswrapper[33142]: iceMinor:1099 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/volumes/kubernetes.io~projected/kube-api-access-pv8dv DeviceMajor:0 DeviceMinor:1131 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1566 DeviceMajor:0 DeviceMinor:1566 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-451 DeviceMajor:0 DeviceMinor:451 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0616abbd-748a-4451-96b7-df0178c99e8f/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:174 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1280 DeviceMajor:0 DeviceMinor:1280 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1055 DeviceMajor:0 DeviceMinor:1055 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b7f9fde08392c65ce1c3c95f566f8400383b906d186df46ad254525d83c87159/userdata/shm DeviceMajor:0 DeviceMinor:629 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1525 DeviceMajor:0 DeviceMinor:1525 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~projected/kube-api-access-xvw7p DeviceMajor:0 DeviceMinor:297 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:586 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-819 DeviceMajor:0 DeviceMinor:819 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-967 DeviceMajor:0 DeviceMinor:967 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:312 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4939b21289b30f741e5b063601cba30ecee1e657055a7fef29dabdb7ced8760/userdata/shm DeviceMajor:0 DeviceMinor:635 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~projected/kube-api-access-qlsmd DeviceMajor:0 DeviceMinor:1355 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76afcc1baac790941176f63f8d06f7c412d646005bb783f15828d233ab561049/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~projected/kube-api-access-k9v27 DeviceMajor:0 DeviceMinor:1493 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-519 DeviceMajor:0 DeviceMinor:519 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-846 DeviceMajor:0 DeviceMinor:846 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-538 DeviceMajor:0 DeviceMinor:538 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/4b5c0b0e-6015-473f-b7b8-0e91900cd82d/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:622 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-797 DeviceMajor:0 DeviceMinor:797 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ef7d4ba8ec9cf9ac37514e74016436d6373a39e9511985bd4b5cc98cd597af2/userdata/shm DeviceMajor:0 DeviceMinor:1017 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:1574 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/kube-api-access-4k5xk DeviceMajor:0 DeviceMinor:316 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/278f4b6d18c3dff2a31d66fba4e29fab6ef18d7c261452df63497a5c531805a2/userdata/shm DeviceMajor:0 DeviceMinor:435 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-73 DeviceMajor:0 DeviceMinor:73 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3e901355-2d0f-46f9-9d64-c4bc900b1839/volumes/kubernetes.io~projected/kube-api-access-vd9fr DeviceMajor:0 DeviceMinor:326 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/95141f9b-b6b0-40dc-a6e2-b5c84d24caac/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert DeviceMajor:0 DeviceMinor:982 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~projected/kube-api-access-h6tj6 DeviceMajor:0 DeviceMinor:1130 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:1486 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-706 DeviceMajor:0 DeviceMinor:706 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d933d3b1b2933dc3a528b899375a15a1dc76d4ce7e9072c0061d68d03ebab0a/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6217f2bc0698da150da0b5ca903bb28eb85928e52ad95a629a6c8f3150d507e9/userdata/shm DeviceMajor:0 DeviceMinor:337 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e8375dfa-3a83-415b-bce5-0819a73255c1/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:600 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/ca-certs DeviceMajor:0 DeviceMinor:553 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/volumes/kubernetes.io~projected/kube-api-access-56gxb DeviceMajor:0 DeviceMinor:440 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1072 DeviceMajor:0 DeviceMinor:1072 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a9ddd66390fada061f4e278a63a615e0bf50f12283f5b7f050c553d832c98f3/userdata/shm DeviceMajor:0 DeviceMinor:495 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-728 DeviceMajor:0 DeviceMinor:728 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-462 DeviceMajor:0 DeviceMinor:462 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1682 DeviceMajor:0 DeviceMinor:1682 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~projected/kube-api-access-58w7s DeviceMajor:0 DeviceMinor:1047 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1069 DeviceMajor:0 DeviceMinor:1069 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-995 DeviceMajor:0 DeviceMinor:995 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~projected/kube-api-access-zn7tr DeviceMajor:0 DeviceMinor:322 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-118 DeviceMajor:0 DeviceMinor:118 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1647 DeviceMajor:0 DeviceMinor:1647 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-95 DeviceMajor:0 DeviceMinor:95 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c88563b57a2b2f50e432a799c6dad94f7e66dc14230becc3dfc6c5396080ec0/userdata/shm DeviceMajor:0 DeviceMinor:1157 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/apiservice-cert DeviceMajor:0 DeviceMinor:555 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:1404 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/83e0d056-186c-4067-b586-14fe2970fcc0/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:1406 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1468 DeviceMajor:0 DeviceMinor:1468 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-193 DeviceMajor:0 DeviceMinor:193 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1114 DeviceMajor:0 DeviceMinor:1114 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1424 DeviceMajor:0 DeviceMinor:1424 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a7c330fa41555001019fb2fe41daf039188d9f9b4c2210b7705447b35ed0b7d8/userdata/shm DeviceMajor:0 DeviceMinor:128 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:319 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/46a9c1fd-6e78-4d87-85ef-f8fc195bb980/volumes/kubernetes.io~secret/image-registry-operator-tls DeviceMajor:0 DeviceMinor:601 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-479 DeviceMajor:0 DeviceMinor:479 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88b7844d31674c8a9ac656b3b83e4c1b06ad83cfc66a64ab524fd7993f8ade5a/userdata/shm DeviceMajor:0 DeviceMinor:782 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-799 DeviceMajor:0 DeviceMinor:799 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-75 DeviceMajor:0 DeviceMinor:75 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:928 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9da438f00be81852193cf6977b4578eadeb8e58d253dc4eeb7ed8920cb7c25d8/userdata/shm DeviceMajor:0 DeviceMinor:1150 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-224 DeviceMajor:0 DeviceMinor:224 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-943 DeviceMajor:0 DeviceMinor:943 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1226 DeviceMajor:0 DeviceMinor:1226 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1308 DeviceMajor:0 DeviceMinor:1308 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-442 DeviceMajor:0 DeviceMinor:442 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-812 DeviceMajor:0 DeviceMinor:812 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/26273240-2261-4564-bb64-1aaf774a921f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:290 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-47 DeviceMajor:0 DeviceMinor:47 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bad0098dbbb3ef91f455d9c5cae0b155a81896e9a2090b1b3cc5925485a01bb5/userdata/shm DeviceMajor:0 DeviceMinor:761 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-900 DeviceMajor:0 DeviceMinor:900 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-116 DeviceMajor:0 DeviceMinor:116 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~projected/kube-api-access-6gvvd DeviceMajor:0 DeviceMinor:153 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1024 DeviceMajor:0 DeviceMinor:1024 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~projected/kube-api-access-xdnml DeviceMajor:0 DeviceMinor:616 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-708 DeviceMajor:0 DeviceMinor:708 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~secret/machine-api-operator-tls DeviceMajor:0 DeviceMinor:415 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-612 DeviceMajor:0 DeviceMinor:612 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1464 DeviceMajor:0 DeviceMinor:1464 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1288d627-f7c2-47d5-aa02-2c86d5f82369/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:1485 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:1575 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-493 DeviceMajor:0 DeviceMinor:493 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d7a0402f-755b-44a1-8cb8-c95b6ecff780/volumes/kubernetes.io~projected/kube-api-access-thzcp DeviceMajor:0 DeviceMinor:125 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-543 DeviceMajor:0 DeviceMinor:543 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-564 DeviceMajor:0 DeviceMinor:564 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1598 DeviceMajor:0 DeviceMinor:1598 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7af17f6f-6bda-4972-a72a-9d9059cd2fa6/volumes/kubernetes.io~secret/encryption-config DeviceMajor:0 DeviceMinor:524 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-665 DeviceMajor:0 DeviceMinor:665 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1477 DeviceMajor:0 DeviceMinor:1477 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:1492 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-506 DeviceMajor:0 DeviceMinor:506 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-936 DeviceMajor:0 DeviceMinor:936 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8/volumes/kubernetes.io~projected/kube-api-access-296mn DeviceMajor:0 DeviceMinor:334 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5970c6bd114edd2ef884fb05178cac88217ec449bc8ce4ae7efbdfbcd42348c/userdata/shm DeviceMajor:0 DeviceMinor:497 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7e83f444-49e8-40b5-9a58-3128002f28c9/volumes/kubernetes.io~projected/kube-api-access-fd68g DeviceMajor:0 DeviceMinor:987 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fb98438b-191c-4957-a9d1-8a64520f7f00/volumes/kubernetes.io~secret/proxy-tls DeviceMajor:0 DeviceMinor:1354 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-535 DeviceMajor:0 DeviceMinor:535 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/edd7cfb0-df67-4978-adca-9b917d3b5708/volumes/kubernetes.io~projected/kube-api-access-tkk7m DeviceMajor:0 DeviceMinor:329 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1030 DeviceMajor:0 DeviceMinor:1030 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-545 DeviceMajor:0 DeviceMinor:545 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/volumes/kubernetes.io~projected/ca-certs DeviceMajor:0 DeviceMinor:618 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-223 DeviceMajor:0 DeviceMinor:223 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1059 DeviceMajor:0 DeviceMinor:1059 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1112 DeviceMajor:0 DeviceMinor:1112 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4d6d22a2c4bd6621ceae8f3f631f713bf31c2e1983c5cc188f5e4c3dbbe34e78/userdata/shm DeviceMajor:0 DeviceMinor:1132 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/04f4782e-b152-41c0-870a-08936498d1af/volumes/kubernetes.io~projected/kube-api-access-h45md DeviceMajor:0 DeviceMinor:296 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b7107932acd9800ab6a9aa8488d291eca64c4817c02b99a03d6afcb4c6aa5306/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/apiservice-cert DeviceMajor:0 DeviceMinor:977 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/aa373a8f-8a9c-4f90-ae62-1d48fd88550b/volumes/kubernetes.io~projected/kube-api-access-lbgzc DeviceMajor:0 DeviceMinor:126 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/volumes/kubernetes.io~projected/kube-api-access-dn7ps DeviceMajor:0 DeviceMinor:333 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/9a83a76c-050e-4378-ac3a-1213d6d53773/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:776 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bdda46124a06acadd437cfa129dd7b6aaf9a297cfebebd4d591a661640986548/userdata/shm DeviceMajor:0 DeviceMinor:466 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-181 DeviceMajor:0 DeviceMinor:181 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/47152378-4ef5-4eff-9b30-fd8635982f02/volumes/kubernetes.io~projected/kube-api-access-rznm9 DeviceMajor:0 DeviceMinor:620 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b4d5da9639ac64af8c6b49afd056c92bbfb29caf48793701f25d367ee5d81bc3/userdata/shm DeviceMajor:0 DeviceMinor:379 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff56e8613e2a75a8198af59a4be09951e8aafaa5c9d86228d688801778bdd1bf/userdata/shm DeviceMajor:0 DeviceMinor:1409 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/21e8bd47-93e6-4068-a6fb-ba34255103d2/volumes/kubernetes.io~projected/kube-api-access-588cp DeviceMajor:0 DeviceMinor:588 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~projected/kube-api-access-f8559 DeviceMajor:0 DeviceMinor:1042 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1371 DeviceMajor:0 DeviceMinor:1371 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-195 DeviceMajor:0 DeviceMinor:195 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/29db06e4-26c0-45e4-ba90-509f51cad1a2/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:502 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1151 DeviceMajor:0 DeviceMinor:1151 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1084 DeviceMajor:0 DeviceMinor:1084 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1194 DeviceMajor:0 DeviceMinor:1194 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1580 DeviceMajor:0 DeviceMinor:1580 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/655dc370-c0d1-4d03-a317-64bf099aff1b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:288 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-148 DeviceMajor:0 DeviceMinor:148 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1312 DeviceMajor:0 DeviceMinor:1312 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1422 DeviceMajor:0 DeviceMinor:1422 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1cc6b47032858a9f23cf1250d8519a8904fc0784c3d5cd13c71b398db1efb64/userdata/shm DeviceMajor:0 DeviceMinor:1496 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes/kubernetes.io~projected/kube-api-access-2jn9h DeviceMajor:0 DeviceMinor:1577 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-785 DeviceMajor:0 DeviceMinor:785 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a419e81adaf5c31cba145fa0771425effc957e659af0a36feb8bcb413f0d60c/userdata/shm DeviceMajor:0 DeviceMinor:1022 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1336 DeviceMajor:0 DeviceMinor:1336 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1506 DeviceMajor:0 DeviceMinor:1506 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/360486ee1b53ba816547cc96be2da7d93fb80ff978aa1fb22f1b0380fa54ff4b/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/aa2eaba9-479e-4420-a24f-63530e4da783/volumes/kubernetes.io~secret/marketplace-operator-metrics DeviceMajor:0 DeviceMinor:771 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a98a5d982257969db8c53b7549324edfb17072359c4ef2f1b840f5a2439be7f/userdata/shm DeviceMajor:0 DeviceMinor:778 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/87c52add-1fdc-4227-b1b1-76f3653e3fb0/volumes/kubernetes.io~projected/kube-api-access-76wg7 DeviceMajor:0 DeviceMinor:1040 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1558 DeviceMajor:0 DeviceMinor:1558 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-641 DeviceMajor:0 DeviceMinor:641 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f690bc5389ec9e345c0e46968aec3c4116d7fa43906a44a14fc8bf9050be4b05/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-835 DeviceMajor:0 DeviceMinor:835 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/17f5a6f7-07dc-45cc-9db4-810f84b678d1/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls DeviceMajor:0 DeviceMinor:768 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/5aabcb3b-483d-419b-98ce-0ffd0ce265e8/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:1491 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/36d5dd7e-7ac5-4c41-8f62-404bc5919857/volumes/kubernetes.io~projected/kube-api-access-fmlmf DeviceMajor:0 DeviceMinor:142 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e3ddcc79665351151a3ca1f6ac3b47f8db24f6462393d1bf515b3796ad0a7ab/userdata/shm DeviceMajor:0 DeviceMinor:351 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cd208ca4-eb77-49a9-87a9-e0a617526e5d/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:1405 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d1087838ccc2ee2e43fbcfa144379af98284af1351e708a321b3441c8c85b24/userdata/shm DeviceMajor:0 DeviceMinor:1462 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd/userdata/shm DeviceMajor:0 DeviceMinor:926 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e852069a-82f1-4121-9d86-277b8ca07370/volumes/kubernetes.io~projected/kube-api-access-tg7nz DeviceMajor:0 DeviceMinor:686 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1176 DeviceMajor:0 DeviceMinor:1176 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1255 DeviceMajor:0 DeviceMinor:1255 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-895 DeviceMajor:0 DeviceMinor:895 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cb121145-3e1a-49da-aac5-822cf65eefcf/volumes/kubernetes.io~secret/node-tuning-operator-tls DeviceMajor:0 DeviceMinor:554 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-158 DeviceMajor:0 DeviceMinor:158 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-805 DeviceMajor:0 DeviceMinor:805 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6f3c3c9a13396c086ee2f9c1555fdb3cb68bedd60ac0bbabe0744784f9f431e6/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-614 DeviceMajor:0 DeviceMinor:614 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dbe3f91011af71e6a691e455964cd1677dffe4a3d4d68dc5eb18c4eae36e9fee/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046/userdata/shm DeviceMajor:0 DeviceMinor:411 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4951cde7e962973134e6afefdb278182a74a306c6b9b6301e94765769a38a203/userdata/shm DeviceMajor:0 DeviceMinor:305 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/68cb9838-2d09-46ab-8e2d-08d5868056fc/volumes/kubernetes.io~projected/kube-api-access-pgmcr DeviceMajor:0 DeviceMinor:178 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-884 DeviceMajor:0 DeviceMinor:884 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-906 DeviceMajor:0 DeviceMinor:906 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:980 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1364 DeviceMajor:0 DeviceMinor:1364 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/df783888-6b82-48e8-aad0-ee77f7167115/volumes/kubernetes.io~projected/kube-api-access-9rd8w DeviceMajor:0 DeviceMinor:465 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes/kubernetes.io~projected/kube-api-access-wmjvf DeviceMajor:0 DeviceMinor:410 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-444 DeviceMajor:0 DeviceMinor:444 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d77cf9cad0615543785857dc17fd17cede40496b0c1db2c45ac4d88d66be0ad/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-725 DeviceMajor:0 DeviceMinor:725 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c0f3ded2-925e-4d86-9c91-55b5df9f28ab/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:304 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:0844b9edd5dc0a0 MacAddress:42:a9:48:16:b7:c4 Speed:10000 Mtu:8900} {Name:088d3a2c938b288 MacAddress:1a:3f:94:de:da:e1 Speed:10000 Mtu:8900} {Name:0ab2d6d8a059c65 MacAddress:f2:eb:10:de:b1:10 Speed:10000 Mtu:8900} {Name:1494f0c416806b4 MacAddress:7e:b4:54:88:af:53 Speed:10000 Mtu:8900} {Name:21f59e2f616354c MacAddress:b2:55:1b:29:20:91 Speed:10000 Mtu:8900} {Name:257bffb545b929a MacAddress:be:9e:f8:ef:0f:ed Speed:10000 Mtu:8900} {Name:278f4b6d18c3dff MacAddress:ee:e7:21:60:0d:f6 Speed:10000 Mtu:8900} {Name:2a98a5d98225796 MacAddress:82:97:56:62:a9:e6 Speed:10000 Mtu:8900} {Name:2d0a498d3e7745b MacAddress:3e:e1:bb:1e:3d:e0 Speed:10000 Mtu:8900} {Name:2d5b8039b2e09b8 MacAddress:3e:6c:b9:f2:d6:b9 Speed:10000 Mtu:8900} {Name:2dc8ab6f03770ec MacAddress:62:52:fb:31:36:24 Speed:10000 Mtu:8900} {Name:33cf50dddcd93f7 MacAddress:0e:01:b2:6c:99:04 Speed:10000 Mtu:8900} {Name:360486ee1b53ba8 MacAddress:ea:de:f4:9b:19:49 Speed:10000 Mtu:8900} {Name:36ec0bdcbf1a701 MacAddress:9e:19:62:3d:ab:7a Speed:10000 Mtu:8900} {Name:3a419e81adaf5c3 MacAddress:3a:5a:fb:d8:f2:14 Speed:10000 Mtu:8900} {Name:3a9ddd66390fada MacAddress:c6:2a:f8:bc:2e:6d Speed:10000 Mtu:8900} {Name:3d77cf9cad06155 MacAddress:fa:61:b2:7d:e1:df Speed:10000 Mtu:8900} {Name:3d933d3b1b2933d MacAddress:5e:36:0c:4f:97:83 Speed:10000 Mtu:8900} {Name:3e0105457378e74 MacAddress:aa:8c:89:96:cf:f6 Speed:10000 Mtu:8900} {Name:3fe4a6cd4cada46 MacAddress:de:c8:b1:7f:57:1b Speed:10000 Mtu:8900} {Name:45f9a09db31f40f MacAddress:7a:b5:34:18:da:9a Speed:10000 Mtu:8900} {Name:4951cde7e962973 MacAddress:9e:ec:d6:20:f9:5e Speed:10000 Mtu:8900} {Name:4b85650970d13e0 MacAddress:8a:e5:40:e7:11:3f Speed:10000 Mtu:8900} {Name:4c88563b57a2b2f MacAddress:b6:8c:90:e7:08:94 Speed:10000 Mtu:8900} {Name:4d6d22a2c4bd662 MacAddress:1e:ff:14:df:c7:13 Speed:10000 Mtu:8900} {Name:52f656c6701b64f MacAddress:da:cc:e9:8e:7f:ea Speed:10000 Mtu:8900} {Name:5e0b72e52dac150 MacAddress:a2:f3:42:14:3a:e2 Speed:10000 Mtu:8900} {Name:5e3ddcc79665351 MacAddress:f2:5d:b7:47:4f:49 Speed:10000 Mtu:8900} {Name:5e77c62a2273f76 MacAddress:72:95:68:84:78:b1 Speed:10000 Mtu:8900} {Name:6217f2bc0698da1 MacAddress:82:3c:32:9c:a5:9a Speed:10000 Mtu:8900} {Name:666fd82fffc3377 MacAddress:d6:f6:3d:a9:a9:29 Speed:10000 Mtu:8900} {Name:6879ac09aaa2d73 MacAddress:c6:94:99:19:1d:2c Speed:10000 Mtu:8900} {Name:6f3c3c9a13396c0 MacAddress:82:c1:84:3d:df:2c Speed:10000 Mtu:8900} {Name:76afcc1baac7909 MacAddress:a2:be:65:95:22:01 Speed:10000 Mtu:8900} {Name:7ef7d4ba8ec9cf9 MacAddress:da:43:90:06:49:a3 Speed:10000 Mtu:8900} {Name:88b7844d31674c8 MacAddress:12:48:a2:c1:94:6f Speed:10000 Mtu:8900} {Name:96f9ea3b5bc4d36 MacAddress:32:14:4f:8a:9c:ef Speed:10000 Mtu:8900} {Name:9da438f00be8185 MacAddress:ea:33:0c:0e:e9:84 Speed:10000 Mtu:8900} {Name:9e74c8aa0085da6 MacAddress:5e:8b:74:1b:60:34 Speed:10000 Mtu:8900} {Name:abfaadf14571079 MacAddress:66:3f:fa:08:9e:5d Speed:10000 Mtu:8900} {Name:b11d5bb0f90292e MacAddress:82:92:c6:45:ab:57 Speed:10000 Mtu:8900} {Name:b4d5da9639ac64a MacAddress:3e:25:5f:03:19:49 Speed:10000 Mtu:8900} {Name:b67b9d50d899e5a MacAddress:2a:75:a7:fa:b7:17 Speed:10000 Mtu:8900} {Name:b7107932acd9800 MacAddress:1e:5c:36:ea:52:33 Speed:10000 Mtu:8900} {Name:b7e6ab5b506ae2c MacAddress:3a:e3:57:55:c8:81 Speed:10000 Mtu:8900} {Name:b7f9fde08392c65 MacAddress:42:95:8b:8f:78:e3 Speed:10000 Mtu:8900} {Name:bad0098dbbb3ef9 MacAddress:12:c5:11:61:23:db Speed:10000 Mtu:8900} {Name:bb89af45791311a MacAddress:a2:66:9c:b4:3f:22 Speed:10000 Mtu:8900} {Name:bb9177a080ed1b1 MacAddress:62:50:2a:06:7f:43 Speed:10000 Mtu:8900} {Name:bdda46124a06aca MacAddress:c2:ba:e5:54:f5:8c Speed:10000 Mtu:8900} {Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:br-int MacAddress:46:89:3b:cd:ed:be Speed:0 Mtu:8900} {Name:d4939b21289b30f MacAddress:ee:2f:04:d8:10:e1 Speed:10000 Mtu:8900} {Name:d5970c6bd114edd MacAddress:f6:f9:34:05:b2:7f Speed:10000 Mtu:8900} {Name:d9e44f827971c5d MacAddress:e2:53:bd:32:2b:ac Speed:10000 Mtu:8900} {Name:dbe3f91011af71e MacAddress:26:42:36:60:b9:e0 Speed:10000 Mtu:8900} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:ea:1e:17 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d2:13:f5 Speed:-1 Mtu:9000} {Name:f192f85af4cbdef MacAddress:6a:d4:ff:4f:bd:dd Speed:10000 Mtu:8900} {Name:f690bc5389ec9e3 MacAddress:c6:6c:ce:c0:f8:17 Speed:10000 Mtu:8900} {Name:ff56e8613e2a75a MacAddress:96:1f:8b:25:92:db Speed:10000 Mtu:8900} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:80:00:02 Speed:0 Mtu:8900} {Name:ovs-system MacAddress:b2:0a:5f:ad:6c:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 00:47:07.787211 master-0 kubenswrapper[33142]: I1204 00:47:07.786565 33142 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 00:47:07.787211 master-0 kubenswrapper[33142]: I1204 00:47:07.786633 33142 manager.go:233] Version: {KernelVersion:5.14.0-427.97.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511041748-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 00:47:07.787211 master-0 kubenswrapper[33142]: I1204 00:47:07.786908 33142 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 00:47:07.787211 master-0 kubenswrapper[33142]: I1204 00:47:07.787086 33142 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787125 33142 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787350 33142 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787359 33142 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787368 33142 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787391 33142 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787426 33142 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787516 33142 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787579 33142 kubelet.go:418] "Attempting to sync node with API server" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787591 33142 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787606 33142 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787621 33142 kubelet.go:324] "Adding apiserver pod source" Dec 04 00:47:07.787782 master-0 kubenswrapper[33142]: I1204 00:47:07.787640 33142 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 00:47:07.789643 master-0 kubenswrapper[33142]: I1204 00:47:07.789394 33142 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 00:47:07.789846 master-0 kubenswrapper[33142]: I1204 00:47:07.789797 33142 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-server-current.pem". Dec 04 00:47:07.790474 master-0 kubenswrapper[33142]: I1204 00:47:07.790432 33142 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 00:47:07.790865 master-0 kubenswrapper[33142]: I1204 00:47:07.790815 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 00:47:07.790971 master-0 kubenswrapper[33142]: I1204 00:47:07.790894 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 00:47:07.791041 master-0 kubenswrapper[33142]: I1204 00:47:07.790984 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 00:47:07.791041 master-0 kubenswrapper[33142]: I1204 00:47:07.791024 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 00:47:07.791116 master-0 kubenswrapper[33142]: I1204 00:47:07.791044 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 00:47:07.791116 master-0 kubenswrapper[33142]: I1204 00:47:07.791064 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 00:47:07.791116 master-0 kubenswrapper[33142]: I1204 00:47:07.791088 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 00:47:07.791116 master-0 kubenswrapper[33142]: I1204 00:47:07.791107 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 00:47:07.791248 master-0 kubenswrapper[33142]: I1204 00:47:07.791131 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 00:47:07.791248 master-0 kubenswrapper[33142]: I1204 00:47:07.791151 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 00:47:07.791248 master-0 kubenswrapper[33142]: I1204 00:47:07.791204 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 00:47:07.791248 master-0 kubenswrapper[33142]: I1204 00:47:07.791236 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 00:47:07.791425 master-0 kubenswrapper[33142]: I1204 00:47:07.791308 33142 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 00:47:07.792667 master-0 kubenswrapper[33142]: I1204 00:47:07.792622 33142 server.go:1280] "Started kubelet" Dec 04 00:47:07.794222 master-0 kubenswrapper[33142]: I1204 00:47:07.794158 33142 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 00:47:07.794316 master-0 kubenswrapper[33142]: I1204 00:47:07.794247 33142 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 00:47:07.794856 master-0 kubenswrapper[33142]: I1204 00:47:07.794810 33142 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 00:47:07.794861 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 00:47:07.798122 master-0 kubenswrapper[33142]: I1204 00:47:07.798022 33142 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 00:47:07.799595 master-0 kubenswrapper[33142]: I1204 00:47:07.799543 33142 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 00:47:07.799988 master-0 kubenswrapper[33142]: I1204 00:47:07.799953 33142 server.go:449] "Adding debug handlers to kubelet server" Dec 04 00:47:07.811292 master-0 kubenswrapper[33142]: I1204 00:47:07.811202 33142 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 00:47:07.833606 master-0 kubenswrapper[33142]: I1204 00:47:07.833542 33142 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 00:47:07.833606 master-0 kubenswrapper[33142]: I1204 00:47:07.833609 33142 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 00:47:07.859205 master-0 kubenswrapper[33142]: I1204 00:47:07.858764 33142 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 00:47:07.859205 master-0 kubenswrapper[33142]: I1204 00:47:07.858825 33142 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 00:47:07.859205 master-0 kubenswrapper[33142]: I1204 00:47:07.858821 33142 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 00:20:04 +0000 UTC, rotation deadline is 2025-12-04 17:11:38.220086977 +0000 UTC Dec 04 00:47:07.859205 master-0 kubenswrapper[33142]: I1204 00:47:07.858997 33142 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 16h24m30.361095999s for next certificate rotation Dec 04 00:47:07.859987 master-0 kubenswrapper[33142]: I1204 00:47:07.859438 33142 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862129 33142 factory.go:55] Registering systemd factory Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862162 33142 factory.go:221] Registration of the systemd container factory successfully Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862731 33142 factory.go:153] Registering CRI-O factory Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862774 33142 factory.go:221] Registration of the crio container factory successfully Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862879 33142 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862909 33142 factory.go:103] Registering Raw factory Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.862947 33142 manager.go:1196] Started watching for new ooms in manager Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.863411 33142 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 00:47:07.865135 master-0 kubenswrapper[33142]: I1204 00:47:07.863503 33142 manager.go:319] Starting recovery of all containers Dec 04 00:47:07.872848 master-0 kubenswrapper[33142]: E1204 00:47:07.872799 33142 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Dec 04 00:47:07.876141 master-0 kubenswrapper[33142]: I1204 00:47:07.876072 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="29db06e4-26c0-45e4-ba90-509f51cad1a2" volumeName="kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle" seLinuxMountContext="" Dec 04 00:47:07.876141 master-0 kubenswrapper[33142]: I1204 00:47:07.876137 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876154 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e85684df-0014-4d28-9b00-9c6a6942cc94" volumeName="kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876169 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876185 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876198 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e83f444-49e8-40b5-9a58-3128002f28c9" volumeName="kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876211 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" volumeName="kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876225 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba4531f5-90d7-41b9-9bbc-0f0d5c640d96" volumeName="kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876249 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e852069a-82f1-4121-9d86-277b8ca07370" volumeName="kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876263 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="004c989d-6ae8-4147-8355-af1118fe6a98" volumeName="kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876276 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876289 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c" volumeName="kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876309 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.876316 master-0 kubenswrapper[33142]: I1204 00:47:07.876327 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="21e8bd47-93e6-4068-a6fb-ba34255103d2" volumeName="kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876341 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876354 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e0d056-186c-4067-b586-14fe2970fcc0" volumeName="kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876368 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a83a76c-050e-4378-ac3a-1213d6d53773" volumeName="kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876380 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" volumeName="kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876392 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8375dfa-3a83-415b-bce5-0819a73255c1" volumeName="kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876405 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="727020b5-1084-48ac-9aed-549e4eabbf81" volumeName="kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876418 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="edd7cfb0-df67-4978-adca-9b917d3b5708" volumeName="kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876457 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="29db06e4-26c0-45e4-ba90-509f51cad1a2" volumeName="kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876471 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876484 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876496 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876532 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876549 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876563 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87adb521-b8d3-4201-b775-50c8c03956fc" volumeName="kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876579 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="890fd2c0-ac22-4d85-aa02-8f6c4518b7a1" volumeName="kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876593 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8375dfa-3a83-415b-bce5-0819a73255c1" volumeName="kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876606 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffe9d26b-34e2-4506-9c38-69b85ab210a1" volumeName="kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876619 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876631 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876644 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e852069a-82f1-4121-9d86-277b8ca07370" volumeName="kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876656 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" volumeName="kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876676 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="975f6a6f-1fbb-49e1-8a0a-722586355364" volumeName="kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876692 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876707 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2f01d68-92ae-45b8-8501-645e439b5295" volumeName="kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876719 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f190ddab-e7d0-4dd6-8bb7-359a02393259" volumeName="kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876735 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876749 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876763 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" volumeName="kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876777 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876790 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87c52add-1fdc-4227-b1b1-76f3653e3fb0" volumeName="kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7" seLinuxMountContext="" Dec 04 00:47:07.876759 master-0 kubenswrapper[33142]: I1204 00:47:07.876803 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c" volumeName="kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876817 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876832 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876847 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" volumeName="kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876860 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876874 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876887 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876899 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="df783888-6b82-48e8-aad0-ee77f7167115" volumeName="kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876917 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1288d627-f7c2-47d5-aa02-2c86d5f82369" volumeName="kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876960 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876977 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.876992 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877006 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" volumeName="kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877019 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877031 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3545341-90a7-42fe-9ba4-bf6e71ef776e" volumeName="kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877045 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffe9d26b-34e2-4506-9c38-69b85ab210a1" volumeName="kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877059 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877071 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877084 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877096 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d4d3057-9f71-4b07-b463-51cc49d28bf3" volumeName="kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877109 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8" volumeName="kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877122 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877133 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877146 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877158 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e83f444-49e8-40b5-9a58-3128002f28c9" volumeName="kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877171 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3545341-90a7-42fe-9ba4-bf6e71ef776e" volumeName="kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877182 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20835c26-301c-423e-b534-ec2a5e5af953" volumeName="kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877194 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b900991f-c6ec-45d1-a76b-44aec0f56cde" volumeName="kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877206 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" volumeName="kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877220 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="95141f9b-b6b0-40dc-a6e2-b5c84d24caac" volumeName="kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877234 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa2eaba9-479e-4420-a24f-63530e4da783" volumeName="kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877245 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877260 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" volumeName="kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877272 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e0d056-186c-4067-b586-14fe2970fcc0" volumeName="kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877284 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e0d056-186c-4067-b586-14fe2970fcc0" volumeName="kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877297 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="890fd2c0-ac22-4d85-aa02-8f6c4518b7a1" volumeName="kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877310 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="93b8a17c-ef68-4be1-9b98-0dd1a3d66f16" volumeName="kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877322 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877334 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877347 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1288d627-f7c2-47d5-aa02-2c86d5f82369" volumeName="kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877368 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17f5a6f7-07dc-45cc-9db4-810f84b678d1" volumeName="kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877380 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877392 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877404 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d4d3057-9f71-4b07-b463-51cc49d28bf3" volumeName="kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877418 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="95141f9b-b6b0-40dc-a6e2-b5c84d24caac" volumeName="kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877431 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877443 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877455 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87c52add-1fdc-4227-b1b1-76f3653e3fb0" volumeName="kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877470 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="890fd2c0-ac22-4d85-aa02-8f6c4518b7a1" volumeName="kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877483 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f190ddab-e7d0-4dd6-8bb7-359a02393259" volumeName="kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877495 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f4782e-b152-41c0-870a-08936498d1af" volumeName="kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877508 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877522 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" volumeName="kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877534 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bf75491-0c03-4e02-9074-c9be808badd4" volumeName="kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877547 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877559 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" volumeName="kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877572 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c" volumeName="kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877587 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1288d627-f7c2-47d5-aa02-2c86d5f82369" volumeName="kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877600 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877635 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" volumeName="kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877656 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877670 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877683 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877696 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bf75491-0c03-4e02-9074-c9be808badd4" volumeName="kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877713 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="edd7cfb0-df67-4978-adca-9b917d3b5708" volumeName="kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877727 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb98438b-191c-4957-a9d1-8a64520f7f00" volumeName="kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877739 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" volumeName="kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877753 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba4531f5-90d7-41b9-9bbc-0f0d5c640d96" volumeName="kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877769 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c79edcd7-4399-4ded-9b03-9084ad9e14b4" volumeName="kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877785 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb98438b-191c-4957-a9d1-8a64520f7f00" volumeName="kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877798 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877811 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877823 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877834 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877846 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877858 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb121145-3e1a-49da-aac5-822cf65eefcf" volumeName="kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877871 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877884 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" volumeName="kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877897 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="df783888-6b82-48e8-aad0-ee77f7167115" volumeName="kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877914 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17f5a6f7-07dc-45cc-9db4-810f84b678d1" volumeName="kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877952 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877976 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" volumeName="kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.877989 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba4531f5-90d7-41b9-9bbc-0f0d5c640d96" volumeName="kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.878001 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm" seLinuxMountContext="" Dec 04 00:47:07.877862 master-0 kubenswrapper[33142]: I1204 00:47:07.878015 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878028 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878041 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3545341-90a7-42fe-9ba4-bf6e71ef776e" volumeName="kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878053 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c" volumeName="kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878065 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="29db06e4-26c0-45e4-ba90-509f51cad1a2" volumeName="kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878077 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="55cd7eeb-05b2-4ec9-bd37-a765beac3ab8" volumeName="kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878092 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878104 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878116 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2f01d68-92ae-45b8-8501-645e439b5295" volumeName="kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878128 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="285a1e74-1d8e-452e-a5a4-484afc10e10f" volumeName="kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878168 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878183 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="47152378-4ef5-4eff-9b30-fd8635982f02" volumeName="kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878198 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d4d3057-9f71-4b07-b463-51cc49d28bf3" volumeName="kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878211 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878222 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffe9d26b-34e2-4506-9c38-69b85ab210a1" volumeName="kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878235 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="060f2a39-e40c-495b-885d-5acd967e6c25" volumeName="kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878246 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878258 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878271 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878283 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0616abbd-748a-4451-96b7-df0178c99e8f" volumeName="kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878296 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878309 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d4d3057-9f71-4b07-b463-51cc49d28bf3" volumeName="kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878323 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878334 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878346 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878359 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="975f6a6f-1fbb-49e1-8a0a-722586355364" volumeName="kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878371 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f190ddab-e7d0-4dd6-8bb7-359a02393259" volumeName="kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878384 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e5012fe-fc48-4b6d-a075-fa94266ba90d" volumeName="kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878400 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8" volumeName="kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878413 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="004c989d-6ae8-4147-8355-af1118fe6a98" volumeName="kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878425 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" volumeName="kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878437 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878449 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="55cd7eeb-05b2-4ec9-bd37-a765beac3ab8" volumeName="kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878462 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="975f6a6f-1fbb-49e1-8a0a-722586355364" volumeName="kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878475 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e852069a-82f1-4121-9d86-277b8ca07370" volumeName="kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878489 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" volumeName="kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878500 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="47152378-4ef5-4eff-9b30-fd8635982f02" volumeName="kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878513 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878525 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87c52add-1fdc-4227-b1b1-76f3653e3fb0" volumeName="kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878539 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8" volumeName="kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878554 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878566 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="26273240-2261-4564-bb64-1aaf774a921f" volumeName="kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878578 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" volumeName="kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878590 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e104a8c-66dc-4a9a-836f-656e6f4cc923" volumeName="kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878604 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="727020b5-1084-48ac-9aed-549e4eabbf81" volumeName="kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878617 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17f5a6f7-07dc-45cc-9db4-810f84b678d1" volumeName="kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878629 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" volumeName="kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878642 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87c52add-1fdc-4227-b1b1-76f3653e3fb0" volumeName="kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878654 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" volumeName="kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878666 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b900991f-c6ec-45d1-a76b-44aec0f56cde" volumeName="kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878680 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3545341-90a7-42fe-9ba4-bf6e71ef776e" volumeName="kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878693 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3545341-90a7-42fe-9ba4-bf6e71ef776e" volumeName="kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878705 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878718 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e104a8c-66dc-4a9a-836f-656e6f4cc923" volumeName="kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878730 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e901355-2d0f-46f9-9d64-c4bc900b1839" volumeName="kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878744 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" volumeName="kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878757 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d3c9170-b36d-4052-8ae9-9e549611dbd8" volumeName="kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878770 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a0402f-755b-44a1-8cb8-c95b6ecff780" volumeName="kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878782 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="93b8a17c-ef68-4be1-9b98-0dd1a3d66f16" volumeName="kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878796 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b900991f-c6ec-45d1-a76b-44aec0f56cde" volumeName="kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878810 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a83a76c-050e-4378-ac3a-1213d6d53773" volumeName="kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878822 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" volumeName="kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878834 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb98438b-191c-4957-a9d1-8a64520f7f00" volumeName="kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878848 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1288d627-f7c2-47d5-aa02-2c86d5f82369" volumeName="kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878860 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca8eddb5-4600-4058-94d2-5d0308c32613" volumeName="kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878873 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878886 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" volumeName="kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878901 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e852069a-82f1-4121-9d86-277b8ca07370" volumeName="kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878915 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="004c989d-6ae8-4147-8355-af1118fe6a98" volumeName="kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878951 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20835c26-301c-423e-b534-ec2a5e5af953" volumeName="kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878969 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.878983 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5aabcb3b-483d-419b-98ce-0ffd0ce265e8" volumeName="kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879018 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87adb521-b8d3-4201-b775-50c8c03956fc" volumeName="kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879032 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879044 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879056 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e104a8c-66dc-4a9a-836f-656e6f4cc923" volumeName="kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879070 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" volumeName="kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879083 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="68cb9838-2d09-46ab-8e2d-08d5868056fc" volumeName="kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879096 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c" volumeName="kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879108 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2f01d68-92ae-45b8-8501-645e439b5295" volumeName="kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879125 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="21e8bd47-93e6-4068-a6fb-ba34255103d2" volumeName="kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879138 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="55cd7eeb-05b2-4ec9-bd37-a765beac3ab8" volumeName="kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879152 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="36d5dd7e-7ac5-4c41-8f62-404bc5919857" volumeName="kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879165 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="727020b5-1084-48ac-9aed-549e4eabbf81" volumeName="kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879179 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="21e8bd47-93e6-4068-a6fb-ba34255103d2" volumeName="kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879193 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" volumeName="kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879206 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e0d056-186c-4067-b586-14fe2970fcc0" volumeName="kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879221 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87adb521-b8d3-4201-b775-50c8c03956fc" volumeName="kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879239 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa2eaba9-479e-4420-a24f-63530e4da783" volumeName="kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879259 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ad96246-c53a-4016-b67d-5e9d66f40d5b" volumeName="kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879275 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e83f444-49e8-40b5-9a58-3128002f28c9" volumeName="kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879292 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879306 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" volumeName="kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879320 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e0d056-186c-4067-b586-14fe2970fcc0" volumeName="kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879333 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa2eaba9-479e-4420-a24f-63530e4da783" volumeName="kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879346 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b95b14d5-c3da-4aa7-9574-5cafff04192a" volumeName="kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879361 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" volumeName="kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879375 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" volumeName="kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879392 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b900991f-c6ec-45d1-a76b-44aec0f56cde" volumeName="kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879406 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="47152378-4ef5-4eff-9b30-fd8635982f02" volumeName="kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879418 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" volumeName="kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879432 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879444 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bf75491-0c03-4e02-9074-c9be808badd4" volumeName="kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879457 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a5721ad-a077-439a-9ec0-57d90dfb5c14" volumeName="kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879471 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17f5a6f7-07dc-45cc-9db4-810f84b678d1" volumeName="kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879487 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" volumeName="kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879502 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="55cd7eeb-05b2-4ec9-bd37-a765beac3ab8" volumeName="kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879519 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd621016-f4f2-4839-aae0-a804e6023423" volumeName="kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879531 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17f5a6f7-07dc-45cc-9db4-810f84b678d1" volumeName="kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879544 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="655dc370-c0d1-4d03-a317-64bf099aff1b" volumeName="kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879556 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c79edcd7-4399-4ded-9b03-9084ad9e14b4" volumeName="kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879568 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd208ca4-eb77-49a9-87a9-e0a617526e5d" volumeName="kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879579 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5f22827-c301-4584-b999-0a1cc1033bb5" volumeName="kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879595 33142 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc7bfc47-972c-4493-8372-f211c6645ff5" volumeName="kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd" seLinuxMountContext="" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879607 33142 reconstruct.go:97] "Volume reconstruction finished" Dec 04 00:47:07.882477 master-0 kubenswrapper[33142]: I1204 00:47:07.879618 33142 reconciler.go:26] "Reconciler: start to sync state" Dec 04 00:47:07.885862 master-0 kubenswrapper[33142]: I1204 00:47:07.882732 33142 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Dec 04 00:47:07.896431 master-0 kubenswrapper[33142]: I1204 00:47:07.895171 33142 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 00:47:07.896858 master-0 kubenswrapper[33142]: I1204 00:47:07.896802 33142 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 00:47:07.896858 master-0 kubenswrapper[33142]: I1204 00:47:07.896850 33142 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 00:47:07.896999 master-0 kubenswrapper[33142]: I1204 00:47:07.896890 33142 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 00:47:07.896999 master-0 kubenswrapper[33142]: E1204 00:47:07.896961 33142 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Dec 04 00:47:07.899113 master-0 kubenswrapper[33142]: I1204 00:47:07.898903 33142 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 00:47:07.905350 master-0 kubenswrapper[33142]: I1204 00:47:07.905304 33142 generic.go:334] "Generic (PLEG): container finished" podID="fd2fa610bb2a39c39fcdd00db03a511a" containerID="a433747788e31b911be2d5dee0f4d95602e43d74e31e597fb77efe46bd44281f" exitCode=0 Dec 04 00:47:07.908400 master-0 kubenswrapper[33142]: I1204 00:47:07.908294 33142 generic.go:334] "Generic (PLEG): container finished" podID="af25c964-8d39-457a-9214-6cadfecf3943" containerID="ac3c3f86fb624407fb4e83dc7253e2823922e10ea8a41094ef13f1bdb4f8569e" exitCode=0 Dec 04 00:47:07.913582 master-0 kubenswrapper[33142]: I1204 00:47:07.913538 33142 generic.go:334] "Generic (PLEG): container finished" podID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerID="370746cda174b3297e4978d445bd103ac2f5c5a7f9f05309706d5946410e739f" exitCode=0 Dec 04 00:47:07.915891 master-0 kubenswrapper[33142]: I1204 00:47:07.915833 33142 generic.go:334] "Generic (PLEG): container finished" podID="6bf75491-0c03-4e02-9074-c9be808badd4" containerID="169a373d3c6d0dc508b99753a1ce47ee9558b95c874853118845c82490d5a2bc" exitCode=0 Dec 04 00:47:07.915891 master-0 kubenswrapper[33142]: I1204 00:47:07.915885 33142 generic.go:334] "Generic (PLEG): container finished" podID="6bf75491-0c03-4e02-9074-c9be808badd4" containerID="560704e0aa4e94086401afcfa753359b76f4ad836e4da9eb3594a626e90afa1f" exitCode=0 Dec 04 00:47:07.918017 master-0 kubenswrapper[33142]: I1204 00:47:07.917983 33142 generic.go:334] "Generic (PLEG): container finished" podID="aa2eaba9-479e-4420-a24f-63530e4da783" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" exitCode=0 Dec 04 00:47:07.923320 master-0 kubenswrapper[33142]: I1204 00:47:07.923293 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-75b4d49d4c-7s5z5_c79edcd7-4399-4ded-9b03-9084ad9e14b4/package-server-manager/0.log" Dec 04 00:47:07.923701 master-0 kubenswrapper[33142]: I1204 00:47:07.923681 33142 generic.go:334] "Generic (PLEG): container finished" podID="c79edcd7-4399-4ded-9b03-9084ad9e14b4" containerID="91047caa011840485cf0440ea5435e7255eea04d0a040e632ceb8483ac22b986" exitCode=1 Dec 04 00:47:07.925776 master-0 kubenswrapper[33142]: I1204 00:47:07.925717 33142 generic.go:334] "Generic (PLEG): container finished" podID="26273240-2261-4564-bb64-1aaf774a921f" containerID="f675877019df3cdc18b7aefe49174ba92d0287bca845b45bc2f441207b0fb5fa" exitCode=0 Dec 04 00:47:07.928630 master-0 kubenswrapper[33142]: I1204 00:47:07.928556 33142 generic.go:334] "Generic (PLEG): container finished" podID="04f4782e-b152-41c0-870a-08936498d1af" containerID="ef0a1dd8b3b02b9ccc27c7f5e6c342a96866c392b4b7777a54fb8bb661414577" exitCode=0 Dec 04 00:47:07.930351 master-0 kubenswrapper[33142]: I1204 00:47:07.930311 33142 generic.go:334] "Generic (PLEG): container finished" podID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerID="a4d8df3e3af5b57340a108d211502f9b486e94114c010963789ad8118dc86e5b" exitCode=0 Dec 04 00:47:07.932564 master-0 kubenswrapper[33142]: I1204 00:47:07.932539 33142 generic.go:334] "Generic (PLEG): container finished" podID="004c989d-6ae8-4147-8355-af1118fe6a98" containerID="c3851f459af3a52ca2d5286fdbe5bfbc4f8adb04de417f015b441c48011e4416" exitCode=0 Dec 04 00:47:07.938035 master-0 kubenswrapper[33142]: I1204 00:47:07.938000 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-6cbf58c977-vjwnj_aa373a8f-8a9c-4f90-ae62-1d48fd88550b/network-operator/0.log" Dec 04 00:47:07.938094 master-0 kubenswrapper[33142]: I1204 00:47:07.938059 33142 generic.go:334] "Generic (PLEG): container finished" podID="aa373a8f-8a9c-4f90-ae62-1d48fd88550b" containerID="016eb70a46f10bedd7dec24049021571b4b28da368391342d032b50cbe92ce70" exitCode=255 Dec 04 00:47:07.940536 master-0 kubenswrapper[33142]: I1204 00:47:07.940497 33142 generic.go:334] "Generic (PLEG): container finished" podID="2ad96246-c53a-4016-b67d-5e9d66f40d5b" containerID="8e1dd1a3bf326b95f76f31f2c263921fd333cc92fd34b2ff2d20c784a7327b3f" exitCode=0 Dec 04 00:47:07.942255 master-0 kubenswrapper[33142]: I1204 00:47:07.942227 33142 generic.go:334] "Generic (PLEG): container finished" podID="3e901355-2d0f-46f9-9d64-c4bc900b1839" containerID="1390652d357c9660029c7c11251fd012033ccb910a6529103f75fc7a1f1c9652" exitCode=0 Dec 04 00:47:07.948104 master-0 kubenswrapper[33142]: I1204 00:47:07.948080 33142 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="cf24040c300df106253834dddfb5503ac540d510ceeea8af9fdc130d4568b9b1" exitCode=0 Dec 04 00:47:07.948104 master-0 kubenswrapper[33142]: I1204 00:47:07.948100 33142 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="017e9a364c8fd1a8d900be61811c2dd5a07ba68a7d515a2e3499b10d06214e39" exitCode=0 Dec 04 00:47:07.948196 master-0 kubenswrapper[33142]: I1204 00:47:07.948110 33142 generic.go:334] "Generic (PLEG): container finished" podID="2b07bd15-f37f-48ab-bc36-ee43e3bb1b11" containerID="5b79511f6f6f5a15957be431642dc8264cb31a43f89320f65a7fcad2554571c5" exitCode=0 Dec 04 00:47:07.951152 master-0 kubenswrapper[33142]: I1204 00:47:07.951123 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15" exitCode=0 Dec 04 00:47:07.953976 master-0 kubenswrapper[33142]: I1204 00:47:07.953871 33142 generic.go:334] "Generic (PLEG): container finished" podID="e19d444a-d0b0-4af1-b570-9520818c5301" containerID="fc6a8239895c17505831104a4cf49245de0e35d1e9d9bb79accb330ffddf2c66" exitCode=0 Dec 04 00:47:07.958802 master-0 kubenswrapper[33142]: I1204 00:47:07.958767 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-cb84b9cdf-tsm24_62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb/machine-approver-controller/0.log" Dec 04 00:47:07.959223 master-0 kubenswrapper[33142]: I1204 00:47:07.959183 33142 generic.go:334] "Generic (PLEG): container finished" podID="62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb" containerID="74dc0ef48d8fe1939f3624a82b33b96968f437acd029a208849d167b8818221f" exitCode=255 Dec 04 00:47:07.963191 master-0 kubenswrapper[33142]: I1204 00:47:07.963151 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-bbd9b9dff-lqlgs_cb121145-3e1a-49da-aac5-822cf65eefcf/cluster-node-tuning-operator/0.log" Dec 04 00:47:07.963249 master-0 kubenswrapper[33142]: I1204 00:47:07.963203 33142 generic.go:334] "Generic (PLEG): container finished" podID="cb121145-3e1a-49da-aac5-822cf65eefcf" containerID="f20da8400c336d34fe4b807aa7ddfc6b03001cf06f4172fd2e33bddf36815af7" exitCode=1 Dec 04 00:47:07.965582 master-0 kubenswrapper[33142]: I1204 00:47:07.965546 33142 generic.go:334] "Generic (PLEG): container finished" podID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerID="381b0d861d6cea3e99674d5dcd82176cb0cef0ec90d4b9a314a1938f78d4a9f5" exitCode=0 Dec 04 00:47:07.965582 master-0 kubenswrapper[33142]: I1204 00:47:07.965575 33142 generic.go:334] "Generic (PLEG): container finished" podID="49bd2d0a-d2b5-423d-adb2-61fdf9a51e39" containerID="3837531baa035e525c30201df8f109e15bad727f44468701060777db28ba8679" exitCode=0 Dec 04 00:47:07.969026 master-0 kubenswrapper[33142]: I1204 00:47:07.968993 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/4.log" Dec 04 00:47:07.969472 master-0 kubenswrapper[33142]: I1204 00:47:07.969438 33142 generic.go:334] "Generic (PLEG): container finished" podID="c0f3ded2-925e-4d86-9c91-55b5df9f28ab" containerID="8530345f5e69950f678434790e89fc9a6cbdfc2a4f905621cc54c729b92e4c16" exitCode=1 Dec 04 00:47:07.974543 master-0 kubenswrapper[33142]: I1204 00:47:07.974465 33142 generic.go:334] "Generic (PLEG): container finished" podID="87adb521-b8d3-4201-b775-50c8c03956fc" containerID="7523d2094b7d9f0f4c1bf4fb5fb915bcee3ec77caca9eebcffa9058251f228f8" exitCode=0 Dec 04 00:47:07.974637 master-0 kubenswrapper[33142]: I1204 00:47:07.974545 33142 generic.go:334] "Generic (PLEG): container finished" podID="87adb521-b8d3-4201-b775-50c8c03956fc" containerID="d516ca20f1a8865e78f54f55e95e34898b42fc4b68d175dfe798bfb61fce6f2d" exitCode=0 Dec 04 00:47:07.991621 master-0 kubenswrapper[33142]: I1204 00:47:07.991551 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/4.log" Dec 04 00:47:07.991621 master-0 kubenswrapper[33142]: I1204 00:47:07.991606 33142 generic.go:334] "Generic (PLEG): container finished" podID="dc7bfc47-972c-4493-8372-f211c6645ff5" containerID="8f54680f05eac3c4e4c0081b6f3fb89bf36ac7684285004e1dee1a758f252342" exitCode=1 Dec 04 00:47:07.995666 master-0 kubenswrapper[33142]: I1204 00:47:07.995596 33142 generic.go:334] "Generic (PLEG): container finished" podID="8a5721ad-a077-439a-9ec0-57d90dfb5c14" containerID="c152b09b4d8fa529e75f7bbb79145b482cc8f1155d6ff7779131595595f74485" exitCode=0 Dec 04 00:47:07.998184 master-0 kubenswrapper[33142]: E1204 00:47:07.997035 33142 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 00:47:08.006465 master-0 kubenswrapper[33142]: I1204 00:47:08.006412 33142 generic.go:334] "Generic (PLEG): container finished" podID="d5f22827-c301-4584-b999-0a1cc1033bb5" containerID="04e9200304854483446720319d72e82a552d8c10ce33bfebf374bd1ca17290f6" exitCode=0 Dec 04 00:47:08.013370 master-0 kubenswrapper[33142]: I1204 00:47:08.013313 33142 generic.go:334] "Generic (PLEG): container finished" podID="29db06e4-26c0-45e4-ba90-509f51cad1a2" containerID="424502a5227056c566845d24bfb829be46563652d57707e9bcb00b5cb331cfba" exitCode=0 Dec 04 00:47:08.020127 master-0 kubenswrapper[33142]: I1204 00:47:08.020074 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/1.log" Dec 04 00:47:08.020623 master-0 kubenswrapper[33142]: I1204 00:47:08.020574 33142 generic.go:334] "Generic (PLEG): container finished" podID="17f5a6f7-07dc-45cc-9db4-810f84b678d1" containerID="f0e5a3e1ffcbd21a6e64906f63f913edff05887b48db42178b42c8c251a977b3" exitCode=1 Dec 04 00:47:08.022771 master-0 kubenswrapper[33142]: I1204 00:47:08.022724 33142 generic.go:334] "Generic (PLEG): container finished" podID="83e0d056-186c-4067-b586-14fe2970fcc0" containerID="8f0a62031d94ed083a9f3132ca810e01606b86643fc6e15a9b3a9446d9f5146f" exitCode=0 Dec 04 00:47:08.026562 master-0 kubenswrapper[33142]: I1204 00:47:08.026502 33142 generic.go:334] "Generic (PLEG): container finished" podID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerID="4118fa7c7b8720a6318c70d78a37012ba48f750c5f42e27c8bad625646cee34f" exitCode=0 Dec 04 00:47:08.029776 master-0 kubenswrapper[33142]: I1204 00:47:08.029717 33142 generic.go:334] "Generic (PLEG): container finished" podID="95141f9b-b6b0-40dc-a6e2-b5c84d24caac" containerID="7cbd376a461c53f9f8504aae5e51bc78d01b3ac68dfe3fd40f099e142c972b78" exitCode=0 Dec 04 00:47:08.047182 master-0 kubenswrapper[33142]: I1204 00:47:08.047092 33142 generic.go:334] "Generic (PLEG): container finished" podID="68cb9838-2d09-46ab-8e2d-08d5868056fc" containerID="c9521e4b338a729f24968935eb69431972eafc3079f28819c337f948d3e9346b" exitCode=0 Dec 04 00:47:08.051579 master-0 kubenswrapper[33142]: I1204 00:47:08.051517 33142 generic.go:334] "Generic (PLEG): container finished" podID="285a1e74-1d8e-452e-a5a4-484afc10e10f" containerID="413a2471e1907fc22f6dd6be4e4024d9156701127dfe71a19a5672b890e28f94" exitCode=0 Dec 04 00:47:08.054392 master-0 kubenswrapper[33142]: I1204 00:47:08.054357 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-5f78c89466-mwkdg_47152378-4ef5-4eff-9b30-fd8635982f02/manager/1.log" Dec 04 00:47:08.055050 master-0 kubenswrapper[33142]: I1204 00:47:08.054957 33142 generic.go:334] "Generic (PLEG): container finished" podID="47152378-4ef5-4eff-9b30-fd8635982f02" containerID="f1dd6f64e11823ee0d3b434487e66ada608d7a5cdf9faa90497f07d455930b88" exitCode=1 Dec 04 00:47:08.059454 master-0 kubenswrapper[33142]: I1204 00:47:08.059410 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:47:08.061589 master-0 kubenswrapper[33142]: I1204 00:47:08.061550 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:47:08.062279 master-0 kubenswrapper[33142]: I1204 00:47:08.062249 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:47:08.062339 master-0 kubenswrapper[33142]: I1204 00:47:08.062303 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" exitCode=255 Dec 04 00:47:08.062339 master-0 kubenswrapper[33142]: I1204 00:47:08.062329 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" exitCode=1 Dec 04 00:47:08.062339 master-0 kubenswrapper[33142]: I1204 00:47:08.062339 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" exitCode=1 Dec 04 00:47:08.067528 master-0 kubenswrapper[33142]: I1204 00:47:08.067482 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="5310369388b9d57f1136135213aab2547b7606ff55df76063a2bfab7824144bd" exitCode=0 Dec 04 00:47:08.067615 master-0 kubenswrapper[33142]: I1204 00:47:08.067601 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="42a43c5406cc22adb9b3ba42d732fa8cb77848a82bb7e49ec7284642472baad4" exitCode=0 Dec 04 00:47:08.067684 master-0 kubenswrapper[33142]: I1204 00:47:08.067671 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="8ff5104678eaba3eecd736a278e1661792ddc36a8b68f4b69f7019b814f16993" exitCode=0 Dec 04 00:47:08.067759 master-0 kubenswrapper[33142]: I1204 00:47:08.067743 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="d5609818cd8c2efbda7153e648a8259ae917c74f4ff0c93048f634b456d737d1" exitCode=0 Dec 04 00:47:08.067841 master-0 kubenswrapper[33142]: I1204 00:47:08.067824 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="6f0ebba6a9c03ec96d055a8afe226473e6d6b3f268074fd934a991ed33ca39ec" exitCode=0 Dec 04 00:47:08.067916 master-0 kubenswrapper[33142]: I1204 00:47:08.067902 33142 generic.go:334] "Generic (PLEG): container finished" podID="36d5dd7e-7ac5-4c41-8f62-404bc5919857" containerID="f2410f4e6fc6ca15d32c345499d7fa49d4ebf0368ee0349e5f7ab0bbf2ca3cf1" exitCode=0 Dec 04 00:47:08.075772 master-0 kubenswrapper[33142]: I1204 00:47:08.075724 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/1.log" Dec 04 00:47:08.076284 master-0 kubenswrapper[33142]: I1204 00:47:08.076125 33142 generic.go:334] "Generic (PLEG): container finished" podID="bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced" containerID="fcec041ddbc1c56bbe2d18ad4f909e42756cba1bd9569bf1cbf0710582cb36fb" exitCode=1 Dec 04 00:47:08.077822 master-0 kubenswrapper[33142]: I1204 00:47:08.077757 33142 generic.go:334] "Generic (PLEG): container finished" podID="a37027d2-eeb1-416b-b67e-7ee233c42d04" containerID="03291911fb6f9dd6f3d49f195b4325b3023f0ac3bdc20d2e3a5c7c5ac9c1f3fd" exitCode=0 Dec 04 00:47:08.082568 master-0 kubenswrapper[33142]: I1204 00:47:08.082528 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 00:47:08.083300 master-0 kubenswrapper[33142]: I1204 00:47:08.083268 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/cluster-cloud-controller-manager/0.log" Dec 04 00:47:08.083353 master-0 kubenswrapper[33142]: I1204 00:47:08.083321 33142 generic.go:334] "Generic (PLEG): container finished" podID="b900991f-c6ec-45d1-a76b-44aec0f56cde" containerID="f0c494bde70f37736abe62be0def4b2d933ab52a855d6e1c1ecf0f70379f00c8" exitCode=1 Dec 04 00:47:08.083353 master-0 kubenswrapper[33142]: I1204 00:47:08.083350 33142 generic.go:334] "Generic (PLEG): container finished" podID="b900991f-c6ec-45d1-a76b-44aec0f56cde" containerID="1fce128595f021cc732e1d1f11e229a1b136cad65889380e6f7c888dae64bf44" exitCode=1 Dec 04 00:47:08.086216 master-0 kubenswrapper[33142]: I1204 00:47:08.086163 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72_a6a2308d-6d6f-4e8d-a6db-d931a172ed55/control-plane-machine-set-operator/0.log" Dec 04 00:47:08.086311 master-0 kubenswrapper[33142]: I1204 00:47:08.086240 33142 generic.go:334] "Generic (PLEG): container finished" podID="a6a2308d-6d6f-4e8d-a6db-d931a172ed55" containerID="e5be4fe727906d907e13052e2f5e4da30f0568dc3c005e899e0bb15bd8847ece" exitCode=1 Dec 04 00:47:08.088475 master-0 kubenswrapper[33142]: I1204 00:47:08.088427 33142 generic.go:334] "Generic (PLEG): container finished" podID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerID="274339ba78590b378384fabf9e945e17f757b313a617429d755e31ef00625b28" exitCode=0 Dec 04 00:47:08.093446 master-0 kubenswrapper[33142]: I1204 00:47:08.093402 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/cluster-autoscaler-operator/0.log" Dec 04 00:47:08.093918 master-0 kubenswrapper[33142]: I1204 00:47:08.093862 33142 generic.go:334] "Generic (PLEG): container finished" podID="ba4531f5-90d7-41b9-9bbc-0f0d5c640d96" containerID="0dfd8857ba31b986ea7faa5328c297f0b3c9f0ea5f465d27f87b850465ce0710" exitCode=255 Dec 04 00:47:08.097200 master-0 kubenswrapper[33142]: I1204 00:47:08.097119 33142 generic.go:334] "Generic (PLEG): container finished" podID="655dc370-c0d1-4d03-a317-64bf099aff1b" containerID="b50a746f991e98693c439e07b3494f8b2b88b67b84aa17a2878ffc95b7437489" exitCode=0 Dec 04 00:47:08.105625 master-0 kubenswrapper[33142]: I1204 00:47:08.105556 33142 generic.go:334] "Generic (PLEG): container finished" podID="4adeb2c2-10ba-420a-be0b-fb2329ac3fe2" containerID="41249359c992651f9b40fe7acef8e75583a599ff2b66ec8076f8be460e15df7d" exitCode=0 Dec 04 00:47:08.116411 master-0 kubenswrapper[33142]: I1204 00:47:08.116339 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 00:47:08.116733 master-0 kubenswrapper[33142]: I1204 00:47:08.116401 33142 generic.go:334] "Generic (PLEG): container finished" podID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerID="d96499e83423aa41557961bd962596742a89753f0be63a3ad713fb62a1bb63b2" exitCode=1 Dec 04 00:47:08.119099 master-0 kubenswrapper[33142]: I1204 00:47:08.119028 33142 generic.go:334] "Generic (PLEG): container finished" podID="975f6a6f-1fbb-49e1-8a0a-722586355364" containerID="e689fbef6d70030a6b0b4a7df461d6fca5d2b1590d1c7473a4818b8d5705082c" exitCode=0 Dec 04 00:47:08.119099 master-0 kubenswrapper[33142]: I1204 00:47:08.119081 33142 generic.go:334] "Generic (PLEG): container finished" podID="975f6a6f-1fbb-49e1-8a0a-722586355364" containerID="79d9c7dd12437812250729ab6ecd35ebbdf85e465fd2ec2d4125aeda4fd082a4" exitCode=0 Dec 04 00:47:08.123761 master-0 kubenswrapper[33142]: I1204 00:47:08.123703 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-lxpmq_0616abbd-748a-4451-96b7-df0178c99e8f/approver/1.log" Dec 04 00:47:08.124563 master-0 kubenswrapper[33142]: I1204 00:47:08.124502 33142 generic.go:334] "Generic (PLEG): container finished" podID="0616abbd-748a-4451-96b7-df0178c99e8f" containerID="915090778ed7f24642c4c3dad60f3307b9a7c339add79ef86c951bd0fd6a05e3" exitCode=1 Dec 04 00:47:08.127458 master-0 kubenswrapper[33142]: I1204 00:47:08.127425 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_b495b0c38f2c54e7cc46282c5f92aab5/kube-rbac-proxy-crio/2.log" Dec 04 00:47:08.127961 master-0 kubenswrapper[33142]: I1204 00:47:08.127910 33142 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c" exitCode=1 Dec 04 00:47:08.127961 master-0 kubenswrapper[33142]: I1204 00:47:08.127956 33142 generic.go:334] "Generic (PLEG): container finished" podID="b495b0c38f2c54e7cc46282c5f92aab5" containerID="56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532" exitCode=0 Dec 04 00:47:08.130372 master-0 kubenswrapper[33142]: I1204 00:47:08.130273 33142 generic.go:334] "Generic (PLEG): container finished" podID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerID="fedd774b5398f0119e888631e667565bbef54e542a0cb27a2bea0c11c45d161f" exitCode=0 Dec 04 00:47:08.135448 master-0 kubenswrapper[33142]: I1204 00:47:08.135363 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/machine-api-operator/0.log" Dec 04 00:47:08.136071 master-0 kubenswrapper[33142]: I1204 00:47:08.136031 33142 generic.go:334] "Generic (PLEG): container finished" podID="e852069a-82f1-4121-9d86-277b8ca07370" containerID="cac1a420acb28af33b28f244c49fd2673d1e17a48f3b917cbbd4e2767cc69b94" exitCode=255 Dec 04 00:47:08.143553 master-0 kubenswrapper[33142]: I1204 00:47:08.143446 33142 generic.go:334] "Generic (PLEG): container finished" podID="4b5c0b0e-6015-473f-b7b8-0e91900cd82d" containerID="cd7a6fc7079a4931c7aa831daced8240cbd41b8c609540c81117d50d9ee6f498" exitCode=0 Dec 04 00:47:08.149253 master-0 kubenswrapper[33142]: I1204 00:47:08.149188 33142 generic.go:334] "Generic (PLEG): container finished" podID="7e83f444-49e8-40b5-9a58-3128002f28c9" containerID="1e6348590b5cd61d8f68dbce714358a044d7ae6003c498bcd2a36157fac20e6b" exitCode=0 Dec 04 00:47:08.149253 master-0 kubenswrapper[33142]: I1204 00:47:08.149240 33142 generic.go:334] "Generic (PLEG): container finished" podID="7e83f444-49e8-40b5-9a58-3128002f28c9" containerID="be6a6b316c4984f8a2b50ae86401f8c00923107cb95d0cd4b15dcef413f3ad38" exitCode=0 Dec 04 00:47:08.161977 master-0 kubenswrapper[33142]: I1204 00:47:08.161865 33142 generic.go:334] "Generic (PLEG): container finished" podID="7af17f6f-6bda-4972-a72a-9d9059cd2fa6" containerID="d7e932bfc93d6424ba109adf9ccfa0aad6919b98e264b7ab4e4f0ba5956458fd" exitCode=0 Dec 04 00:47:08.169073 master-0 kubenswrapper[33142]: I1204 00:47:08.168973 33142 generic.go:334] "Generic (PLEG): container finished" podID="46a9c1fd-6e78-4d87-85ef-f8fc195bb980" containerID="757db1e370e5b4cbd7b221ef1b6bf638c1107af84e7d48c8bb84579675cd71b1" exitCode=0 Dec 04 00:47:08.171063 master-0 kubenswrapper[33142]: I1204 00:47:08.171021 33142 generic.go:334] "Generic (PLEG): container finished" podID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerID="fa783d35d4eac378504f1998f5b24825e94944f2ad0fc300c6862451a2e4a6c6" exitCode=0 Dec 04 00:47:08.185996 master-0 kubenswrapper[33142]: I1204 00:47:08.185824 33142 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="bfda60e9468bd1f09a61e5566915637d02a3202a0e4b0c3c89ce083d4719858b" exitCode=0 Dec 04 00:47:08.185996 master-0 kubenswrapper[33142]: I1204 00:47:08.185898 33142 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="f951fe8d6420f20633e9aa099f7a29a56295f060f029ad2921bd92a9bc5f21b3" exitCode=0 Dec 04 00:47:08.185996 master-0 kubenswrapper[33142]: I1204 00:47:08.185910 33142 generic.go:334] "Generic (PLEG): container finished" podID="4dd8b778e190b1975a0a8fad534da6dd" containerID="4f0e5e65ec23a0d46db6114295e8e2ea0c7aa061d233e49d8004312b84bad2da" exitCode=0 Dec 04 00:47:08.192168 master-0 kubenswrapper[33142]: I1204 00:47:08.192110 33142 generic.go:334] "Generic (PLEG): container finished" podID="87c52add-1fdc-4227-b1b1-76f3653e3fb0" containerID="901cafaddfb48ad12a48e90f2d27e69834e9c9300ce76bcf5ec911ddb71f0294" exitCode=0 Dec 04 00:47:08.197241 master-0 kubenswrapper[33142]: E1204 00:47:08.197194 33142 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 00:47:08.197404 master-0 kubenswrapper[33142]: I1204 00:47:08.197335 33142 generic.go:334] "Generic (PLEG): container finished" podID="dd621016-f4f2-4839-aae0-a804e6023423" containerID="3a39d58bf14a8a0237f78a42a4d77a9a5f5be020fc17c1b7fa5678e3282f18dc" exitCode=0 Dec 04 00:47:08.218632 master-0 kubenswrapper[33142]: I1204 00:47:08.218531 33142 generic.go:334] "Generic (PLEG): container finished" podID="3e104a8c-66dc-4a9a-836f-656e6f4cc923" containerID="d0c2b162740018e46456402872eb28a1d15f5b59d45bffcefe5f2776b4811d37" exitCode=0 Dec 04 00:47:08.224144 master-0 kubenswrapper[33142]: I1204 00:47:08.224065 33142 generic.go:334] "Generic (PLEG): container finished" podID="f4d39cde-d7b9-4156-afd1-cc4f23b9b16a" containerID="fd3589300b36ad6c047594904bec153361e0713f63741a4acf7e0ce1f226f895" exitCode=0 Dec 04 00:47:08.227156 master-0 kubenswrapper[33142]: I1204 00:47:08.227095 33142 generic.go:334] "Generic (PLEG): container finished" podID="ca8eddb5-4600-4058-94d2-5d0308c32613" containerID="53f3ad5a02fe61d14e3118f30603f785f895999675e16d3f4049dea7bd628227" exitCode=0 Dec 04 00:47:08.348701 master-0 kubenswrapper[33142]: I1204 00:47:08.348629 33142 manager.go:324] Recovery completed Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.444531 33142 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.444591 33142 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.444694 33142 state_mem.go:36] "Initialized new in-memory state store" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.445056 33142 state_mem.go:88] "Updated default CPUSet" cpuSet="" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.445078 33142 state_mem.go:96] "Updated CPUSet assignments" assignments={} Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.445112 33142 state_checkpoint.go:136] "State checkpoint: restored state from checkpoint" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.445127 33142 state_checkpoint.go:137] "State checkpoint: defaultCPUSet" defaultCpuSet="" Dec 04 00:47:08.447042 master-0 kubenswrapper[33142]: I1204 00:47:08.445140 33142 policy_none.go:49] "None policy: Start" Dec 04 00:47:08.453130 master-0 kubenswrapper[33142]: I1204 00:47:08.453077 33142 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 00:47:08.453222 master-0 kubenswrapper[33142]: I1204 00:47:08.453133 33142 state_mem.go:35] "Initializing new in-memory state store" Dec 04 00:47:08.453521 master-0 kubenswrapper[33142]: I1204 00:47:08.453484 33142 state_mem.go:75] "Updated machine memory state" Dec 04 00:47:08.453521 master-0 kubenswrapper[33142]: I1204 00:47:08.453513 33142 state_checkpoint.go:82] "State checkpoint: restored state from checkpoint" Dec 04 00:47:08.481530 master-0 kubenswrapper[33142]: I1204 00:47:08.481443 33142 manager.go:334] "Starting Device Plugin manager" Dec 04 00:47:08.481530 master-0 kubenswrapper[33142]: I1204 00:47:08.481525 33142 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 00:47:08.481900 master-0 kubenswrapper[33142]: I1204 00:47:08.481549 33142 server.go:79] "Starting device plugin registration server" Dec 04 00:47:08.482283 master-0 kubenswrapper[33142]: I1204 00:47:08.482234 33142 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 00:47:08.482385 master-0 kubenswrapper[33142]: I1204 00:47:08.482265 33142 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 00:47:08.482601 master-0 kubenswrapper[33142]: I1204 00:47:08.482548 33142 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 00:47:08.482715 master-0 kubenswrapper[33142]: I1204 00:47:08.482696 33142 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 00:47:08.482715 master-0 kubenswrapper[33142]: I1204 00:47:08.482711 33142 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 00:47:08.584223 master-0 kubenswrapper[33142]: I1204 00:47:08.584143 33142 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:47:08.588410 master-0 kubenswrapper[33142]: I1204 00:47:08.588343 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:47:08.588489 master-0 kubenswrapper[33142]: I1204 00:47:08.588425 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:47:08.588489 master-0 kubenswrapper[33142]: I1204 00:47:08.588457 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:47:08.588662 master-0 kubenswrapper[33142]: I1204 00:47:08.588626 33142 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:47:08.593571 master-0 kubenswrapper[33142]: E1204 00:47:08.593486 33142 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes \"master-0\" is forbidden: autoscaling.openshift.io/ManagedNode infra config cache not synchronized" node="master-0" Dec 04 00:47:08.597388 master-0 kubenswrapper[33142]: I1204 00:47:08.597319 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-etcd/etcd-master-0","openshift-kube-apiserver/kube-apiserver-master-0","openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0","openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:08.598902 master-0 kubenswrapper[33142]: I1204 00:47:08.598805 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"d087c5369abafac8257323e4a3cdee0afd5095e579509890d896a866c8dc7850"} Dec 04 00:47:08.599047 master-0 kubenswrapper[33142]: I1204 00:47:08.598904 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"b161863113c6139a611f04e59906422e687c026b8160b780bb0e96afed49b6e2"} Dec 04 00:47:08.599047 master-0 kubenswrapper[33142]: I1204 00:47:08.598972 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"a720c84c34a3a85156a6762f68a4fbd1f22af6519f05ed2a56176eb6f32551b8"} Dec 04 00:47:08.599047 master-0 kubenswrapper[33142]: I1204 00:47:08.598996 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerDied","Data":"a433747788e31b911be2d5dee0f4d95602e43d74e31e597fb77efe46bd44281f"} Dec 04 00:47:08.599165 master-0 kubenswrapper[33142]: I1204 00:47:08.599054 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"fd2fa610bb2a39c39fcdd00db03a511a","Type":"ContainerStarted","Data":"3e687558ac9303feb73670490b1fecaf558fff432fa6eb10eb8333dd042f763b"} Dec 04 00:47:08.599165 master-0 kubenswrapper[33142]: I1204 00:47:08.599080 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1e66fb87ca9cfd25135e6c5da5375ffe9b7845876b1d605d0336a5b5d2aff3f" Dec 04 00:47:08.599165 master-0 kubenswrapper[33142]: I1204 00:47:08.599111 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="141db83ebfaa98384885b96b46a0566c73e0126df52aa7b221371a34fa1078d1" Dec 04 00:47:08.599267 master-0 kubenswrapper[33142]: I1204 00:47:08.599181 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="987985e70a2163b6066b5e2f456d1cc2a0a89fb34d199cab23eb0835c758af7f" Dec 04 00:47:08.599881 master-0 kubenswrapper[33142]: I1204 00:47:08.599831 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65d5f5d3e928c35921c10273836829e2d47edcee6fed1b02889fec8d43f7ce51" Dec 04 00:47:08.599881 master-0 kubenswrapper[33142]: I1204 00:47:08.599871 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb"} Dec 04 00:47:08.600013 master-0 kubenswrapper[33142]: I1204 00:47:08.599895 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c"} Dec 04 00:47:08.600013 master-0 kubenswrapper[33142]: I1204 00:47:08.599916 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1"} Dec 04 00:47:08.600013 master-0 kubenswrapper[33142]: I1204 00:47:08.599966 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e"} Dec 04 00:47:08.600013 master-0 kubenswrapper[33142]: I1204 00:47:08.599984 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4"} Dec 04 00:47:08.600013 master-0 kubenswrapper[33142]: I1204 00:47:08.600001 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerDied","Data":"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15"} Dec 04 00:47:08.600192 master-0 kubenswrapper[33142]: I1204 00:47:08.600022 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"382c2026eb84cf3d7672e1fe1646be64","Type":"ContainerStarted","Data":"4dc69b666c729a576cf43bf0fec73a35870b638132e27e16c52e1ad9b4d92599"} Dec 04 00:47:08.600192 master-0 kubenswrapper[33142]: I1204 00:47:08.600044 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b98650c65c20f2dc4c4dfb9e71ac8d03ae356fc9e3daaf8e40e4d7945991ada2" Dec 04 00:47:08.600192 master-0 kubenswrapper[33142]: I1204 00:47:08.600121 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4b83ab4443aa0c31704f38f77c4aaefe8bb38a88f809f9098c0a8032fdc6bbc" Dec 04 00:47:08.600301 master-0 kubenswrapper[33142]: I1204 00:47:08.600195 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c995af96c184bdbdd4444fee0c5422622d07b5a65a6f75d3cf670d3adbfc1fa" Dec 04 00:47:08.600301 master-0 kubenswrapper[33142]: I1204 00:47:08.600267 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} Dec 04 00:47:08.600301 master-0 kubenswrapper[33142]: I1204 00:47:08.600285 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600305 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600325 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600342 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600362 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600381 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerDied","Data":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} Dec 04 00:47:08.600402 master-0 kubenswrapper[33142]: I1204 00:47:08.600398 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"61b999b2e31764aaaf13d451199f7b0e","Type":"ContainerStarted","Data":"a8717ac80c22c92cff6d37ee74e62111c9e3a0771e7681211972cbd1e6b3c8ef"} Dec 04 00:47:08.600611 master-0 kubenswrapper[33142]: I1204 00:47:08.600461 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="360aa2f800ebc371b90264db00ef3c6f070c26b5e1b69133ede5ca8a3538ec5b" Dec 04 00:47:08.600611 master-0 kubenswrapper[33142]: I1204 00:47:08.600502 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084586157faa24ecc65c93b4d38e32fb734bb9420e68aafeeda15ecd3581f978" Dec 04 00:47:08.600611 master-0 kubenswrapper[33142]: I1204 00:47:08.600544 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c82e9c8b94a9501a586c5f07670a3bc3c87b2a325c36fbb83d25e6fcb238763b" Dec 04 00:47:08.600611 master-0 kubenswrapper[33142]: I1204 00:47:08.600605 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e1da84269661a20bf7c11520351b241d1d7e4935e72cd3b83bd80eb3a79e2b0" Dec 04 00:47:08.600748 master-0 kubenswrapper[33142]: I1204 00:47:08.600647 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"d3bf5f95f064d6d4c06a0006d3f20c777a30163e26ecd49576d8d891cf10c17b"} Dec 04 00:47:08.600748 master-0 kubenswrapper[33142]: I1204 00:47:08.600666 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"57a2c4f8f4edeef9c494354bab1a503e0c76ac152a6b0d8f208235a74a698c9c"} Dec 04 00:47:08.600748 master-0 kubenswrapper[33142]: I1204 00:47:08.600686 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerDied","Data":"56d22248ee4c98c4e41b2afd16bba244e0361795af499523c1fe227802ae2532"} Dec 04 00:47:08.600748 master-0 kubenswrapper[33142]: I1204 00:47:08.600707 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"b495b0c38f2c54e7cc46282c5f92aab5","Type":"ContainerStarted","Data":"00acc7a57f5c5446a615d0c205815dab14f41590f7345348e33f759b9e577e5b"} Dec 04 00:47:08.600748 master-0 kubenswrapper[33142]: I1204 00:47:08.600728 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce0e2e76d8332917071c6298991ac2f7d87882c9a3820d43da2be3639d890081" Dec 04 00:47:08.600918 master-0 kubenswrapper[33142]: I1204 00:47:08.600843 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0451d76943e54baf31ba16ee33fa613c424ee3dd7503ebad380d4c809a4d8cb1" Dec 04 00:47:08.600918 master-0 kubenswrapper[33142]: I1204 00:47:08.600868 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"04eaa0d1e99785cc1b2c1318fb89cd242f6c9e21b8d818d07d3c042a6d8475fc"} Dec 04 00:47:08.600918 master-0 kubenswrapper[33142]: I1204 00:47:08.600886 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"73a0a851fc87078c91307a057c74b8897b9a941bd7c6acebecf52bbe87adbf2f"} Dec 04 00:47:08.600918 master-0 kubenswrapper[33142]: I1204 00:47:08.600905 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"e5a3bb33b325eef7f383c0d659e0c02d068419e9a7e184bfd8398e85be8ec9d8"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.600922 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"3dc53442451539a70d9cbd440858ffdafc4bc2364b6f832ccbfb1ad0f4b49d4e"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.600970 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"50bc3ef940109b58d6db2f4987717d4d8bf043dc726131752c9f5868f606431e"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.600988 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"bfda60e9468bd1f09a61e5566915637d02a3202a0e4b0c3c89ce083d4719858b"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.601009 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"f951fe8d6420f20633e9aa099f7a29a56295f060f029ad2921bd92a9bc5f21b3"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.601028 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerDied","Data":"4f0e5e65ec23a0d46db6114295e8e2ea0c7aa061d233e49d8004312b84bad2da"} Dec 04 00:47:08.601081 master-0 kubenswrapper[33142]: I1204 00:47:08.601048 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"4dd8b778e190b1975a0a8fad534da6dd","Type":"ContainerStarted","Data":"4ee3dd7cd38da2c920657ce4d7b82c0b34d9d38275312a1c0eadf1bcf0b5d640"} Dec 04 00:47:08.601322 master-0 kubenswrapper[33142]: I1204 00:47:08.601111 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"cbad610cd8689b0972c02840bb486a62","Type":"ContainerStarted","Data":"5d0a33c64da0b1dd5560e6a19900c4795c94210bc6ff9cbffed5612130d3fbf2"} Dec 04 00:47:08.601322 master-0 kubenswrapper[33142]: I1204 00:47:08.601162 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"cbad610cd8689b0972c02840bb486a62","Type":"ContainerStarted","Data":"3cf96bd05b53d165383a3c610342b4df44e3aa665e8a5ebd50e7627e5c9d60cf"} Dec 04 00:47:08.625542 master-0 kubenswrapper[33142]: E1204 00:47:08.625444 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-apiserver-startup-monitor-master-0\" already exists" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.626738 master-0 kubenswrapper[33142]: E1204 00:47:08.626660 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-master-0\" already exists" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.627263 master-0 kubenswrapper[33142]: E1204 00:47:08.627215 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"openshift-kube-scheduler-master-0\" already exists" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.627569 master-0 kubenswrapper[33142]: E1204 00:47:08.627522 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0\" already exists" pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.685391 master-0 kubenswrapper[33142]: I1204 00:47:08.685317 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.685391 master-0 kubenswrapper[33142]: I1204 00:47:08.685367 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.685391 master-0 kubenswrapper[33142]: I1204 00:47:08.685396 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685418 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685440 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685458 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685476 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685494 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685514 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685533 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.686632 master-0 kubenswrapper[33142]: I1204 00:47:08.685909 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.698041 master-0 kubenswrapper[33142]: I1204 00:47:08.697885 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.698041 master-0 kubenswrapper[33142]: I1204 00:47:08.697990 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.698198 master-0 kubenswrapper[33142]: I1204 00:47:08.698080 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.698198 master-0 kubenswrapper[33142]: I1204 00:47:08.698124 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.698198 master-0 kubenswrapper[33142]: I1204 00:47:08.698151 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.698198 master-0 kubenswrapper[33142]: I1204 00:47:08.698175 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.698434 master-0 kubenswrapper[33142]: I1204 00:47:08.698242 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.698434 master-0 kubenswrapper[33142]: I1204 00:47:08.698268 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.698434 master-0 kubenswrapper[33142]: I1204 00:47:08.698288 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.788958 master-0 kubenswrapper[33142]: I1204 00:47:08.788863 33142 apiserver.go:52] "Watching apiserver" Dec 04 00:47:08.794249 master-0 kubenswrapper[33142]: I1204 00:47:08.794164 33142 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:47:08.798649 master-0 kubenswrapper[33142]: I1204 00:47:08.798593 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.798730 master-0 kubenswrapper[33142]: I1204 00:47:08.798668 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.798730 master-0 kubenswrapper[33142]: I1204 00:47:08.798708 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798744 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798775 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798808 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798838 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798842 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.798881 master-0 kubenswrapper[33142]: I1204 00:47:08.798876 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.798893 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799012 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.798918 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799036 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799035 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.798737 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.798856 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b495b0c38f2c54e7cc46282c5f92aab5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"b495b0c38f2c54e7cc46282c5f92aab5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799095 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799145 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.798803 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799175 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.799230 master-0 kubenswrapper[33142]: I1204 00:47:08.799115 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-usr-local-bin\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799238 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799213 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799283 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799337 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-resource-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799347 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799395 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799400 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-cert-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799439 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799451 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799415 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799498 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799521 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799544 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799531 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799554 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799638 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799679 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799699 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-static-pod-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799742 33142 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:47:08.799764 master-0 kubenswrapper[33142]: I1204 00:47:08.799772 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-data-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.800467 master-0 kubenswrapper[33142]: I1204 00:47:08.799773 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/fd2fa610bb2a39c39fcdd00db03a511a-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"fd2fa610bb2a39c39fcdd00db03a511a\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:08.800467 master-0 kubenswrapper[33142]: I1204 00:47:08.799785 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.800467 master-0 kubenswrapper[33142]: I1204 00:47:08.799739 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/4dd8b778e190b1975a0a8fad534da6dd-log-dir\") pod \"etcd-master-0\" (UID: \"4dd8b778e190b1975a0a8fad534da6dd\") " pod="openshift-etcd/etcd-master-0" Dec 04 00:47:08.804315 master-0 kubenswrapper[33142]: E1204 00:47:08.804260 33142 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes \"master-0\" is forbidden: autoscaling.openshift.io/ManagedNode infra config cache not synchronized" node="master-0" Dec 04 00:47:08.822139 master-0 kubenswrapper[33142]: I1204 00:47:08.822067 33142 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 00:47:08.825431 master-0 kubenswrapper[33142]: I1204 00:47:08.825311 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24","openshift-ingress/router-default-54f97f57-x27s4","openshift-kube-scheduler/openshift-kube-scheduler-master-0","openshift-marketplace/certified-operators-m4q5k","openshift-network-operator/network-operator-6cbf58c977-vjwnj","openshift-ovn-kubernetes/ovnkube-node-kgflj","openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn","openshift-etcd/installer-2-master-0","openshift-kube-controller-manager/installer-3-master-0","openshift-marketplace/community-operators-dvxb6","openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht","assisted-installer/assisted-installer-controller-6cf87","openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs","openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72","openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf","openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5","openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl","openshift-etcd/installer-1-master-0","openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf","openshift-kube-scheduler/installer-5-master-0","openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx","openshift-monitoring/metrics-server-6b4bbf8466-qk67v","openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc","openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm","openshift-ingress-canary/ingress-canary-rn56p","openshift-insights/insights-operator-59d99f9b7b-jl84b","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-multus/network-metrics-daemon-t85qp","openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l","openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g","openshift-kube-apiserver/installer-1-master-0","openshift-machine-config-operator/machine-config-daemon-dhr5k","openshift-marketplace/redhat-marketplace-zc792","openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn","openshift-monitoring/prometheus-operator-565bdcb8-8dcsg","openshift-multus/multus-admission-controller-5bdcc987c4-s85ld","openshift-cluster-node-tuning-operator/tuned-df7ld","openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6","openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2","openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p","openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn","openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx","openshift-etcd/etcd-master-0","openshift-kube-scheduler/installer-4-master-0","openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2","openshift-dns/dns-default-cr7sj","openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0","openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx","openshift-marketplace/redhat-operators-cl29d","openshift-network-diagnostics/network-check-target-w5f2j","openshift-oauth-apiserver/apiserver-87cd489bc-llsfr","openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q","openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr","openshift-controller-manager/controller-manager-6555cd6548-djfrg","openshift-network-operator/iptables-alerter-zm8h9","openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r","openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm","openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p","openshift-dns/node-resolver-5bwrm","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p","openshift-machine-api/machine-api-operator-7486ff55f-tnhrb","openshift-machine-config-operator/machine-config-server-kl9fp","openshift-monitoring/node-exporter-pcpjf","openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q","openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8","openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb","openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw","openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84","openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw","openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz","openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr","openshift-ingress-operator/ingress-operator-85dbd94574-7clvx","openshift-multus/multus-additional-cni-plugins-jglkq","openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq","openshift-network-node-identity/network-node-identity-lxpmq","openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg","openshift-service-ca/service-ca-6b8bb995f7-rwmbh","openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs","openshift-apiserver/apiserver-56f6ccc758-vsg29","openshift-kube-controller-manager/installer-2-master-0","openshift-kube-controller-manager/kube-controller-manager-master-0","openshift-multus/multus-w7796","openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc","openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m","openshift-kube-apiserver/kube-apiserver-master-0","openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7","openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj","openshift-kube-apiserver/installer-3-master-0"] Dec 04 00:47:08.825728 master-0 kubenswrapper[33142]: I1204 00:47:08.825682 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-6cf87" Dec 04 00:47:08.836685 master-0 kubenswrapper[33142]: I1204 00:47:08.836235 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 00:47:08.836914 master-0 kubenswrapper[33142]: I1204 00:47:08.836701 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 00:47:08.840334 master-0 kubenswrapper[33142]: I1204 00:47:08.839815 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 00:47:08.841025 master-0 kubenswrapper[33142]: I1204 00:47:08.840970 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 00:47:08.843077 master-0 kubenswrapper[33142]: I1204 00:47:08.843027 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.843194 master-0 kubenswrapper[33142]: I1204 00:47:08.843027 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 00:47:08.843194 master-0 kubenswrapper[33142]: I1204 00:47:08.843139 33142 kubelet.go:2566] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="f1b21e83-7c96-4be2-8f13-9c8d1b622d36" Dec 04 00:47:08.843692 master-0 kubenswrapper[33142]: I1204 00:47:08.843658 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 00:47:08.843781 master-0 kubenswrapper[33142]: I1204 00:47:08.843744 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 00:47:08.843844 master-0 kubenswrapper[33142]: I1204 00:47:08.843833 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 00:47:08.843971 master-0 kubenswrapper[33142]: I1204 00:47:08.843950 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 00:47:08.844065 master-0 kubenswrapper[33142]: I1204 00:47:08.844035 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 00:47:08.844153 master-0 kubenswrapper[33142]: I1204 00:47:08.844119 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 00:47:08.844275 master-0 kubenswrapper[33142]: I1204 00:47:08.844242 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 00:47:08.844910 master-0 kubenswrapper[33142]: I1204 00:47:08.844851 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.845055 master-0 kubenswrapper[33142]: I1204 00:47:08.845009 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 00:47:08.845248 master-0 kubenswrapper[33142]: I1204 00:47:08.845174 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 00:47:08.845338 master-0 kubenswrapper[33142]: I1204 00:47:08.845280 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 00:47:08.846174 master-0 kubenswrapper[33142]: I1204 00:47:08.846130 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 00:47:08.846286 master-0 kubenswrapper[33142]: I1204 00:47:08.846216 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 00:47:08.846612 master-0 kubenswrapper[33142]: I1204 00:47:08.846511 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw" Dec 04 00:47:08.846612 master-0 kubenswrapper[33142]: I1204 00:47:08.846580 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 00:47:08.846914 master-0 kubenswrapper[33142]: I1204 00:47:08.846642 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 00:47:08.846914 master-0 kubenswrapper[33142]: I1204 00:47:08.846743 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 00:47:08.848683 master-0 kubenswrapper[33142]: I1204 00:47:08.848636 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 00:47:08.848918 master-0 kubenswrapper[33142]: I1204 00:47:08.848876 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 00:47:08.849064 master-0 kubenswrapper[33142]: I1204 00:47:08.849022 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.849184 master-0 kubenswrapper[33142]: I1204 00:47:08.849149 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 00:47:08.849324 master-0 kubenswrapper[33142]: I1204 00:47:08.849291 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 00:47:08.849596 master-0 kubenswrapper[33142]: I1204 00:47:08.849562 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.850045 master-0 kubenswrapper[33142]: I1204 00:47:08.849994 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 00:47:08.850616 master-0 kubenswrapper[33142]: I1204 00:47:08.850571 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 00:47:08.853085 master-0 kubenswrapper[33142]: I1204 00:47:08.853046 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 00:47:08.855194 master-0 kubenswrapper[33142]: I1204 00:47:08.855155 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 00:47:08.855341 master-0 kubenswrapper[33142]: I1204 00:47:08.855240 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 00:47:08.855341 master-0 kubenswrapper[33142]: I1204 00:47:08.855281 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.855601 master-0 kubenswrapper[33142]: I1204 00:47:08.855570 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 00:47:08.855757 master-0 kubenswrapper[33142]: I1204 00:47:08.855729 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.855915 master-0 kubenswrapper[33142]: I1204 00:47:08.855890 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 00:47:08.855967 master-0 kubenswrapper[33142]: I1204 00:47:08.855906 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 00:47:08.857053 master-0 kubenswrapper[33142]: I1204 00:47:08.856077 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 00:47:08.857217 master-0 kubenswrapper[33142]: I1204 00:47:08.856161 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 00:47:08.857868 master-0 kubenswrapper[33142]: I1204 00:47:08.857833 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 00:47:08.857960 master-0 kubenswrapper[33142]: I1204 00:47:08.857899 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.860134 master-0 kubenswrapper[33142]: I1204 00:47:08.859674 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 00:47:08.860134 master-0 kubenswrapper[33142]: I1204 00:47:08.859806 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 00:47:08.860134 master-0 kubenswrapper[33142]: I1204 00:47:08.859947 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 00:47:08.860134 master-0 kubenswrapper[33142]: I1204 00:47:08.860075 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.860134 master-0 kubenswrapper[33142]: I1204 00:47:08.860118 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 00:47:08.860506 master-0 kubenswrapper[33142]: I1204 00:47:08.860167 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.860506 master-0 kubenswrapper[33142]: I1204 00:47:08.860339 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 00:47:08.860506 master-0 kubenswrapper[33142]: I1204 00:47:08.860378 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:47:08.860506 master-0 kubenswrapper[33142]: I1204 00:47:08.860391 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.860665 master-0 kubenswrapper[33142]: I1204 00:47:08.860542 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 00:47:08.860665 master-0 kubenswrapper[33142]: I1204 00:47:08.860577 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 00:47:08.860665 master-0 kubenswrapper[33142]: I1204 00:47:08.860633 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.860784 master-0 kubenswrapper[33142]: I1204 00:47:08.860668 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 00:47:08.860784 master-0 kubenswrapper[33142]: I1204 00:47:08.860720 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 00:47:08.860784 master-0 kubenswrapper[33142]: I1204 00:47:08.860742 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 00:47:08.860902 master-0 kubenswrapper[33142]: I1204 00:47:08.860851 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 00:47:08.860902 master-0 kubenswrapper[33142]: I1204 00:47:08.860880 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 00:47:08.861312 master-0 kubenswrapper[33142]: I1204 00:47:08.861260 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 00:47:08.861459 master-0 kubenswrapper[33142]: I1204 00:47:08.861398 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 00:47:08.861503 master-0 kubenswrapper[33142]: I1204 00:47:08.861473 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 00:47:08.861768 master-0 kubenswrapper[33142]: I1204 00:47:08.861715 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 00:47:08.861768 master-0 kubenswrapper[33142]: I1204 00:47:08.861761 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 00:47:08.862668 master-0 kubenswrapper[33142]: I1204 00:47:08.862590 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 00:47:08.862870 master-0 kubenswrapper[33142]: I1204 00:47:08.862801 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:47:08.863587 master-0 kubenswrapper[33142]: I1204 00:47:08.863542 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 00:47:08.867344 master-0 kubenswrapper[33142]: I1204 00:47:08.867284 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 00:47:08.870658 master-0 kubenswrapper[33142]: I1204 00:47:08.870598 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 00:47:08.871655 master-0 kubenswrapper[33142]: I1204 00:47:08.871619 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 00:47:08.872092 master-0 kubenswrapper[33142]: I1204 00:47:08.872058 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 00:47:08.872206 master-0 kubenswrapper[33142]: I1204 00:47:08.872162 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 00:47:08.873295 master-0 kubenswrapper[33142]: I1204 00:47:08.873215 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht" Dec 04 00:47:08.873295 master-0 kubenswrapper[33142]: I1204 00:47:08.873287 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.873520 master-0 kubenswrapper[33142]: I1204 00:47:08.873491 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:47:08.873700 master-0 kubenswrapper[33142]: I1204 00:47:08.873658 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 00:47:08.874000 master-0 kubenswrapper[33142]: I1204 00:47:08.873918 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:47:08.874273 master-0 kubenswrapper[33142]: I1204 00:47:08.874220 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 00:47:08.875002 master-0 kubenswrapper[33142]: I1204 00:47:08.874780 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:08.875002 master-0 kubenswrapper[33142]: I1204 00:47:08.874962 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 00:47:08.877425 master-0 kubenswrapper[33142]: I1204 00:47:08.877367 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 00:47:08.879727 master-0 kubenswrapper[33142]: I1204 00:47:08.879679 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 00:47:08.879971 master-0 kubenswrapper[33142]: I1204 00:47:08.879912 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 00:47:08.880072 master-0 kubenswrapper[33142]: I1204 00:47:08.879914 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 00:47:08.880138 master-0 kubenswrapper[33142]: I1204 00:47:08.880069 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 00:47:08.881411 master-0 kubenswrapper[33142]: I1204 00:47:08.881341 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 00:47:08.882066 master-0 kubenswrapper[33142]: I1204 00:47:08.881466 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 00:47:08.883559 master-0 kubenswrapper[33142]: I1204 00:47:08.883522 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 00:47:08.883713 master-0 kubenswrapper[33142]: I1204 00:47:08.883684 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 00:47:08.884225 master-0 kubenswrapper[33142]: I1204 00:47:08.884143 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 00:47:08.885571 master-0 kubenswrapper[33142]: I1204 00:47:08.885545 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 00:47:08.886185 master-0 kubenswrapper[33142]: I1204 00:47:08.886150 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 00:47:08.886274 master-0 kubenswrapper[33142]: I1204 00:47:08.886223 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 00:47:08.886605 master-0 kubenswrapper[33142]: I1204 00:47:08.886565 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 00:47:08.886756 master-0 kubenswrapper[33142]: I1204 00:47:08.886704 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 00:47:08.886854 master-0 kubenswrapper[33142]: I1204 00:47:08.886824 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 00:47:08.886854 master-0 kubenswrapper[33142]: I1204 00:47:08.886843 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 00:47:08.887005 master-0 kubenswrapper[33142]: I1204 00:47:08.886869 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 00:47:08.887076 master-0 kubenswrapper[33142]: I1204 00:47:08.887055 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 00:47:08.887218 master-0 kubenswrapper[33142]: I1204 00:47:08.887177 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 00:47:08.887482 master-0 kubenswrapper[33142]: I1204 00:47:08.887445 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 00:47:08.887977 master-0 kubenswrapper[33142]: I1204 00:47:08.887910 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 00:47:08.889778 master-0 kubenswrapper[33142]: I1204 00:47:08.889730 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 00:47:08.890254 master-0 kubenswrapper[33142]: I1204 00:47:08.890216 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 00:47:08.890563 master-0 kubenswrapper[33142]: I1204 00:47:08.890525 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 00:47:08.895062 master-0 kubenswrapper[33142]: I1204 00:47:08.895034 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 00:47:08.895221 master-0 kubenswrapper[33142]: I1204 00:47:08.895198 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 00:47:08.896237 master-0 kubenswrapper[33142]: I1204 00:47:08.896200 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 00:47:08.896555 master-0 kubenswrapper[33142]: I1204 00:47:08.896507 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 00:47:08.900974 master-0 kubenswrapper[33142]: I1204 00:47:08.900868 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bnmjf\" (UniqueName: \"kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:47:08.900974 master-0 kubenswrapper[33142]: I1204 00:47:08.900955 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:47:08.901126 master-0 kubenswrapper[33142]: I1204 00:47:08.900987 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.901126 master-0 kubenswrapper[33142]: I1204 00:47:08.901013 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.901126 master-0 kubenswrapper[33142]: I1204 00:47:08.901036 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:08.901126 master-0 kubenswrapper[33142]: I1204 00:47:08.901061 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.901126 master-0 kubenswrapper[33142]: I1204 00:47:08.901082 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901137 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901166 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901196 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901223 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901255 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901279 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.901337 master-0 kubenswrapper[33142]: I1204 00:47:08.901300 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901350 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901371 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901391 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901440 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901459 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901500 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901520 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901544 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901567 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.901623 master-0 kubenswrapper[33142]: I1204 00:47:08.901596 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sslx5\" (UniqueName: \"kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901625 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901678 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cfcxz\" (UniqueName: \"kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-trusted-ca\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901702 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901783 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovn-node-metrics-cert\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901788 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.901974 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:08.902090 master-0 kubenswrapper[33142]: I1204 00:47:08.902041 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902098 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902149 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-profile-collector-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902167 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902239 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655dc370-c0d1-4d03-a317-64bf099aff1b-serving-cert\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902272 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902313 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/47152378-4ef5-4eff-9b30-fd8635982f02-cache\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.902409 master-0 kubenswrapper[33142]: I1204 00:47:08.902344 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902416 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902498 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902586 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902640 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902618 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-snapshots\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902632 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-catalog-content\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:08.902747 master-0 kubenswrapper[33142]: I1204 00:47:08.902702 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.902778 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a5721ad-a077-439a-9ec0-57d90dfb5c14-serving-cert\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.902848 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.902856 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/c79edcd7-4399-4ded-9b03-9084ad9e14b4-package-server-manager-serving-cert\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.902899 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-service-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.902956 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.903009 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-image-registry-operator-tls\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.903040 master-0 kubenswrapper[33142]: I1204 00:47:08.903035 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903102 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903160 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903202 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903202 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-utilities\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903208 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-config\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903236 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903285 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-whereabouts-configmap\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.903358 master-0 kubenswrapper[33142]: I1204 00:47:08.903349 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903381 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903410 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903440 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903465 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903493 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903518 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903548 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903576 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-client\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903605 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903635 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903661 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fd68g\" (UniqueName: \"kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:08.903684 master-0 kubenswrapper[33142]: I1204 00:47:08.903693 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903706 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cni-binary-copy\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903721 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-config\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903722 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903801 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903834 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903859 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903880 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903899 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903919 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903957 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-56gxb\" (UniqueName: \"kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903960 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26273240-2261-4564-bb64-1aaf774a921f-config\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.903979 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904002 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904021 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904040 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904062 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904085 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-588cp\" (UniqueName: \"kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904104 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904101 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-tmpfs\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904128 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904148 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904171 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904193 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.904193 master-0 kubenswrapper[33142]: I1204 00:47:08.904213 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904236 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904255 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904273 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904292 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904311 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904333 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904356 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904376 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904395 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904414 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-khxjm\" (UniqueName: \"kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904411 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-ovnkube-identity-cm\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904433 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904433 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-metrics-tls\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904454 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvj6\" (UniqueName: \"kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6\") pod \"migrator-5bcf58cf9c-x5fz2\" (UID: \"7d3c9170-b36d-4052-8ae9-9e549611dbd8\") " pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904505 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc\" (UID: \"cd208ca4-eb77-49a9-87a9-e0a617526e5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904547 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904589 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904632 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904676 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8eddb5-4600-4058-94d2-5d0308c32613-serving-cert\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904713 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904750 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904788 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904824 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-env-overrides\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904828 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904867 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904906 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.904982 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58w7s\" (UniqueName: \"kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905025 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905062 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905104 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905140 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-trusted-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905142 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905182 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g42cq\" (UniqueName: \"kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq\") pod \"network-check-source-6964bb78b7-qzwwq\" (UID: \"3e5012fe-fc48-4b6d-a075-fa94266ba90d\") " pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905204 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905231 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905254 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:08.905233 master-0 kubenswrapper[33142]: I1204 00:47:08.905274 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905292 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905311 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905359 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s89j7\" (UniqueName: \"kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905374 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905391 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905410 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905427 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905445 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pv8dv\" (UniqueName: \"kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905461 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905482 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905502 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnml\" (UniqueName: \"kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905506 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd621016-f4f2-4839-aae0-a804e6023423-serving-cert\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905529 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb121145-3e1a-49da-aac5-822cf65eefcf-trusted-ca\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905521 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qt7lk\" (UniqueName: \"kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905587 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8559\" (UniqueName: \"kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905628 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905668 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905711 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905743 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8375dfa-3a83-415b-bce5-0819a73255c1-metrics-tls\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905749 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905789 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.904549 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-catalog-content\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905826 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905902 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.905966 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906014 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906051 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.904903 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-srv-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906184 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0616abbd-748a-4451-96b7-df0178c99e8f-webhook-cert\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906380 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0616abbd-748a-4451-96b7-df0178c99e8f-env-overrides\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906455 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26273240-2261-4564-bb64-1aaf774a921f-serving-cert\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906623 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovnkube-config\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906662 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906690 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906711 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906734 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906752 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906772 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:08.906746 master-0 kubenswrapper[33142]: I1204 00:47:08.906793 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906812 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906831 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906851 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906867 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906873 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cni-binary-copy\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906884 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.906970 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907011 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655dc370-c0d1-4d03-a317-64bf099aff1b-config\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907012 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907077 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907118 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907161 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907197 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907240 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907280 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907318 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907354 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907284 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-available-featuregates\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907448 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-srv-cert\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907470 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-config\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907525 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907570 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907610 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907646 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e901355-2d0f-46f9-9d64-c4bc900b1839-serving-cert\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907652 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907702 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907742 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907779 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907817 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907846 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a5721ad-a077-439a-9ec0-57d90dfb5c14-config\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907944 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907950 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ffe9d26b-34e2-4506-9c38-69b85ab210a1-profile-collector-cert\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907974 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.907997 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908018 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908037 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908055 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908078 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908099 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908117 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjgh\" (UniqueName: \"kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908135 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908156 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vtf\" (UniqueName: \"kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908177 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908196 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908202 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edd7cfb0-df67-4978-adca-9b917d3b5708-iptables-alerter-script\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908214 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908277 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-serving-cert\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908336 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-cache\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908366 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:08.908323 master-0 kubenswrapper[33142]: I1204 00:47:08.908386 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908405 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908421 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-tmp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908425 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rznm9\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908481 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/975f6a6f-1fbb-49e1-8a0a-722586355364-utilities\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908489 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908552 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908581 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-tuned\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908594 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908637 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908678 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908716 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908748 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-script-lib\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908763 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908840 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908863 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908882 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908901 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908918 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908955 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908976 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908977 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-trusted-ca\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.908995 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909015 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909033 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909052 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909070 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909092 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909096 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04f4782e-b152-41c0-870a-08936498d1af-config\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909110 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909170 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909212 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909225 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e83f444-49e8-40b5-9a58-3128002f28c9-catalog-content\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909253 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca8eddb5-4600-4058-94d2-5d0308c32613-config\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909255 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909416 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909447 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909467 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909555 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/3e901355-2d0f-46f9-9d64-c4bc900b1839-etcd-ca\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909585 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-catalog-content\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909667 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909734 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909756 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68cb9838-2d09-46ab-8e2d-08d5868056fc-ovnkube-config\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909793 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909811 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-operand-assets\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909837 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909872 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04f4782e-b152-41c0-870a-08936498d1af-serving-cert\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909873 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-serving-cert\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.909917 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2f01d68-92ae-45b8-8501-645e439b5295-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910047 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd621016-f4f2-4839-aae0-a804e6023423-config\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910113 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910108 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/87adb521-b8d3-4201-b775-50c8c03956fc-utilities\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910142 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f22827-c301-4584-b999-0a1cc1033bb5-serving-cert\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910132 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910171 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910246 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6tj6\" (UniqueName: \"kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910324 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ad96246-c53a-4016-b67d-5e9d66f40d5b-env-overrides\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.910316 master-0 kubenswrapper[33142]: I1204 00:47:08.910329 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910406 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-apiservice-cert\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910418 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910487 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9j7\" (UniqueName: \"kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910556 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910610 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a83a76c-050e-4378-ac3a-1213d6d53773-metrics-certs\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910630 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-metrics-tls\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910637 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5rb5q\" (UniqueName: \"kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910690 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f22827-c301-4584-b999-0a1cc1033bb5-service-ca-bundle\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910791 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.910961 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911034 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-trusted-ca\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911034 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911073 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911090 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb121145-3e1a-49da-aac5-822cf65eefcf-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911187 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2f01d68-92ae-45b8-8501-645e439b5295-telemetry-config\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911191 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pc2xd\" (UniqueName: \"kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd\") pod \"csi-snapshot-controller-86897dd478-8zdrm\" (UID: \"dc7bfc47-972c-4493-8372-f211c6645ff5\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911325 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76wg7\" (UniqueName: \"kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911376 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911403 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911495 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911534 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdwv\" (UniqueName: \"kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911648 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911695 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911772 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911814 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.911952 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912005 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/aa2eaba9-479e-4420-a24f-63530e4da783-marketplace-operator-metrics\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912014 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912048 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ad96246-c53a-4016-b67d-5e9d66f40d5b-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912060 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912103 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912184 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6bf75491-0c03-4e02-9074-c9be808badd4-utilities\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912201 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2g6h\" (UniqueName: \"kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912247 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912268 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-daemon-config\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:08.913581 master-0 kubenswrapper[33142]: I1204 00:47:08.912329 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25sts\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:08.932528 master-0 kubenswrapper[33142]: I1204 00:47:08.932493 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 00:47:08.935524 master-0 kubenswrapper[33142]: I1204 00:47:08.935488 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-key\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:08.951277 master-0 kubenswrapper[33142]: I1204 00:47:08.951185 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 00:47:08.952367 master-0 kubenswrapper[33142]: I1204 00:47:08.952325 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29db06e4-26c0-45e4-ba90-509f51cad1a2-signing-cabundle\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:08.963169 master-0 kubenswrapper[33142]: I1204 00:47:08.963127 33142 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 00:47:08.971826 master-0 kubenswrapper[33142]: I1204 00:47:08.971790 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 00:47:08.992655 master-0 kubenswrapper[33142]: I1204 00:47:08.992588 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 00:47:09.006609 master-0 kubenswrapper[33142]: I1204 00:47:09.006526 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 00:47:09.012535 master-0 kubenswrapper[33142]: I1204 00:47:09.012464 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 00:47:09.013238 master-0 kubenswrapper[33142]: I1204 00:47:09.013176 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.013394 master-0 kubenswrapper[33142]: I1204 00:47:09.013360 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7nz\" (UniqueName: \"kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:09.013486 master-0 kubenswrapper[33142]: I1204 00:47:09.013388 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-systemd-units\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.013486 master-0 kubenswrapper[33142]: I1204 00:47:09.013412 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:09.013627 master-0 kubenswrapper[33142]: I1204 00:47:09.013574 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.013701 master-0 kubenswrapper[33142]: I1204 00:47:09.013628 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.013701 master-0 kubenswrapper[33142]: I1204 00:47:09.013678 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.013811 master-0 kubenswrapper[33142]: I1204 00:47:09.013724 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.013811 master-0 kubenswrapper[33142]: I1204 00:47:09.013780 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.013957 master-0 kubenswrapper[33142]: I1204 00:47:09.013848 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.013957 master-0 kubenswrapper[33142]: I1204 00:47:09.013885 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-kubernetes\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.014073 master-0 kubenswrapper[33142]: I1204 00:47:09.014000 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.014135 master-0 kubenswrapper[33142]: I1204 00:47:09.013780 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-multus-certs\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.014135 master-0 kubenswrapper[33142]: I1204 00:47:09.014085 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.014261 master-0 kubenswrapper[33142]: I1204 00:47:09.014202 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.014322 master-0 kubenswrapper[33142]: I1204 00:47:09.014264 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.014322 master-0 kubenswrapper[33142]: I1204 00:47:09.014295 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-k8s-cni-cncf-io\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.014442 master-0 kubenswrapper[33142]: I1204 00:47:09.014324 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.014442 master-0 kubenswrapper[33142]: I1204 00:47:09.014383 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.014565 master-0 kubenswrapper[33142]: I1204 00:47:09.014438 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.014565 master-0 kubenswrapper[33142]: I1204 00:47:09.014476 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.014565 master-0 kubenswrapper[33142]: I1204 00:47:09.014483 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-var-lib-kubelet\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.014565 master-0 kubenswrapper[33142]: I1204 00:47:09.014547 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.014778 master-0 kubenswrapper[33142]: I1204 00:47:09.014580 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.014778 master-0 kubenswrapper[33142]: I1204 00:47:09.014594 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit-dir\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.014778 master-0 kubenswrapper[33142]: I1204 00:47:09.014590 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:09.014778 master-0 kubenswrapper[33142]: I1204 00:47:09.014723 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.014778 master-0 kubenswrapper[33142]: I1204 00:47:09.014776 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014814 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-system-cni-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014822 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014850 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-kubelet\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014877 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9v27\" (UniqueName: \"kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014818 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-os-release\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.015131 master-0 kubenswrapper[33142]: I1204 00:47:09.014986 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2zj\" (UniqueName: \"kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015161 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015227 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-multus\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015266 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015291 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vtt\" (UniqueName: \"kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015366 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:09.015469 master-0 kubenswrapper[33142]: I1204 00:47:09.015420 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015509 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-cni-bin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015535 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jms7r\" (UniqueName: \"kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015557 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015586 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015607 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015685 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysconfig\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015702 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85684df-0014-4d28-9b00-9c6a6942cc94-hosts-file\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015686 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:09.015840 master-0 kubenswrapper[33142]: I1204 00:47:09.015787 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.015880 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.015915 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016019 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-docker\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016032 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016050 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-modprobe-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016081 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-d\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016065 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016139 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-os-release\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016172 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016220 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016244 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-netns\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016265 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016278 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-etc-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016328 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016378 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68d85\" (UniqueName: \"kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:09.016401 master-0 kubenswrapper[33142]: I1204 00:47:09.016386 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-run\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016430 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016484 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016543 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016569 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016653 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-hostroot\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016687 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016669 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-etc-kubernetes\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016734 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-system-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016802 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016847 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016891 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nctgw\" (UniqueName: \"kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016950 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.016988 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017024 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-sys\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017041 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-run-netns\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017026 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017068 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-var-lib-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017082 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017163 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017193 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017225 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017260 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rd8w\" (UniqueName: \"kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017318 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017352 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsmd\" (UniqueName: \"kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.017331 master-0 kubenswrapper[33142]: I1204 00:47:09.017319 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-socket-dir-parent\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017398 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017430 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017457 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017489 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017501 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-textfile\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017515 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-slash\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017540 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-netd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017607 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017636 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017662 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017694 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017730 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017776 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017793 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-docker\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017847 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-dir\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017850 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-node-pullsecrets\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017780 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-host\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.017841 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018056 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018188 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018235 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018275 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018314 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018324 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018368 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018443 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018640 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xbks2\" (UniqueName: \"kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018745 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018802 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018832 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/47152378-4ef5-4eff-9b30-fd8635982f02-etc-containers\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018856 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018881 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-cni-bin\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.018921 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019066 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019018 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-systemd\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019134 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019194 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019331 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019404 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019517 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019577 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019662 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019718 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019810 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019870 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-volume-directive-shadow\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.019798 master-0 kubenswrapper[33142]: I1204 00:47:09.019867 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.019970 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.019998 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020035 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020064 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020082 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020151 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-ovn\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020172 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-node-log\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020185 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020263 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020330 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020379 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020471 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdw4\" (UniqueName: \"kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020505 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-log-socket\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020510 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020478 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-cni-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020553 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020652 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020729 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020783 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020809 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-openvswitch\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020824 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020864 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020873 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-multus-conf-dir\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020904 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020961 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edd7cfb0-df67-4978-adca-9b917d3b5708-host-slash\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.020990 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021006 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-etc-containers\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021042 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021067 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-cnibin\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021021 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68cb9838-2d09-46ab-8e2d-08d5868056fc-run-systemd\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021117 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021242 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-cnibin\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021255 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021339 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/004c989d-6ae8-4147-8355-af1118fe6a98-etc-ssl-certs\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021345 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021455 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021510 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-lib-modules\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021536 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021593 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-host-etc-kube\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021604 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021696 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021745 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021836 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7a0402f-755b-44a1-8cb8-c95b6ecff780-host-var-lib-kubelet\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.021868 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21e8bd47-93e6-4068-a6fb-ba34255103d2-etc-sysctl-conf\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:09.024225 master-0 kubenswrapper[33142]: I1204 00:47:09.022006 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36d5dd7e-7ac5-4c41-8f62-404bc5919857-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:09.032989 master-0 kubenswrapper[33142]: I1204 00:47:09.032754 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 00:47:09.034316 master-0 kubenswrapper[33142]: I1204 00:47:09.034230 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-image-import-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.052004 master-0 kubenswrapper[33142]: I1204 00:47:09.051913 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 00:47:09.060042 master-0 kubenswrapper[33142]: I1204 00:47:09.059971 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-client\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.071876 master-0 kubenswrapper[33142]: I1204 00:47:09.071841 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 00:47:09.079108 master-0 kubenswrapper[33142]: I1204 00:47:09.079032 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-serving-cert\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.092874 master-0 kubenswrapper[33142]: I1204 00:47:09.092814 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 00:47:09.094304 master-0 kubenswrapper[33142]: I1204 00:47:09.094248 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-encryption-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.148587 master-0 kubenswrapper[33142]: I1204 00:47:09.148510 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 00:47:09.150285 master-0 kubenswrapper[33142]: I1204 00:47:09.150216 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.151287 master-0 kubenswrapper[33142]: I1204 00:47:09.151197 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.152173 master-0 kubenswrapper[33142]: I1204 00:47:09.151818 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-root\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.152505 master-0 kubenswrapper[33142]: I1204 00:47:09.152410 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.154769 master-0 kubenswrapper[33142]: I1204 00:47:09.154729 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.155364 master-0 kubenswrapper[33142]: I1204 00:47:09.155307 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/b900991f-c6ec-45d1-a76b-44aec0f56cde-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:09.155528 master-0 kubenswrapper[33142]: I1204 00:47:09.155496 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.158651 master-0 kubenswrapper[33142]: I1204 00:47:09.158482 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 00:47:09.159363 master-0 kubenswrapper[33142]: I1204 00:47:09.159324 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.159518 master-0 kubenswrapper[33142]: I1204 00:47:09.159439 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.161869 master-0 kubenswrapper[33142]: I1204 00:47:09.161818 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.162008 master-0 kubenswrapper[33142]: I1204 00:47:09.161883 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-wtmp\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.162008 master-0 kubenswrapper[33142]: I1204 00:47:09.161830 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/fb98438b-191c-4957-a9d1-8a64520f7f00-rootfs\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:09.162154 master-0 kubenswrapper[33142]: I1204 00:47:09.162054 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:09.162232 master-0 kubenswrapper[33142]: I1204 00:47:09.162214 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.162322 master-0 kubenswrapper[33142]: I1204 00:47:09.162302 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.162395 master-0 kubenswrapper[33142]: I1204 00:47:09.162345 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.162395 master-0 kubenswrapper[33142]: I1204 00:47:09.162342 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-sys\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:09.162618 master-0 kubenswrapper[33142]: I1204 00:47:09.162401 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.162618 master-0 kubenswrapper[33142]: I1204 00:47:09.162438 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.163641 master-0 kubenswrapper[33142]: I1204 00:47:09.163604 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 00:47:09.166624 master-0 kubenswrapper[33142]: I1204 00:47:09.166562 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-trusted-ca-bundle\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.172069 master-0 kubenswrapper[33142]: I1204 00:47:09.172008 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 00:47:09.180444 master-0 kubenswrapper[33142]: I1204 00:47:09.180388 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-config\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.192261 master-0 kubenswrapper[33142]: I1204 00:47:09.192223 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 00:47:09.200788 master-0 kubenswrapper[33142]: I1204 00:47:09.200739 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-audit\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.205183 master-0 kubenswrapper[33142]: I1204 00:47:09.205092 33142 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 00:47:09.208260 master-0 kubenswrapper[33142]: I1204 00:47:09.208205 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 00:47:09.208319 master-0 kubenswrapper[33142]: I1204 00:47:09.208281 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 00:47:09.208319 master-0 kubenswrapper[33142]: I1204 00:47:09.208301 33142 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 00:47:09.208710 master-0 kubenswrapper[33142]: I1204 00:47:09.208678 33142 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 00:47:09.211006 master-0 kubenswrapper[33142]: I1204 00:47:09.210916 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 00:47:09.213438 master-0 kubenswrapper[33142]: I1204 00:47:09.213411 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-etcd-serving-ca\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:09.232072 master-0 kubenswrapper[33142]: I1204 00:47:09.232037 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 00:47:09.238232 master-0 kubenswrapper[33142]: I1204 00:47:09.238175 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.248203 master-0 kubenswrapper[33142]: I1204 00:47:09.248174 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:09.251123 master-0 kubenswrapper[33142]: I1204 00:47:09.251085 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 00:47:09.260417 master-0 kubenswrapper[33142]: I1204 00:47:09.260371 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-catalogserver-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.272834 master-0 kubenswrapper[33142]: I1204 00:47:09.272766 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 00:47:09.301448 master-0 kubenswrapper[33142]: I1204 00:47:09.301378 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 00:47:09.312440 master-0 kubenswrapper[33142]: I1204 00:47:09.312389 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 00:47:09.314990 master-0 kubenswrapper[33142]: I1204 00:47:09.314900 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-ca-certs\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:09.340170 master-0 kubenswrapper[33142]: I1204 00:47:09.340069 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 00:47:09.352202 master-0 kubenswrapper[33142]: I1204 00:47:09.352152 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 00:47:09.362790 master-0 kubenswrapper[33142]: I1204 00:47:09.362702 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-ca-certs\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:09.366269 master-0 kubenswrapper[33142]: I1204 00:47:09.366219 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:47:09.366392 master-0 kubenswrapper[33142]: I1204 00:47:09.366289 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:09.366460 master-0 kubenswrapper[33142]: I1204 00:47:09.366442 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:47:09.366704 master-0 kubenswrapper[33142]: I1204 00:47:09.366631 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock" (OuterVolumeSpecName: "var-lock") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:09.368005 master-0 kubenswrapper[33142]: I1204 00:47:09.367957 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:09.368005 master-0 kubenswrapper[33142]: I1204 00:47:09.367985 33142 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a37027d2-eeb1-416b-b67e-7ee233c42d04-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:09.370845 master-0 kubenswrapper[33142]: I1204 00:47:09.370792 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 00:47:09.377978 master-0 kubenswrapper[33142]: I1204 00:47:09.377879 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-default-certificate\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:09.391553 master-0 kubenswrapper[33142]: I1204 00:47:09.391502 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 00:47:09.413105 master-0 kubenswrapper[33142]: I1204 00:47:09.412986 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 00:47:09.423310 master-0 kubenswrapper[33142]: I1204 00:47:09.423226 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-metrics-certs\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:09.431542 master-0 kubenswrapper[33142]: I1204 00:47:09.431465 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 00:47:09.434711 master-0 kubenswrapper[33142]: I1204 00:47:09.434633 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83e0d056-186c-4067-b586-14fe2970fcc0-service-ca-bundle\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:09.452212 master-0 kubenswrapper[33142]: I1204 00:47:09.452119 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 00:47:09.457836 master-0 kubenswrapper[33142]: I1204 00:47:09.457636 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83e0d056-186c-4067-b586-14fe2970fcc0-stats-auth\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:09.472232 master-0 kubenswrapper[33142]: I1204 00:47:09.472158 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 00:47:09.491720 master-0 kubenswrapper[33142]: I1204 00:47:09.491627 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 00:47:09.512614 master-0 kubenswrapper[33142]: I1204 00:47:09.512504 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 00:47:09.513072 master-0 kubenswrapper[33142]: I1204 00:47:09.513027 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-audit-policies\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.515124 master-0 kubenswrapper[33142]: I1204 00:47:09.515066 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 00:47:09.533686 master-0 kubenswrapper[33142]: I1204 00:47:09.533593 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 00:47:09.539873 master-0 kubenswrapper[33142]: I1204 00:47:09.539802 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-serving-cert\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.550855 master-0 kubenswrapper[33142]: I1204 00:47:09.550789 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 00:47:09.560689 master-0 kubenswrapper[33142]: I1204 00:47:09.560613 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-serving-ca\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.571296 master-0 kubenswrapper[33142]: I1204 00:47:09.571228 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 00:47:09.577752 master-0 kubenswrapper[33142]: I1204 00:47:09.577681 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-encryption-config\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.592046 master-0 kubenswrapper[33142]: I1204 00:47:09.591993 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 00:47:09.598508 master-0 kubenswrapper[33142]: I1204 00:47:09.598451 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-etcd-client\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.612456 master-0 kubenswrapper[33142]: I1204 00:47:09.612387 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 00:47:09.613615 master-0 kubenswrapper[33142]: I1204 00:47:09.613562 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-trusted-ca-bundle\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:09.632530 master-0 kubenswrapper[33142]: I1204 00:47:09.632432 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 00:47:09.654700 master-0 kubenswrapper[33142]: I1204 00:47:09.654113 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 00:47:09.671215 master-0 kubenswrapper[33142]: I1204 00:47:09.671119 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 00:47:09.694637 master-0 kubenswrapper[33142]: I1204 00:47:09.694524 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 00:47:09.697168 master-0 kubenswrapper[33142]: I1204 00:47:09.697118 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f190ddab-e7d0-4dd6-8bb7-359a02393259-config-volume\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:09.714135 master-0 kubenswrapper[33142]: I1204 00:47:09.711504 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:09.714135 master-0 kubenswrapper[33142]: I1204 00:47:09.711720 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 00:47:09.717575 master-0 kubenswrapper[33142]: I1204 00:47:09.717519 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f190ddab-e7d0-4dd6-8bb7-359a02393259-metrics-tls\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:09.718302 master-0 kubenswrapper[33142]: I1204 00:47:09.718257 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 00:47:09.731311 master-0 kubenswrapper[33142]: I1204 00:47:09.731247 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-d7vtk" Dec 04 00:47:09.752561 master-0 kubenswrapper[33142]: I1204 00:47:09.752050 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 00:47:09.756733 master-0 kubenswrapper[33142]: I1204 00:47:09.756672 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cd208ca4-eb77-49a9-87a9-e0a617526e5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc\" (UID: \"cd208ca4-eb77-49a9-87a9-e0a617526e5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:47:09.771661 master-0 kubenswrapper[33142]: I1204 00:47:09.771405 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:47:09.774455 master-0 kubenswrapper[33142]: I1204 00:47:09.774406 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/004c989d-6ae8-4147-8355-af1118fe6a98-serving-cert\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.790810 master-0 kubenswrapper[33142]: I1204 00:47:09.790729 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:47:09.796580 master-0 kubenswrapper[33142]: I1204 00:47:09.796531 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:09.802214 master-0 kubenswrapper[33142]: I1204 00:47:09.802169 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:09.811818 master-0 kubenswrapper[33142]: I1204 00:47:09.811782 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:47:09.819869 master-0 kubenswrapper[33142]: I1204 00:47:09.819770 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/004c989d-6ae8-4147-8355-af1118fe6a98-service-ca\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:09.831281 master-0 kubenswrapper[33142]: I1204 00:47:09.831219 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4xsx2" Dec 04 00:47:09.853228 master-0 kubenswrapper[33142]: I1204 00:47:09.851776 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-94kgq" Dec 04 00:47:09.869708 master-0 kubenswrapper[33142]: I1204 00:47:09.869647 33142 request.go:700] Waited for 1.013088296s due to client-side throttling, not priority and fairness, request: GET:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/secrets?fieldSelector=metadata.name%3Dredhat-marketplace-dockercfg-v4pfc&limit=500&resourceVersion=0 Dec 04 00:47:09.871560 master-0 kubenswrapper[33142]: I1204 00:47:09.871523 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-v4pfc" Dec 04 00:47:09.891399 master-0 kubenswrapper[33142]: I1204 00:47:09.891338 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 00:47:09.892635 master-0 kubenswrapper[33142]: I1204 00:47:09.892587 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:47:09.903406 master-0 kubenswrapper[33142]: E1204 00:47:09.903367 33142 secret.go:189] Couldn't get secret openshift-cloud-credential-operator/cloud-credential-operator-serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.903570 master-0 kubenswrapper[33142]: E1204 00:47:09.903450 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert podName:890fd2c0-ac22-4d85-aa02-8f6c4518b7a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.403427479 +0000 UTC m=+2.805429429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cloud-credential-operator-serving-cert" (UniqueName: "kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert") pod "cloud-credential-operator-7c4dc67499-shsm8" (UID: "890fd2c0-ac22-4d85-aa02-8f6c4518b7a1") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.903570 master-0 kubenswrapper[33142]: E1204 00:47:09.903460 33142 configmap.go:193] Couldn't get configMap openshift-insights/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.903570 master-0 kubenswrapper[33142]: E1204 00:47:09.903558 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle podName:e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.403537243 +0000 UTC m=+2.805539123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle") pod "insights-operator-59d99f9b7b-jl84b" (UID: "e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.903704 master-0 kubenswrapper[33142]: E1204 00:47:09.903608 33142 secret.go:189] Couldn't get secret openshift-cluster-machine-approver/machine-approver-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.903704 master-0 kubenswrapper[33142]: E1204 00:47:09.903650 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls podName:62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.403637945 +0000 UTC m=+2.805639825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "machine-approver-tls" (UniqueName: "kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls") pod "machine-approver-cb84b9cdf-tsm24" (UID: "62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.903785 master-0 kubenswrapper[33142]: E1204 00:47:09.903719 33142 secret.go:189] Couldn't get secret openshift-insights/openshift-insights-serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.903785 master-0 kubenswrapper[33142]: E1204 00:47:09.903748 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert podName:e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.403740088 +0000 UTC m=+2.805741928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert") pod "insights-operator-59d99f9b7b-jl84b" (UID: "e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.906794 master-0 kubenswrapper[33142]: I1204 00:47:09.906752 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="" Dec 04 00:47:09.906969 master-0 kubenswrapper[33142]: E1204 00:47:09.906832 33142 secret.go:189] Couldn't get secret openshift-machine-config-operator/mco-proxy-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907103 master-0 kubenswrapper[33142]: E1204 00:47:09.907066 33142 configmap.go:193] Couldn't get configMap openshift-cloud-credential-operator/cco-trusted-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907176 master-0 kubenswrapper[33142]: E1204 00:47:09.907116 33142 configmap.go:193] Couldn't get configMap openshift-insights/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907176 master-0 kubenswrapper[33142]: E1204 00:47:09.906862 33142 configmap.go:193] Couldn't get configMap openshift-machine-api/cluster-baremetal-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907176 master-0 kubenswrapper[33142]: E1204 00:47:09.907143 33142 secret.go:189] Couldn't get secret openshift-machine-api/cluster-autoscaler-operator-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907176 master-0 kubenswrapper[33142]: E1204 00:47:09.906885 33142 secret.go:189] Couldn't get secret openshift-machine-api/cluster-baremetal-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907319 master-0 kubenswrapper[33142]: E1204 00:47:09.906903 33142 configmap.go:193] Couldn't get configMap openshift-cluster-machine-approver/machine-approver-config: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907319 master-0 kubenswrapper[33142]: E1204 00:47:09.906912 33142 configmap.go:193] Couldn't get configMap openshift-machine-api/baremetal-kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907319 master-0 kubenswrapper[33142]: E1204 00:47:09.907213 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls podName:87c52add-1fdc-4227-b1b1-76f3653e3fb0 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407080645 +0000 UTC m=+2.809082505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls") pod "machine-config-operator-664c9d94c9-r2h84" (UID: "87c52add-1fdc-4227-b1b1-76f3653e3fb0") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907323 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca podName:890fd2c0-ac22-4d85-aa02-8f6c4518b7a1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407296751 +0000 UTC m=+2.809298631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cco-trusted-ca" (UniqueName: "kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca") pod "cloud-credential-operator-7c4dc67499-shsm8" (UID: "890fd2c0-ac22-4d85-aa02-8f6c4518b7a1") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907353 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle podName:e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407341832 +0000 UTC m=+2.809343722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle") pod "insights-operator-59d99f9b7b-jl84b" (UID: "e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907374 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images podName:17f5a6f7-07dc-45cc-9db4-810f84b678d1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407364433 +0000 UTC m=+2.809366323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images") pod "cluster-baremetal-operator-5fdc576499-xlwrx" (UID: "17f5a6f7-07dc-45cc-9db4-810f84b678d1") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907397 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert podName:17f5a6f7-07dc-45cc-9db4-810f84b678d1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407388574 +0000 UTC m=+2.809390464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert") pod "cluster-baremetal-operator-5fdc576499-xlwrx" (UID: "17f5a6f7-07dc-45cc-9db4-810f84b678d1") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907416 33142 configmap.go:193] Couldn't get configMap openshift-cluster-machine-approver/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907434 master-0 kubenswrapper[33142]: E1204 00:47:09.907423 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert podName:ba4531f5-90d7-41b9-9bbc-0f0d5c640d96 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407410164 +0000 UTC m=+2.809412044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert") pod "cluster-autoscaler-operator-7f88444875-zwhqs" (UID: "ba4531f5-90d7-41b9-9bbc-0f0d5c640d96") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.907751 master-0 kubenswrapper[33142]: E1204 00:47:09.907448 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config podName:62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407438575 +0000 UTC m=+2.809440455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config") pod "machine-approver-cb84b9cdf-tsm24" (UID: "62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907751 master-0 kubenswrapper[33142]: E1204 00:47:09.907472 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config podName:17f5a6f7-07dc-45cc-9db4-810f84b678d1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407461906 +0000 UTC m=+2.809463796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config") pod "cluster-baremetal-operator-5fdc576499-xlwrx" (UID: "17f5a6f7-07dc-45cc-9db4-810f84b678d1") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.907751 master-0 kubenswrapper[33142]: E1204 00:47:09.907494 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config podName:62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.407484106 +0000 UTC m=+2.809485986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config") pod "machine-approver-cb84b9cdf-tsm24" (UID: "62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.908546 master-0 kubenswrapper[33142]: E1204 00:47:09.908505 33142 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/machine-config-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.908604 master-0 kubenswrapper[33142]: E1204 00:47:09.908560 33142 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.908604 master-0 kubenswrapper[33142]: E1204 00:47:09.908573 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images podName:87c52add-1fdc-4227-b1b1-76f3653e3fb0 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.408551967 +0000 UTC m=+2.810553827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images") pod "machine-config-operator-664c9d94c9-r2h84" (UID: "87c52add-1fdc-4227-b1b1-76f3653e3fb0") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.908681 master-0 kubenswrapper[33142]: E1204 00:47:09.908618 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls podName:93b8a17c-ef68-4be1-9b98-0dd1a3d66f16 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.408602229 +0000 UTC m=+2.810604109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls") pod "cluster-samples-operator-6d64b47964-6r94q" (UID: "93b8a17c-ef68-4be1-9b98-0dd1a3d66f16") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.910611 master-0 kubenswrapper[33142]: E1204 00:47:09.910577 33142 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/packageserver-service-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.910675 master-0 kubenswrapper[33142]: E1204 00:47:09.910627 33142 configmap.go:193] Couldn't get configMap openshift-machine-api/kube-rbac-proxy-cluster-autoscaler-operator: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.910721 master-0 kubenswrapper[33142]: E1204 00:47:09.910636 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert podName:55cd7eeb-05b2-4ec9-bd37-a765beac3ab8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.410620817 +0000 UTC m=+2.812622677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert") pod "packageserver-59f876d99-xlc5q" (UID: "55cd7eeb-05b2-4ec9-bd37-a765beac3ab8") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.910721 master-0 kubenswrapper[33142]: E1204 00:47:09.910687 33142 secret.go:189] Couldn't get secret openshift-cluster-storage-operator/cluster-storage-operator-serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.910721 master-0 kubenswrapper[33142]: E1204 00:47:09.910712 33142 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.910839 master-0 kubenswrapper[33142]: E1204 00:47:09.910720 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config podName:ba4531f5-90d7-41b9-9bbc-0f0d5c640d96 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.410700509 +0000 UTC m=+2.812702429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config") pod "cluster-autoscaler-operator-7f88444875-zwhqs" (UID: "ba4531f5-90d7-41b9-9bbc-0f0d5c640d96") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.910839 master-0 kubenswrapper[33142]: E1204 00:47:09.910754 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config podName:87c52add-1fdc-4227-b1b1-76f3653e3fb0 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.41074444 +0000 UTC m=+2.812746300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config") pod "machine-config-operator-664c9d94c9-r2h84" (UID: "87c52add-1fdc-4227-b1b1-76f3653e3fb0") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:09.910839 master-0 kubenswrapper[33142]: E1204 00:47:09.910706 33142 secret.go:189] Couldn't get secret openshift-machine-api/cluster-baremetal-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.910839 master-0 kubenswrapper[33142]: E1204 00:47:09.910792 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert podName:95141f9b-b6b0-40dc-a6e2-b5c84d24caac nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.410764201 +0000 UTC m=+2.812766131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-storage-operator-serving-cert" (UniqueName: "kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert") pod "cluster-storage-operator-f84784664-zvrvl" (UID: "95141f9b-b6b0-40dc-a6e2-b5c84d24caac") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.911005 master-0 kubenswrapper[33142]: E1204 00:47:09.910841 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls podName:17f5a6f7-07dc-45cc-9db4-810f84b678d1 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.410824503 +0000 UTC m=+2.812826483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-baremetal-operator-tls" (UniqueName: "kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls") pod "cluster-baremetal-operator-5fdc576499-xlwrx" (UID: "17f5a6f7-07dc-45cc-9db4-810f84b678d1") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.911983 master-0 kubenswrapper[33142]: I1204 00:47:09.911952 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 00:47:09.913258 master-0 kubenswrapper[33142]: E1204 00:47:09.913185 33142 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/packageserver-service-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.913400 master-0 kubenswrapper[33142]: E1204 00:47:09.913370 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert podName:55cd7eeb-05b2-4ec9-bd37-a765beac3ab8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.413323055 +0000 UTC m=+2.815325015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert") pod "packageserver-59f876d99-xlc5q" (UID: "55cd7eeb-05b2-4ec9-bd37-a765beac3ab8") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:09.930653 master-0 kubenswrapper[33142]: I1204 00:47:09.930595 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-zg65n" Dec 04 00:47:09.951632 master-0 kubenswrapper[33142]: I1204 00:47:09.951579 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 00:47:09.971286 master-0 kubenswrapper[33142]: I1204 00:47:09.971125 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-dockercfg-868vg" Dec 04 00:47:09.992379 master-0 kubenswrapper[33142]: I1204 00:47:09.992309 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 00:47:10.013786 master-0 kubenswrapper[33142]: E1204 00:47:10.013700 33142 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014041 master-0 kubenswrapper[33142]: E1204 00:47:10.013817 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config podName:3e104a8c-66dc-4a9a-836f-656e6f4cc923 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.513793862 +0000 UTC m=+2.915795722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "mcc-auth-proxy-config" (UniqueName: "kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config") pod "machine-config-controller-74cddd4fb5-9nq7p" (UID: "3e104a8c-66dc-4a9a-836f-656e6f4cc923") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014172 master-0 kubenswrapper[33142]: E1204 00:47:10.014110 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-server-audit-profiles: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014277 master-0 kubenswrapper[33142]: E1204 00:47:10.014203 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.514184934 +0000 UTC m=+2.916186784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-server-audit-profiles" (UniqueName: "kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014625 master-0 kubenswrapper[33142]: E1204 00:47:10.014585 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014693 master-0 kubenswrapper[33142]: E1204 00:47:10.014632 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca podName:5aabcb3b-483d-419b-98ce-0ffd0ce265e8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.514623876 +0000 UTC m=+2.916625726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca") pod "kube-state-metrics-7dcc7f9bd6-cwhhx" (UID: "5aabcb3b-483d-419b-98ce-0ffd0ce265e8") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014693 master-0 kubenswrapper[33142]: E1204 00:47:10.014586 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/kubelet-serving-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014693 master-0 kubenswrapper[33142]: E1204 00:47:10.014663 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.514657227 +0000 UTC m=+2.916659077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "configmap-kubelet-serving-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.014981 master-0 kubenswrapper[33142]: E1204 00:47:10.014950 33142 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.015047 master-0 kubenswrapper[33142]: E1204 00:47:10.015004 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config podName:1288d627-f7c2-47d5-aa02-2c86d5f82369 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.514992107 +0000 UTC m=+2.916994057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config") pod "openshift-state-metrics-57cbc648f8-tmqmn" (UID: "1288d627-f7c2-47d5-aa02-2c86d5f82369") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.015606 master-0 kubenswrapper[33142]: E1204 00:47:10.015572 33142 configmap.go:193] Couldn't get configMap openshift-cloud-controller-manager-operator/cloud-controller-manager-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.015606 master-0 kubenswrapper[33142]: E1204 00:47:10.015601 33142 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.015789 master-0 kubenswrapper[33142]: E1204 00:47:10.015626 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images podName:b900991f-c6ec-45d1-a76b-44aec0f56cde nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.515614205 +0000 UTC m=+2.917616165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images") pod "cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" (UID: "b900991f-c6ec-45d1-a76b-44aec0f56cde") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.015789 master-0 kubenswrapper[33142]: E1204 00:47:10.015649 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config podName:e3545341-90a7-42fe-9ba4-bf6e71ef776e nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.515639396 +0000 UTC m=+2.917641376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config") pod "controller-manager-6555cd6548-djfrg" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.015989 master-0 kubenswrapper[33142]: E1204 00:47:10.015803 33142 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.015989 master-0 kubenswrapper[33142]: E1204 00:47:10.015844 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.015989 master-0 kubenswrapper[33142]: E1204 00:47:10.015871 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls podName:5aabcb3b-483d-419b-98ce-0ffd0ce265e8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.515853992 +0000 UTC m=+2.917855862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls") pod "kube-state-metrics-7dcc7f9bd6-cwhhx" (UID: "5aabcb3b-483d-419b-98ce-0ffd0ce265e8") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.015989 master-0 kubenswrapper[33142]: E1204 00:47:10.015901 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca podName:1288d627-f7c2-47d5-aa02-2c86d5f82369 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.515888553 +0000 UTC m=+2.917890513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca") pod "openshift-state-metrics-57cbc648f8-tmqmn" (UID: "1288d627-f7c2-47d5-aa02-2c86d5f82369") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.016288 master-0 kubenswrapper[33142]: E1204 00:47:10.016076 33142 configmap.go:193] Couldn't get configMap openshift-controller-manager/openshift-global-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.016288 master-0 kubenswrapper[33142]: E1204 00:47:10.016118 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles podName:e3545341-90a7-42fe-9ba4-bf6e71ef776e nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.516108999 +0000 UTC m=+2.918110839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-ca-bundles" (UniqueName: "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles") pod "controller-manager-6555cd6548-djfrg" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.016747 master-0 kubenswrapper[33142]: E1204 00:47:10.016694 33142 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.016841 master-0 kubenswrapper[33142]: E1204 00:47:10.016719 33142 secret.go:189] Couldn't get secret openshift-machine-config-operator/node-bootstrapper-token: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.016903 master-0 kubenswrapper[33142]: E1204 00:47:10.016817 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls podName:1288d627-f7c2-47d5-aa02-2c86d5f82369 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.516786259 +0000 UTC m=+2.918788109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls") pod "openshift-state-metrics-57cbc648f8-tmqmn" (UID: "1288d627-f7c2-47d5-aa02-2c86d5f82369") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.016903 master-0 kubenswrapper[33142]: E1204 00:47:10.016887 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token podName:727020b5-1084-48ac-9aed-549e4eabbf81 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.516870751 +0000 UTC m=+2.918872701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-bootstrap-token" (UniqueName: "kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token") pod "machine-config-server-kl9fp" (UID: "727020b5-1084-48ac-9aed-549e4eabbf81") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017102 master-0 kubenswrapper[33142]: E1204 00:47:10.017055 33142 configmap.go:193] Couldn't get configMap openshift-machine-api/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.017102 master-0 kubenswrapper[33142]: E1204 00:47:10.017099 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config podName:e852069a-82f1-4121-9d86-277b8ca07370 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517087637 +0000 UTC m=+2.919089587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config") pod "machine-api-operator-7486ff55f-tnhrb" (UID: "e852069a-82f1-4121-9d86-277b8ca07370") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.017588 master-0 kubenswrapper[33142]: E1204 00:47:10.017537 33142 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017588 master-0 kubenswrapper[33142]: E1204 00:47:10.017582 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config podName:8d4d3057-9f71-4b07-b463-51cc49d28bf3 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517571581 +0000 UTC m=+2.919573541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config") pod "prometheus-operator-565bdcb8-8dcsg" (UID: "8d4d3057-9f71-4b07-b463-51cc49d28bf3") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017635 33142 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017667 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert podName:e3545341-90a7-42fe-9ba4-bf6e71ef776e nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517656804 +0000 UTC m=+2.919658764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert") pod "controller-manager-6555cd6548-djfrg" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017700 33142 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/config: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017722 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517716175 +0000 UTC m=+2.919718025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017740 33142 secret.go:189] Couldn't get secret openshift-machine-config-operator/mcc-proxy-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017759 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls podName:3e104a8c-66dc-4a9a-836f-656e6f4cc923 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517754197 +0000 UTC m=+2.919756047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls") pod "machine-config-controller-74cddd4fb5-9nq7p" (UID: "3e104a8c-66dc-4a9a-836f-656e6f4cc923") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017785 33142 configmap.go:193] Couldn't get configMap openshift-machine-api/machine-api-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.017810 master-0 kubenswrapper[33142]: E1204 00:47:10.017806 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images podName:e852069a-82f1-4121-9d86-277b8ca07370 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.517800988 +0000 UTC m=+2.919802838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images") pod "machine-api-operator-7486ff55f-tnhrb" (UID: "e852069a-82f1-4121-9d86-277b8ca07370") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.018521 master-0 kubenswrapper[33142]: E1204 00:47:10.017832 33142 secret.go:189] Couldn't get secret openshift-machine-config-operator/proxy-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.018521 master-0 kubenswrapper[33142]: E1204 00:47:10.017902 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls podName:fb98438b-191c-4957-a9d1-8a64520f7f00 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.51788758 +0000 UTC m=+2.919889440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls") pod "machine-config-daemon-dhr5k" (UID: "fb98438b-191c-4957-a9d1-8a64520f7f00") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019082 master-0 kubenswrapper[33142]: I1204 00:47:10.019043 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 00:47:10.019477 master-0 kubenswrapper[33142]: E1204 00:47:10.019439 33142 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019475 33142 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019505 33142 secret.go:189] Couldn't get secret openshift-machine-api/machine-api-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019483 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls podName:8d4d3057-9f71-4b07-b463-51cc49d28bf3 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519473356 +0000 UTC m=+2.921475206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls") pod "prometheus-operator-565bdcb8-8dcsg" (UID: "8d4d3057-9f71-4b07-b463-51cc49d28bf3") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019523 33142 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019547 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519533918 +0000 UTC m=+2.921535778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019550 master-0 kubenswrapper[33142]: E1204 00:47:10.019551 33142 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019568 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls podName:e852069a-82f1-4121-9d86-277b8ca07370 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519559369 +0000 UTC m=+2.921561229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "machine-api-operator-tls" (UniqueName: "kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls") pod "machine-api-operator-7486ff55f-tnhrb" (UID: "e852069a-82f1-4121-9d86-277b8ca07370") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019535 33142 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019591 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs podName:20835c26-301c-423e-b534-ec2a5e5af953 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519578869 +0000 UTC m=+2.921580719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs") pod "multus-admission-controller-5bdcc987c4-s85ld" (UID: "20835c26-301c-423e-b534-ec2a5e5af953") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019609 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert podName:df783888-6b82-48e8-aad0-ee77f7167115 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.51960047 +0000 UTC m=+2.921602340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert") pod "ingress-canary-rn56p" (UID: "df783888-6b82-48e8-aad0-ee77f7167115") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019627 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config podName:4adeb2c2-10ba-420a-be0b-fb2329ac3fe2 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.51961877 +0000 UTC m=+2.921620630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config") pod "node-exporter-pcpjf" (UID: "4adeb2c2-10ba-420a-be0b-fb2329ac3fe2") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019708 33142 secret.go:189] Couldn't get secret openshift-machine-config-operator/machine-config-server-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019740 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs podName:727020b5-1084-48ac-9aed-549e4eabbf81 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519732204 +0000 UTC m=+2.921734054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certs" (UniqueName: "kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs") pod "machine-config-server-kl9fp" (UID: "727020b5-1084-48ac-9aed-549e4eabbf81") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019757 33142 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019797 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls podName:4adeb2c2-10ba-420a-be0b-fb2329ac3fe2 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519788545 +0000 UTC m=+2.921790395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls") pod "node-exporter-pcpjf" (UID: "4adeb2c2-10ba-420a-be0b-fb2329ac3fe2") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019796 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/kube-state-metrics-custom-resource-state-configmap: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.019997 master-0 kubenswrapper[33142]: E1204 00:47:10.019843 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap podName:5aabcb3b-483d-419b-98ce-0ffd0ce265e8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.519835737 +0000 UTC m=+2.921837587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-custom-resource-state-configmap" (UniqueName: "kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap") pod "kube-state-metrics-7dcc7f9bd6-cwhhx" (UID: "5aabcb3b-483d-419b-98ce-0ffd0ce265e8") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020356 33142 secret.go:189] Couldn't get secret openshift-cloud-controller-manager-operator/cloud-controller-manager-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020370 33142 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020388 33142 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020398 33142 secret.go:189] Couldn't get secret openshift-monitoring/metrics-server-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020411 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls podName:b900991f-c6ec-45d1-a76b-44aec0f56cde nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.520397953 +0000 UTC m=+2.922399813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cloud-controller-manager-operator-tls" (UniqueName: "kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls") pod "cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" (UID: "b900991f-c6ec-45d1-a76b-44aec0f56cde") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020443 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config podName:fb98438b-191c-4957-a9d1-8a64520f7f00 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.520427564 +0000 UTC m=+2.922429424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "mcd-auth-proxy-config" (UniqueName: "kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config") pod "machine-config-daemon-dhr5k" (UID: "fb98438b-191c-4957-a9d1-8a64520f7f00") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020459 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.520450634 +0000 UTC m=+2.922452484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-metrics-server-tls" (UniqueName: "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.020621 master-0 kubenswrapper[33142]: E1204 00:47:10.020476 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.520468945 +0000 UTC m=+2.922470935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.021569 master-0 kubenswrapper[33142]: E1204 00:47:10.021518 33142 secret.go:189] Couldn't get secret openshift-monitoring/metrics-client-certs: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.021569 master-0 kubenswrapper[33142]: E1204 00:47:10.021539 33142 secret.go:189] Couldn't get secret openshift-monitoring/metrics-server-7kmmpv795dabm: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.021569 master-0 kubenswrapper[33142]: E1204 00:47:10.021558 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.521550136 +0000 UTC m=+2.923551986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-metrics-client-certs" (UniqueName: "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.021569 master-0 kubenswrapper[33142]: E1204 00:47:10.021576 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.521568347 +0000 UTC m=+2.923570197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca-bundle" (UniqueName: "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.021569 master-0 kubenswrapper[33142]: E1204 00:47:10.021582 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021594 33142 configmap.go:193] Couldn't get configMap openshift-cloud-controller-manager-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021610 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021621 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config podName:b900991f-c6ec-45d1-a76b-44aec0f56cde nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.521615588 +0000 UTC m=+2.923617438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config") pod "cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" (UID: "b900991f-c6ec-45d1-a76b-44aec0f56cde") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021617 33142 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021634 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca podName:8d4d3057-9f71-4b07-b463-51cc49d28bf3 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.521628288 +0000 UTC m=+2.923630138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca") pod "prometheus-operator-565bdcb8-8dcsg" (UID: "8d4d3057-9f71-4b07-b463-51cc49d28bf3") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021686 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca podName:4adeb2c2-10ba-420a-be0b-fb2329ac3fe2 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.5216725 +0000 UTC m=+2.923674470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca") pod "node-exporter-pcpjf" (UID: "4adeb2c2-10ba-420a-be0b-fb2329ac3fe2") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021702 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca podName:e3545341-90a7-42fe-9ba4-bf6e71ef776e nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.52169407 +0000 UTC m=+2.923696090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca") pod "controller-manager-6555cd6548-djfrg" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021735 33142 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.022029 master-0 kubenswrapper[33142]: E1204 00:47:10.021778 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config podName:5aabcb3b-483d-419b-98ce-0ffd0ce265e8 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:10.521767112 +0000 UTC m=+2.923769102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config") pod "kube-state-metrics-7dcc7f9bd6-cwhhx" (UID: "5aabcb3b-483d-419b-98ce-0ffd0ce265e8") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:10.033295 master-0 kubenswrapper[33142]: I1204 00:47:10.033028 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 00:47:10.050884 master-0 kubenswrapper[33142]: I1204 00:47:10.050811 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 00:47:10.072686 master-0 kubenswrapper[33142]: I1204 00:47:10.072611 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 00:47:10.093042 master-0 kubenswrapper[33142]: I1204 00:47:10.092875 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"cluster-samples-operator-dockercfg-rmj52" Dec 04 00:47:10.110949 master-0 kubenswrapper[33142]: I1204 00:47:10.110881 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 00:47:10.131788 master-0 kubenswrapper[33142]: I1204 00:47:10.131734 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 00:47:10.150733 master-0 kubenswrapper[33142]: I1204 00:47:10.150674 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-dockercfg-pzz8t" Dec 04 00:47:10.171084 master-0 kubenswrapper[33142]: I1204 00:47:10.171035 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 00:47:10.190617 master-0 kubenswrapper[33142]: I1204 00:47:10.190574 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 00:47:10.212131 master-0 kubenswrapper[33142]: I1204 00:47:10.212093 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-gvp2m" Dec 04 00:47:10.231687 master-0 kubenswrapper[33142]: I1204 00:47:10.231574 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 00:47:10.244774 master-0 kubenswrapper[33142]: I1204 00:47:10.244735 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:10.256945 master-0 kubenswrapper[33142]: I1204 00:47:10.256893 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 00:47:10.271557 master-0 kubenswrapper[33142]: I1204 00:47:10.271518 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 00:47:10.293948 master-0 kubenswrapper[33142]: I1204 00:47:10.291447 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 00:47:10.316372 master-0 kubenswrapper[33142]: I1204 00:47:10.316311 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-8qsb6" Dec 04 00:47:10.331784 master-0 kubenswrapper[33142]: I1204 00:47:10.331733 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 00:47:10.351293 master-0 kubenswrapper[33142]: I1204 00:47:10.351236 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 00:47:10.372116 master-0 kubenswrapper[33142]: I1204 00:47:10.372064 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 00:47:10.391866 master-0 kubenswrapper[33142]: I1204 00:47:10.391797 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 00:47:10.412055 master-0 kubenswrapper[33142]: I1204 00:47:10.411682 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 00:47:10.431606 master-0 kubenswrapper[33142]: I1204 00:47:10.431524 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 00:47:10.451893 master-0 kubenswrapper[33142]: I1204 00:47:10.451814 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 00:47:10.472429 master-0 kubenswrapper[33142]: I1204 00:47:10.472371 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 00:47:10.493040 master-0 kubenswrapper[33142]: I1204 00:47:10.492900 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 00:47:10.497875 master-0 kubenswrapper[33142]: I1204 00:47:10.497813 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.498019 master-0 kubenswrapper[33142]: I1204 00:47:10.497985 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:10.498176 master-0 kubenswrapper[33142]: I1204 00:47:10.498147 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:10.498327 master-0 kubenswrapper[33142]: I1204 00:47:10.498297 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.498406 master-0 kubenswrapper[33142]: I1204 00:47:10.498383 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:10.498437 master-0 kubenswrapper[33142]: I1204 00:47:10.498417 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.498482 master-0 kubenswrapper[33142]: I1204 00:47:10.498464 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.498684 master-0 kubenswrapper[33142]: I1204 00:47:10.498640 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-service-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.498725 master-0 kubenswrapper[33142]: I1204 00:47:10.498661 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.498806 master-0 kubenswrapper[33142]: I1204 00:47:10.498787 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.498908 master-0 kubenswrapper[33142]: I1204 00:47:10.498890 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.498908 master-0 kubenswrapper[33142]: I1204 00:47:10.498897 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.499023 master-0 kubenswrapper[33142]: I1204 00:47:10.499006 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.499076 master-0 kubenswrapper[33142]: I1204 00:47:10.499059 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.499108 master-0 kubenswrapper[33142]: I1204 00:47:10.499086 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.499142 master-0 kubenswrapper[33142]: I1204 00:47:10.499108 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:10.499226 master-0 kubenswrapper[33142]: I1204 00:47:10.499201 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:10.499226 master-0 kubenswrapper[33142]: I1204 00:47:10.499217 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:10.499299 master-0 kubenswrapper[33142]: I1204 00:47:10.499283 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.499354 master-0 kubenswrapper[33142]: I1204 00:47:10.499337 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:10.499419 master-0 kubenswrapper[33142]: I1204 00:47:10.499401 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.499470 master-0 kubenswrapper[33142]: I1204 00:47:10.499440 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:47:10.499518 master-0 kubenswrapper[33142]: I1204 00:47:10.499496 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:47:10.499586 master-0 kubenswrapper[33142]: I1204 00:47:10.499568 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.499677 master-0 kubenswrapper[33142]: I1204 00:47:10.499649 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-machine-approver-tls\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.499834 master-0 kubenswrapper[33142]: I1204 00:47:10.499441 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-serving-cert\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.499890 master-0 kubenswrapper[33142]: I1204 00:47:10.499854 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-auth-proxy-config\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:10.499944 master-0 kubenswrapper[33142]: I1204 00:47:10.499782 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-auth-proxy-config\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.500020 master-0 kubenswrapper[33142]: I1204 00:47:10.499998 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-samples-operator-tls\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:47:10.500158 master-0 kubenswrapper[33142]: I1204 00:47:10.500122 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-cco-trusted-ca\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:10.500196 master-0 kubenswrapper[33142]: I1204 00:47:10.500134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-auth-proxy-config\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:10.500196 master-0 kubenswrapper[33142]: I1204 00:47:10.500134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/87c52add-1fdc-4227-b1b1-76f3653e3fb0-images\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.500331 master-0 kubenswrapper[33142]: I1204 00:47:10.500240 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-cert\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:10.500710 master-0 kubenswrapper[33142]: I1204 00:47:10.500631 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:47:10.505135 master-0 kubenswrapper[33142]: I1204 00:47:10.505087 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-trusted-ca-bundle\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:10.517943 master-0 kubenswrapper[33142]: I1204 00:47:10.517869 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-dnxpd" Dec 04 00:47:10.534943 master-0 kubenswrapper[33142]: I1204 00:47:10.533163 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-cmtsx" Dec 04 00:47:10.551486 master-0 kubenswrapper[33142]: I1204 00:47:10.551431 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 00:47:10.560153 master-0 kubenswrapper[33142]: I1204 00:47:10.560101 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c52add-1fdc-4227-b1b1-76f3653e3fb0-proxy-tls\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:10.572042 master-0 kubenswrapper[33142]: I1204 00:47:10.571989 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-mfl95" Dec 04 00:47:10.591866 master-0 kubenswrapper[33142]: I1204 00:47:10.591772 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 00:47:10.600488 master-0 kubenswrapper[33142]: I1204 00:47:10.600423 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-images\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.600677 master-0 kubenswrapper[33142]: I1204 00:47:10.600622 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:10.600764 master-0 kubenswrapper[33142]: I1204 00:47:10.600682 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.600811 master-0 kubenswrapper[33142]: I1204 00:47:10.600768 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:10.600861 master-0 kubenswrapper[33142]: I1204 00:47:10.600813 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:10.600861 master-0 kubenswrapper[33142]: I1204 00:47:10.600840 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:10.600970 master-0 kubenswrapper[33142]: I1204 00:47:10.600891 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:10.600970 master-0 kubenswrapper[33142]: I1204 00:47:10.600964 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.601046 master-0 kubenswrapper[33142]: I1204 00:47:10.600989 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:10.601085 master-0 kubenswrapper[33142]: I1204 00:47:10.601046 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:10.601085 master-0 kubenswrapper[33142]: I1204 00:47:10.601067 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:10.601169 master-0 kubenswrapper[33142]: I1204 00:47:10.601157 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:47:10.601216 master-0 kubenswrapper[33142]: I1204 00:47:10.601176 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:10.601216 master-0 kubenswrapper[33142]: I1204 00:47:10.601206 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601261 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601284 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601311 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601330 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601347 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601364 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601385 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:10.601392 master-0 kubenswrapper[33142]: I1204 00:47:10.601403 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601423 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601462 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601479 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601502 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601540 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601573 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601638 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601685 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601736 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601755 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:10.601809 master-0 kubenswrapper[33142]: I1204 00:47:10.601799 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.601892 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.601910 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.601952 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fb98438b-191c-4957-a9d1-8a64520f7f00-mcd-auth-proxy-config\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.601978 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.602091 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.602121 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.602170 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:10.602388 master-0 kubenswrapper[33142]: I1204 00:47:10.602204 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:10.602716 master-0 kubenswrapper[33142]: I1204 00:47:10.602443 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/3e104a8c-66dc-4a9a-836f-656e6f4cc923-mcc-auth-proxy-config\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:10.611786 master-0 kubenswrapper[33142]: I1204 00:47:10.611746 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 00:47:10.620377 master-0 kubenswrapper[33142]: I1204 00:47:10.620319 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cert\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.644791 master-0 kubenswrapper[33142]: E1204 00:47:10.629273 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-rbac-proxy-crio-master-0\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 00:47:10.644791 master-0 kubenswrapper[33142]: I1204 00:47:10.634286 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 00:47:10.646639 master-0 kubenswrapper[33142]: I1204 00:47:10.646543 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/17f5a6f7-07dc-45cc-9db4-810f84b678d1-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.659396 master-0 kubenswrapper[33142]: I1204 00:47:10.659335 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 00:47:10.663238 master-0 kubenswrapper[33142]: I1204 00:47:10.663161 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f5a6f7-07dc-45cc-9db4-810f84b678d1-config\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:10.674260 master-0 kubenswrapper[33142]: I1204 00:47:10.674214 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 00:47:10.692067 master-0 kubenswrapper[33142]: I1204 00:47:10.691998 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 00:47:10.712946 master-0 kubenswrapper[33142]: I1204 00:47:10.711910 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-hkhgp" Dec 04 00:47:10.731529 master-0 kubenswrapper[33142]: I1204 00:47:10.731488 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 00:47:10.739147 master-0 kubenswrapper[33142]: I1204 00:47:10.739079 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-webhook-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:10.739147 master-0 kubenswrapper[33142]: I1204 00:47:10.739129 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-apiservice-cert\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:10.752756 master-0 kubenswrapper[33142]: I1204 00:47:10.752653 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 00:47:10.762349 master-0 kubenswrapper[33142]: I1204 00:47:10.762288 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/e852069a-82f1-4121-9d86-277b8ca07370-machine-api-operator-tls\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.770818 master-0 kubenswrapper[33142]: I1204 00:47:10.770781 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-rjr9s" Dec 04 00:47:10.791087 master-0 kubenswrapper[33142]: I1204 00:47:10.790899 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 00:47:10.792051 master-0 kubenswrapper[33142]: I1204 00:47:10.792009 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fb98438b-191c-4957-a9d1-8a64520f7f00-proxy-tls\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:10.811732 master-0 kubenswrapper[33142]: I1204 00:47:10.811665 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-xscpn" Dec 04 00:47:10.831028 master-0 kubenswrapper[33142]: I1204 00:47:10.830964 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 00:47:10.831278 master-0 kubenswrapper[33142]: I1204 00:47:10.831233 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-config\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.850713 master-0 kubenswrapper[33142]: I1204 00:47:10.850656 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-68bvv" Dec 04 00:47:10.869989 master-0 kubenswrapper[33142]: I1204 00:47:10.869914 33142 request.go:700] Waited for 2.00382171s due to client-side throttling, not priority and fairness, request: GET:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/secrets?fieldSelector=metadata.name%3Dmcc-proxy-tls&limit=500&resourceVersion=0 Dec 04 00:47:10.871304 master-0 kubenswrapper[33142]: I1204 00:47:10.871278 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 00:47:10.882108 master-0 kubenswrapper[33142]: I1204 00:47:10.882062 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3e104a8c-66dc-4a9a-836f-656e6f4cc923-proxy-tls\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:10.891574 master-0 kubenswrapper[33142]: I1204 00:47:10.891344 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 00:47:10.892727 master-0 kubenswrapper[33142]: I1204 00:47:10.892687 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:10.911228 master-0 kubenswrapper[33142]: I1204 00:47:10.911155 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 00:47:10.922033 master-0 kubenswrapper[33142]: I1204 00:47:10.921968 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/e852069a-82f1-4121-9d86-277b8ca07370-images\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:10.930488 master-0 kubenswrapper[33142]: I1204 00:47:10.930425 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-p78gv" Dec 04 00:47:10.951951 master-0 kubenswrapper[33142]: I1204 00:47:10.951866 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 00:47:10.964094 master-0 kubenswrapper[33142]: I1204 00:47:10.963916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/b900991f-c6ec-45d1-a76b-44aec0f56cde-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:10.971895 master-0 kubenswrapper[33142]: I1204 00:47:10.971860 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:47:10.991404 master-0 kubenswrapper[33142]: I1204 00:47:10.991335 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:47:11.014373 master-0 kubenswrapper[33142]: I1204 00:47:11.012123 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-lmpqm" Dec 04 00:47:11.039448 master-0 kubenswrapper[33142]: I1204 00:47:11.039383 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 00:47:11.043539 master-0 kubenswrapper[33142]: I1204 00:47:11.043489 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/b900991f-c6ec-45d1-a76b-44aec0f56cde-images\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:11.054653 master-0 kubenswrapper[33142]: I1204 00:47:11.054593 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 00:47:11.063432 master-0 kubenswrapper[33142]: I1204 00:47:11.063369 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-metrics-client-ca\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:11.063679 master-0 kubenswrapper[33142]: I1204 00:47:11.063376 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d4d3057-9f71-4b07-b463-51cc49d28bf3-metrics-client-ca\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:11.063679 master-0 kubenswrapper[33142]: I1204 00:47:11.063473 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1288d627-f7c2-47d5-aa02-2c86d5f82369-metrics-client-ca\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:11.063679 master-0 kubenswrapper[33142]: I1204 00:47:11.063488 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-metrics-client-ca\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:11.071691 master-0 kubenswrapper[33142]: I1204 00:47:11.071633 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 00:47:11.071972 master-0 kubenswrapper[33142]: I1204 00:47:11.071910 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-certs\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:11.093811 master-0 kubenswrapper[33142]: I1204 00:47:11.093757 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 00:47:11.101889 master-0 kubenswrapper[33142]: I1204 00:47:11.101823 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:11.111504 master-0 kubenswrapper[33142]: I1204 00:47:11.111431 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-kfhzx" Dec 04 00:47:11.133568 master-0 kubenswrapper[33142]: I1204 00:47:11.133514 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 00:47:11.144378 master-0 kubenswrapper[33142]: I1204 00:47:11.144319 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d4d3057-9f71-4b07-b463-51cc49d28bf3-prometheus-operator-tls\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:11.151979 master-0 kubenswrapper[33142]: I1204 00:47:11.151904 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 00:47:11.153451 master-0 kubenswrapper[33142]: I1204 00:47:11.153413 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/727020b5-1084-48ac-9aed-549e4eabbf81-node-bootstrap-token\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:11.172959 master-0 kubenswrapper[33142]: I1204 00:47:11.170447 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-x6jwn" Dec 04 00:47:11.191770 master-0 kubenswrapper[33142]: I1204 00:47:11.191687 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 00:47:11.202655 master-0 kubenswrapper[33142]: I1204 00:47:11.202578 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-tls\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:11.211469 master-0 kubenswrapper[33142]: I1204 00:47:11.211402 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 00:47:11.224329 master-0 kubenswrapper[33142]: I1204 00:47:11.224266 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:11.233311 master-0 kubenswrapper[33142]: I1204 00:47:11.233243 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 00:47:11.234635 master-0 kubenswrapper[33142]: I1204 00:47:11.234568 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:11.250825 master-0 kubenswrapper[33142]: I1204 00:47:11.250762 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-f6xzw" Dec 04 00:47:11.251641 master-0 kubenswrapper[33142]: I1204 00:47:11.251611 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:47:11.251641 master-0 kubenswrapper[33142]: I1204 00:47:11.251631 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:47:11.270938 master-0 kubenswrapper[33142]: I1204 00:47:11.270784 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 00:47:11.273337 master-0 kubenswrapper[33142]: I1204 00:47:11.273299 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-tls\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:11.291501 master-0 kubenswrapper[33142]: I1204 00:47:11.291437 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 00:47:11.292561 master-0 kubenswrapper[33142]: I1204 00:47:11.292526 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:11.312416 master-0 kubenswrapper[33142]: I1204 00:47:11.312323 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 00:47:11.312839 master-0 kubenswrapper[33142]: I1204 00:47:11.312778 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:11.331392 master-0 kubenswrapper[33142]: I1204 00:47:11.331275 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-wdzq5" Dec 04 00:47:11.351253 master-0 kubenswrapper[33142]: I1204 00:47:11.351194 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 00:47:11.351645 master-0 kubenswrapper[33142]: I1204 00:47:11.351602 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df783888-6b82-48e8-aad0-ee77f7167115-cert\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:47:11.371720 master-0 kubenswrapper[33142]: I1204 00:47:11.371638 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 00:47:11.392749 master-0 kubenswrapper[33142]: I1204 00:47:11.392684 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 00:47:11.403707 master-0 kubenswrapper[33142]: I1204 00:47:11.403655 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1288d627-f7c2-47d5-aa02-2c86d5f82369-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:11.412495 master-0 kubenswrapper[33142]: I1204 00:47:11.412424 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 00:47:11.433623 master-0 kubenswrapper[33142]: I1204 00:47:11.433567 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-grlj9" Dec 04 00:47:11.451537 master-0 kubenswrapper[33142]: I1204 00:47:11.451477 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 00:47:11.452483 master-0 kubenswrapper[33142]: I1204 00:47:11.452440 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:11.471757 master-0 kubenswrapper[33142]: I1204 00:47:11.471677 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-7kmmpv795dabm" Dec 04 00:47:11.472035 master-0 kubenswrapper[33142]: I1204 00:47:11.471995 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:11.492321 master-0 kubenswrapper[33142]: I1204 00:47:11.492253 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:47:11.512073 master-0 kubenswrapper[33142]: I1204 00:47:11.512015 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:47:11.522347 master-0 kubenswrapper[33142]: I1204 00:47:11.522250 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:11.532006 master-0 kubenswrapper[33142]: I1204 00:47:11.531968 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:47:11.532817 master-0 kubenswrapper[33142]: I1204 00:47:11.532773 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:11.551277 master-0 kubenswrapper[33142]: I1204 00:47:11.551215 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:47:11.553337 master-0 kubenswrapper[33142]: I1204 00:47:11.553300 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:11.571340 master-0 kubenswrapper[33142]: I1204 00:47:11.571291 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 00:47:11.572982 master-0 kubenswrapper[33142]: I1204 00:47:11.572896 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:11.598605 master-0 kubenswrapper[33142]: I1204 00:47:11.598523 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:47:11.601451 master-0 kubenswrapper[33142]: E1204 00:47:11.601410 33142 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.601556 master-0 kubenswrapper[33142]: E1204 00:47:11.601469 33142 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.601556 master-0 kubenswrapper[33142]: E1204 00:47:11.601501 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs podName:20835c26-301c-423e-b534-ec2a5e5af953 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.601476252 +0000 UTC m=+5.003478102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs") pod "multus-admission-controller-5bdcc987c4-s85ld" (UID: "20835c26-301c-423e-b534-ec2a5e5af953") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.601556 master-0 kubenswrapper[33142]: E1204 00:47:11.601508 33142 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/config: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.601680 master-0 kubenswrapper[33142]: E1204 00:47:11.601593 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.601565414 +0000 UTC m=+5.003567274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.601680 master-0 kubenswrapper[33142]: E1204 00:47:11.601629 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.601614436 +0000 UTC m=+5.003616296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.602879 master-0 kubenswrapper[33142]: E1204 00:47:11.602836 33142 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-server-audit-profiles: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.602879 master-0 kubenswrapper[33142]: E1204 00:47:11.602854 33142 secret.go:189] Couldn't get secret openshift-monitoring/metrics-server-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.603025 master-0 kubenswrapper[33142]: E1204 00:47:11.602906 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.602894313 +0000 UTC m=+5.004896163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-server-audit-profiles" (UniqueName: "kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.603025 master-0 kubenswrapper[33142]: E1204 00:47:11.602949 33142 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.603143 master-0 kubenswrapper[33142]: E1204 00:47:11.602965 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls podName:4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.602919423 +0000 UTC m=+5.004921273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-metrics-server-tls" (UniqueName: "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls") pod "metrics-server-6b4bbf8466-qk67v" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a") : failed to sync secret cache: timed out waiting for the condition Dec 04 00:47:11.603143 master-0 kubenswrapper[33142]: E1204 00:47:11.603099 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca podName:2cfd1a75-01c6-488b-aed9-646f1c4ce0f5 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:12.603076768 +0000 UTC m=+5.005078628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca") pod "route-controller-manager-64497d959b-vghsb" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5") : failed to sync configmap cache: timed out waiting for the condition Dec 04 00:47:11.603277 master-0 kubenswrapper[33142]: I1204 00:47:11.603249 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:11.610978 master-0 kubenswrapper[33142]: I1204 00:47:11.610915 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 00:47:11.631752 master-0 kubenswrapper[33142]: I1204 00:47:11.631690 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-pvgwv" Dec 04 00:47:11.652889 master-0 kubenswrapper[33142]: I1204 00:47:11.652823 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:47:11.672573 master-0 kubenswrapper[33142]: I1204 00:47:11.672508 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:47:11.691963 master-0 kubenswrapper[33142]: I1204 00:47:11.691893 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 00:47:11.712199 master-0 kubenswrapper[33142]: I1204 00:47:11.711815 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:47:11.731999 master-0 kubenswrapper[33142]: I1204 00:47:11.731784 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:47:11.751001 master-0 kubenswrapper[33142]: I1204 00:47:11.750947 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:47:11.771232 master-0 kubenswrapper[33142]: I1204 00:47:11.771167 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:47:11.791280 master-0 kubenswrapper[33142]: I1204 00:47:11.791182 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-b7gnv" Dec 04 00:47:11.811849 master-0 kubenswrapper[33142]: I1204 00:47:11.811796 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:47:11.831581 master-0 kubenswrapper[33142]: I1204 00:47:11.831520 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-sk926" Dec 04 00:47:11.851570 master-0 kubenswrapper[33142]: I1204 00:47:11.851512 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 00:47:11.870881 master-0 kubenswrapper[33142]: I1204 00:47:11.870821 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-xwbnk" Dec 04 00:47:11.889734 master-0 kubenswrapper[33142]: I1204 00:47:11.889669 33142 request.go:700] Waited for 3.008733371s due to client-side throttling, not priority and fairness, request: GET:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/configmaps?fieldSelector=metadata.name%3Dkube-root-ca.crt&limit=500&resourceVersion=0 Dec 04 00:47:11.891116 master-0 kubenswrapper[33142]: I1204 00:47:11.891082 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 00:47:11.942556 master-0 kubenswrapper[33142]: I1204 00:47:11.942492 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9fr\" (UniqueName: \"kubernetes.io/projected/3e901355-2d0f-46f9-9d64-c4bc900b1839-kube-api-access-vd9fr\") pod \"etcd-operator-7978bf889c-zkr9h\" (UID: \"3e901355-2d0f-46f9-9d64-c4bc900b1839\") " pod="openshift-etcd-operator/etcd-operator-7978bf889c-zkr9h" Dec 04 00:47:11.962146 master-0 kubenswrapper[33142]: I1204 00:47:11.962095 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnmjf\" (UniqueName: \"kubernetes.io/projected/a6a2308d-6d6f-4e8d-a6db-d931a172ed55-kube-api-access-bnmjf\") pod \"control-plane-machine-set-operator-66f4cc99d4-6sv72\" (UID: \"a6a2308d-6d6f-4e8d-a6db-d931a172ed55\") " pod="openshift-machine-api/control-plane-machine-set-operator-66f4cc99d4-6sv72" Dec 04 00:47:11.981798 master-0 kubenswrapper[33142]: I1204 00:47:11.981734 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkk7m\" (UniqueName: \"kubernetes.io/projected/edd7cfb0-df67-4978-adca-9b917d3b5708-kube-api-access-tkk7m\") pod \"iptables-alerter-zm8h9\" (UID: \"edd7cfb0-df67-4978-adca-9b917d3b5708\") " pod="openshift-network-operator/iptables-alerter-zm8h9" Dec 04 00:47:12.007625 master-0 kubenswrapper[33142]: I1204 00:47:12.007548 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslx5\" (UniqueName: \"kubernetes.io/projected/87adb521-b8d3-4201-b775-50c8c03956fc-kube-api-access-sslx5\") pod \"redhat-operators-cl29d\" (UID: \"87adb521-b8d3-4201-b775-50c8c03956fc\") " pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:12.025180 master-0 kubenswrapper[33142]: I1204 00:47:12.025087 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfcxz\" (UniqueName: \"kubernetes.io/projected/93b8a17c-ef68-4be1-9b98-0dd1a3d66f16-kube-api-access-cfcxz\") pod \"cluster-samples-operator-6d64b47964-6r94q\" (UID: \"93b8a17c-ef68-4be1-9b98-0dd1a3d66f16\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6d64b47964-6r94q" Dec 04 00:47:12.045861 master-0 kubenswrapper[33142]: I1204 00:47:12.045714 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvvd\" (UniqueName: \"kubernetes.io/projected/9a83a76c-050e-4378-ac3a-1213d6d53773-kube-api-access-6gvvd\") pod \"network-metrics-daemon-t85qp\" (UID: \"9a83a76c-050e-4378-ac3a-1213d6d53773\") " pod="openshift-multus/network-metrics-daemon-t85qp" Dec 04 00:47:12.066342 master-0 kubenswrapper[33142]: I1204 00:47:12.066283 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/26273240-2261-4564-bb64-1aaf774a921f-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f574c6c79-zbdd7\" (UID: \"26273240-2261-4564-bb64-1aaf774a921f\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f574c6c79-zbdd7" Dec 04 00:47:12.087680 master-0 kubenswrapper[33142]: I1204 00:47:12.087614 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45md\" (UniqueName: \"kubernetes.io/projected/04f4782e-b152-41c0-870a-08936498d1af-kube-api-access-h45md\") pod \"kube-storage-version-migrator-operator-67c4cff67d-7mc5p\" (UID: \"04f4782e-b152-41c0-870a-08936498d1af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-67c4cff67d-7mc5p" Dec 04 00:47:12.106034 master-0 kubenswrapper[33142]: I1204 00:47:12.105960 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsg2\" (UniqueName: \"kubernetes.io/projected/8a5721ad-a077-439a-9ec0-57d90dfb5c14-kube-api-access-9rsg2\") pod \"openshift-controller-manager-operator-7c4697b5f5-x459g\" (UID: \"8a5721ad-a077-439a-9ec0-57d90dfb5c14\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-7c4697b5f5-x459g" Dec 04 00:47:12.123339 master-0 kubenswrapper[33142]: I1204 00:47:12.123280 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vsq\" (UniqueName: \"kubernetes.io/projected/aa2eaba9-479e-4420-a24f-63530e4da783-kube-api-access-59vsq\") pod \"marketplace-operator-7d67745bb7-2qnbf\" (UID: \"aa2eaba9-479e-4420-a24f-63530e4da783\") " pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:12.145004 master-0 kubenswrapper[33142]: I1204 00:47:12.144916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5xk\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-kube-api-access-4k5xk\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:12.163652 master-0 kubenswrapper[33142]: I1204 00:47:12.163605 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd68g\" (UniqueName: \"kubernetes.io/projected/7e83f444-49e8-40b5-9a58-3128002f28c9-kube-api-access-fd68g\") pod \"redhat-marketplace-zc792\" (UID: \"7e83f444-49e8-40b5-9a58-3128002f28c9\") " pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:12.182681 master-0 kubenswrapper[33142]: I1204 00:47:12.182631 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvj6\" (UniqueName: \"kubernetes.io/projected/7d3c9170-b36d-4052-8ae9-9e549611dbd8-kube-api-access-gwvj6\") pod \"migrator-5bcf58cf9c-x5fz2\" (UID: \"7d3c9170-b36d-4052-8ae9-9e549611dbd8\") " pod="openshift-kube-storage-version-migrator/migrator-5bcf58cf9c-x5fz2" Dec 04 00:47:12.203960 master-0 kubenswrapper[33142]: I1204 00:47:12.203898 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7ps\" (UniqueName: \"kubernetes.io/projected/49bd2d0a-d2b5-423d-adb2-61fdf9a51e39-kube-api-access-dn7ps\") pod \"openshift-config-operator-68c95b6cf5-qgr6l\" (UID: \"49bd2d0a-d2b5-423d-adb2-61fdf9a51e39\") " pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:12.223037 master-0 kubenswrapper[33142]: I1204 00:47:12.222992 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-588cp\" (UniqueName: \"kubernetes.io/projected/21e8bd47-93e6-4068-a6fb-ba34255103d2-kube-api-access-588cp\") pod \"tuned-df7ld\" (UID: \"21e8bd47-93e6-4068-a6fb-ba34255103d2\") " pod="openshift-cluster-node-tuning-operator/tuned-df7ld" Dec 04 00:47:12.243761 master-0 kubenswrapper[33142]: I1204 00:47:12.243700 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzsg\" (UniqueName: \"kubernetes.io/projected/c79edcd7-4399-4ded-9b03-9084ad9e14b4-kube-api-access-ptzsg\") pod \"package-server-manager-75b4d49d4c-7s5z5\" (UID: \"c79edcd7-4399-4ded-9b03-9084ad9e14b4\") " pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:12.266326 master-0 kubenswrapper[33142]: I1204 00:47:12.266217 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt7lk\" (UniqueName: \"kubernetes.io/projected/6bf75491-0c03-4e02-9074-c9be808badd4-kube-api-access-qt7lk\") pod \"certified-operators-m4q5k\" (UID: \"6bf75491-0c03-4e02-9074-c9be808badd4\") " pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:12.283891 master-0 kubenswrapper[33142]: I1204 00:47:12.283803 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gxb\" (UniqueName: \"kubernetes.io/projected/890fd2c0-ac22-4d85-aa02-8f6c4518b7a1-kube-api-access-56gxb\") pod \"cloud-credential-operator-7c4dc67499-shsm8\" (UID: \"890fd2c0-ac22-4d85-aa02-8f6c4518b7a1\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-7c4dc67499-shsm8" Dec 04 00:47:12.306470 master-0 kubenswrapper[33142]: I1204 00:47:12.306281 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-296mn\" (UniqueName: \"kubernetes.io/projected/ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8-kube-api-access-296mn\") pod \"catalog-operator-7cf5cf757f-mmb2r\" (UID: \"ad19ef0d-1034-4b80-b3ad-9a506bc0a3a8\") " pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:12.323913 master-0 kubenswrapper[33142]: I1204 00:47:12.323835 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxjm\" (UniqueName: \"kubernetes.io/projected/29db06e4-26c0-45e4-ba90-509f51cad1a2-kube-api-access-khxjm\") pod \"service-ca-6b8bb995f7-rwmbh\" (UID: \"29db06e4-26c0-45e4-ba90-509f51cad1a2\") " pod="openshift-service-ca/service-ca-6b8bb995f7-rwmbh" Dec 04 00:47:12.343943 master-0 kubenswrapper[33142]: I1204 00:47:12.343873 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42cq\" (UniqueName: \"kubernetes.io/projected/3e5012fe-fc48-4b6d-a075-fa94266ba90d-kube-api-access-g42cq\") pod \"network-check-source-6964bb78b7-qzwwq\" (UID: \"3e5012fe-fc48-4b6d-a075-fa94266ba90d\") " pod="openshift-network-diagnostics/network-check-source-6964bb78b7-qzwwq" Dec 04 00:47:12.364424 master-0 kubenswrapper[33142]: I1204 00:47:12.364358 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8559\" (UniqueName: \"kubernetes.io/projected/55cd7eeb-05b2-4ec9-bd37-a765beac3ab8-kube-api-access-f8559\") pod \"packageserver-59f876d99-xlc5q\" (UID: \"55cd7eeb-05b2-4ec9-bd37-a765beac3ab8\") " pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:12.383758 master-0 kubenswrapper[33142]: I1204 00:47:12.383677 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgmcr\" (UniqueName: \"kubernetes.io/projected/68cb9838-2d09-46ab-8e2d-08d5868056fc-kube-api-access-pgmcr\") pod \"ovnkube-node-kgflj\" (UID: \"68cb9838-2d09-46ab-8e2d-08d5868056fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:12.403106 master-0 kubenswrapper[33142]: I1204 00:47:12.403040 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw7p\" (UniqueName: \"kubernetes.io/projected/e8375dfa-3a83-415b-bce5-0819a73255c1-kube-api-access-xvw7p\") pod \"dns-operator-6b7bcd6566-v5f4p\" (UID: \"e8375dfa-3a83-415b-bce5-0819a73255c1\") " pod="openshift-dns-operator/dns-operator-6b7bcd6566-v5f4p" Dec 04 00:47:12.430642 master-0 kubenswrapper[33142]: I1204 00:47:12.430561 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmlmf\" (UniqueName: \"kubernetes.io/projected/36d5dd7e-7ac5-4c41-8f62-404bc5919857-kube-api-access-fmlmf\") pod \"multus-additional-cni-plugins-jglkq\" (UID: \"36d5dd7e-7ac5-4c41-8f62-404bc5919857\") " pod="openshift-multus/multus-additional-cni-plugins-jglkq" Dec 04 00:47:12.453397 master-0 kubenswrapper[33142]: I1204 00:47:12.453309 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnml\" (UniqueName: \"kubernetes.io/projected/7af17f6f-6bda-4972-a72a-9d9059cd2fa6-kube-api-access-xdnml\") pod \"apiserver-56f6ccc758-vsg29\" (UID: \"7af17f6f-6bda-4972-a72a-9d9059cd2fa6\") " pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:12.469264 master-0 kubenswrapper[33142]: I1204 00:47:12.469184 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4sq\" (UniqueName: \"kubernetes.io/projected/285a1e74-1d8e-452e-a5a4-484afc10e10f-kube-api-access-6q4sq\") pod \"csi-snapshot-controller-operator-7b795784b8-6cgj2\" (UID: \"285a1e74-1d8e-452e-a5a4-484afc10e10f\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-7b795784b8-6cgj2" Dec 04 00:47:12.486156 master-0 kubenswrapper[33142]: I1204 00:47:12.486106 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89j7\" (UniqueName: \"kubernetes.io/projected/f190ddab-e7d0-4dd6-8bb7-359a02393259-kube-api-access-s89j7\") pod \"dns-default-cr7sj\" (UID: \"f190ddab-e7d0-4dd6-8bb7-359a02393259\") " pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:12.502341 master-0 kubenswrapper[33142]: I1204 00:47:12.502272 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-bound-sa-token\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:12.527838 master-0 kubenswrapper[33142]: I1204 00:47:12.527755 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv8dv\" (UniqueName: \"kubernetes.io/projected/e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c-kube-api-access-pv8dv\") pod \"insights-operator-59d99f9b7b-jl84b\" (UID: \"e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c\") " pod="openshift-insights/insights-operator-59d99f9b7b-jl84b" Dec 04 00:47:12.544921 master-0 kubenswrapper[33142]: I1204 00:47:12.544847 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlv5m\" (UniqueName: \"kubernetes.io/projected/f2f01d68-92ae-45b8-8501-645e439b5295-kube-api-access-vlv5m\") pod \"cluster-monitoring-operator-69cc794c58-5cpjn\" (UID: \"f2f01d68-92ae-45b8-8501-645e439b5295\") " pod="openshift-monitoring/cluster-monitoring-operator-69cc794c58-5cpjn" Dec 04 00:47:12.583746 master-0 kubenswrapper[33142]: I1204 00:47:12.583060 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58w7s\" (UniqueName: \"kubernetes.io/projected/ba4531f5-90d7-41b9-9bbc-0f0d5c640d96-kube-api-access-58w7s\") pod \"cluster-autoscaler-operator-7f88444875-zwhqs\" (UID: \"ba4531f5-90d7-41b9-9bbc-0f0d5c640d96\") " pod="openshift-machine-api/cluster-autoscaler-operator-7f88444875-zwhqs" Dec 04 00:47:12.603054 master-0 kubenswrapper[33142]: I1204 00:47:12.602979 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46a9c1fd-6e78-4d87-85ef-f8fc195bb980-bound-sa-token\") pod \"cluster-image-registry-operator-65dc4bcb88-2m45m\" (UID: \"46a9c1fd-6e78-4d87-85ef-f8fc195bb980\") " pod="openshift-image-registry/cluster-image-registry-operator-65dc4bcb88-2m45m" Dec 04 00:47:12.604137 master-0 kubenswrapper[33142]: I1204 00:47:12.604018 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5r9\" (UniqueName: \"kubernetes.io/projected/0616abbd-748a-4451-96b7-df0178c99e8f-kube-api-access-gx5r9\") pod \"network-node-identity-lxpmq\" (UID: \"0616abbd-748a-4451-96b7-df0178c99e8f\") " pod="openshift-network-node-identity/network-node-identity-lxpmq" Dec 04 00:47:12.634501 master-0 kubenswrapper[33142]: I1204 00:47:12.634425 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrjl\" (UniqueName: \"kubernetes.io/projected/c0f3ded2-925e-4d86-9c91-55b5df9f28ab-kube-api-access-9lrjl\") pod \"ingress-operator-85dbd94574-7clvx\" (UID: \"c0f3ded2-925e-4d86-9c91-55b5df9f28ab\") " pod="openshift-ingress-operator/ingress-operator-85dbd94574-7clvx" Dec 04 00:47:12.645207 master-0 kubenswrapper[33142]: I1204 00:47:12.645122 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.645207 master-0 kubenswrapper[33142]: I1204 00:47:12.645203 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:12.645512 master-0 kubenswrapper[33142]: I1204 00:47:12.645301 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:12.645512 master-0 kubenswrapper[33142]: I1204 00:47:12.645457 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.645897 master-0 kubenswrapper[33142]: I1204 00:47:12.645545 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:12.645897 master-0 kubenswrapper[33142]: I1204 00:47:12.645555 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:12.645897 master-0 kubenswrapper[33142]: I1204 00:47:12.645556 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.645897 master-0 kubenswrapper[33142]: I1204 00:47:12.645728 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.645897 master-0 kubenswrapper[33142]: I1204 00:47:12.645836 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:12.646313 master-0 kubenswrapper[33142]: I1204 00:47:12.645903 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.646313 master-0 kubenswrapper[33142]: I1204 00:47:12.645916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/20835c26-301c-423e-b534-ec2a5e5af953-webhook-certs\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:12.646313 master-0 kubenswrapper[33142]: I1204 00:47:12.646080 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:12.655162 master-0 kubenswrapper[33142]: I1204 00:47:12.655125 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznm9\" (UniqueName: \"kubernetes.io/projected/47152378-4ef5-4eff-9b30-fd8635982f02-kube-api-access-rznm9\") pod \"operator-controller-controller-manager-5f78c89466-mwkdg\" (UID: \"47152378-4ef5-4eff-9b30-fd8635982f02\") " pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:12.661994 master-0 kubenswrapper[33142]: I1204 00:47:12.661965 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn7tr\" (UniqueName: \"kubernetes.io/projected/cb121145-3e1a-49da-aac5-822cf65eefcf-kube-api-access-zn7tr\") pod \"cluster-node-tuning-operator-bbd9b9dff-lqlgs\" (UID: \"cb121145-3e1a-49da-aac5-822cf65eefcf\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-bbd9b9dff-lqlgs" Dec 04 00:47:12.681850 master-0 kubenswrapper[33142]: I1204 00:47:12.681782 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4mf\" (UniqueName: \"kubernetes.io/projected/2b07bd15-f37f-48ab-bc36-ee43e3bb1b11-kube-api-access-2s4mf\") pod \"cluster-olm-operator-589f5cdc9d-vqmbm\" (UID: \"2b07bd15-f37f-48ab-bc36-ee43e3bb1b11\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-589f5cdc9d-vqmbm" Dec 04 00:47:12.707837 master-0 kubenswrapper[33142]: I1204 00:47:12.707770 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpp6c\" (UniqueName: \"kubernetes.io/projected/2ad96246-c53a-4016-b67d-5e9d66f40d5b-kube-api-access-kpp6c\") pod \"ovnkube-control-plane-f9f7f4946-kwdfc\" (UID: \"2ad96246-c53a-4016-b67d-5e9d66f40d5b\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-f9f7f4946-kwdfc" Dec 04 00:47:12.735022 master-0 kubenswrapper[33142]: I1204 00:47:12.734952 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f4d39cde-d7b9-4156-afd1-cc4f23b9b16a-kube-api-access\") pod \"kube-apiserver-operator-5b557b5f57-z9mw6\" (UID: \"f4d39cde-d7b9-4156-afd1-cc4f23b9b16a\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-5b557b5f57-z9mw6" Dec 04 00:47:12.743073 master-0 kubenswrapper[33142]: I1204 00:47:12.743027 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kssf\" (UniqueName: \"kubernetes.io/projected/060f2a39-e40c-495b-885d-5acd967e6c25-kube-api-access-9kssf\") pod \"network-check-target-w5f2j\" (UID: \"060f2a39-e40c-495b-885d-5acd967e6c25\") " pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:47:12.763014 master-0 kubenswrapper[33142]: I1204 00:47:12.762911 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ca8eddb5-4600-4058-94d2-5d0308c32613-kube-api-access\") pod \"kube-controller-manager-operator-b5dddf8f5-2h4wf\" (UID: \"ca8eddb5-4600-4058-94d2-5d0308c32613\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-b5dddf8f5-2h4wf" Dec 04 00:47:12.784408 master-0 kubenswrapper[33142]: I1204 00:47:12.784347 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vtf\" (UniqueName: \"kubernetes.io/projected/95141f9b-b6b0-40dc-a6e2-b5c84d24caac-kube-api-access-j7vtf\") pod \"cluster-storage-operator-f84784664-zvrvl\" (UID: \"95141f9b-b6b0-40dc-a6e2-b5c84d24caac\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-f84784664-zvrvl" Dec 04 00:47:12.806743 master-0 kubenswrapper[33142]: I1204 00:47:12.806602 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjgh\" (UniqueName: \"kubernetes.io/projected/e85684df-0014-4d28-9b00-9c6a6942cc94-kube-api-access-ssjgh\") pod \"node-resolver-5bwrm\" (UID: \"e85684df-0014-4d28-9b00-9c6a6942cc94\") " pod="openshift-dns/node-resolver-5bwrm" Dec 04 00:47:12.830836 master-0 kubenswrapper[33142]: I1204 00:47:12.830736 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzcp\" (UniqueName: \"kubernetes.io/projected/d7a0402f-755b-44a1-8cb8-c95b6ecff780-kube-api-access-thzcp\") pod \"multus-w7796\" (UID: \"d7a0402f-755b-44a1-8cb8-c95b6ecff780\") " pod="openshift-multus/multus-w7796" Dec 04 00:47:12.845054 master-0 kubenswrapper[33142]: I1204 00:47:12.844888 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcpnq\" (UniqueName: \"kubernetes.io/projected/ffe9d26b-34e2-4506-9c38-69b85ab210a1-kube-api-access-xcpnq\") pod \"olm-operator-76bd5d69c7-8xfwz\" (UID: \"ffe9d26b-34e2-4506-9c38-69b85ab210a1\") " pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:12.864576 master-0 kubenswrapper[33142]: I1204 00:47:12.864499 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvkp2\" (UniqueName: \"kubernetes.io/projected/655dc370-c0d1-4d03-a317-64bf099aff1b-kube-api-access-fvkp2\") pod \"openshift-apiserver-operator-667484ff5-mswdx\" (UID: \"655dc370-c0d1-4d03-a317-64bf099aff1b\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-667484ff5-mswdx" Dec 04 00:47:12.885843 master-0 kubenswrapper[33142]: I1204 00:47:12.885614 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6tj6\" (UniqueName: \"kubernetes.io/projected/17f5a6f7-07dc-45cc-9db4-810f84b678d1-kube-api-access-h6tj6\") pod \"cluster-baremetal-operator-5fdc576499-xlwrx\" (UID: \"17f5a6f7-07dc-45cc-9db4-810f84b678d1\") " pod="openshift-machine-api/cluster-baremetal-operator-5fdc576499-xlwrx" Dec 04 00:47:12.889984 master-0 kubenswrapper[33142]: I1204 00:47:12.889942 33142 request.go:700] Waited for 3.979403756s due to client-side throttling, not priority and fairness, request: POST:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-network-operator/serviceaccounts/cluster-network-operator/token Dec 04 00:47:12.914181 master-0 kubenswrapper[33142]: I1204 00:47:12.914121 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgzc\" (UniqueName: \"kubernetes.io/projected/aa373a8f-8a9c-4f90-ae62-1d48fd88550b-kube-api-access-lbgzc\") pod \"network-operator-6cbf58c977-vjwnj\" (UID: \"aa373a8f-8a9c-4f90-ae62-1d48fd88550b\") " pod="openshift-network-operator/network-operator-6cbf58c977-vjwnj" Dec 04 00:47:12.923355 master-0 kubenswrapper[33142]: I1204 00:47:12.923310 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9j7\" (UniqueName: \"kubernetes.io/projected/975f6a6f-1fbb-49e1-8a0a-722586355364-kube-api-access-jt9j7\") pod \"community-operators-dvxb6\" (UID: \"975f6a6f-1fbb-49e1-8a0a-722586355364\") " pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:12.942897 master-0 kubenswrapper[33142]: I1204 00:47:12.942833 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rb5q\" (UniqueName: \"kubernetes.io/projected/4b5c0b0e-6015-473f-b7b8-0e91900cd82d-kube-api-access-5rb5q\") pod \"apiserver-87cd489bc-llsfr\" (UID: \"4b5c0b0e-6015-473f-b7b8-0e91900cd82d\") " pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:12.968416 master-0 kubenswrapper[33142]: I1204 00:47:12.968346 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/004c989d-6ae8-4147-8355-af1118fe6a98-kube-api-access\") pod \"cluster-version-operator-7c49fbfc6f-mbdzr\" (UID: \"004c989d-6ae8-4147-8355-af1118fe6a98\") " pod="openshift-cluster-version/cluster-version-operator-7c49fbfc6f-mbdzr" Dec 04 00:47:12.986511 master-0 kubenswrapper[33142]: I1204 00:47:12.986442 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpnm\" (UniqueName: \"kubernetes.io/projected/dd621016-f4f2-4839-aae0-a804e6023423-kube-api-access-6vpnm\") pod \"service-ca-operator-56f5898f45-2qvfj\" (UID: \"dd621016-f4f2-4839-aae0-a804e6023423\") " pod="openshift-service-ca-operator/service-ca-operator-56f5898f45-2qvfj" Dec 04 00:47:13.009653 master-0 kubenswrapper[33142]: I1204 00:47:13.009594 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc2xd\" (UniqueName: \"kubernetes.io/projected/dc7bfc47-972c-4493-8372-f211c6645ff5-kube-api-access-pc2xd\") pod \"csi-snapshot-controller-86897dd478-8zdrm\" (UID: \"dc7bfc47-972c-4493-8372-f211c6645ff5\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-86897dd478-8zdrm" Dec 04 00:47:13.024837 master-0 kubenswrapper[33142]: I1204 00:47:13.024747 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wg7\" (UniqueName: \"kubernetes.io/projected/87c52add-1fdc-4227-b1b1-76f3653e3fb0-kube-api-access-76wg7\") pod \"machine-config-operator-664c9d94c9-r2h84\" (UID: \"87c52add-1fdc-4227-b1b1-76f3653e3fb0\") " pod="openshift-machine-config-operator/machine-config-operator-664c9d94c9-r2h84" Dec 04 00:47:13.045425 master-0 kubenswrapper[33142]: I1204 00:47:13.045361 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkrq\" (UniqueName: \"kubernetes.io/projected/d5f22827-c301-4584-b999-0a1cc1033bb5-kube-api-access-5hkrq\") pod \"authentication-operator-7479ffdf48-7jnhr\" (UID: \"d5f22827-c301-4584-b999-0a1cc1033bb5\") " pod="openshift-authentication-operator/authentication-operator-7479ffdf48-7jnhr" Dec 04 00:47:13.067428 master-0 kubenswrapper[33142]: I1204 00:47:13.067357 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdwv\" (UniqueName: \"kubernetes.io/projected/62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb-kube-api-access-9zdwv\") pod \"machine-approver-cb84b9cdf-tsm24\" (UID: \"62e34e8d-fd5e-4d7b-81f4-3ad911b3dedb\") " pod="openshift-cluster-machine-approver/machine-approver-cb84b9cdf-tsm24" Dec 04 00:47:13.087057 master-0 kubenswrapper[33142]: I1204 00:47:13.087001 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2g6h\" (UniqueName: \"kubernetes.io/projected/83e0d056-186c-4067-b586-14fe2970fcc0-kube-api-access-p2g6h\") pod \"router-default-54f97f57-x27s4\" (UID: \"83e0d056-186c-4067-b586-14fe2970fcc0\") " pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:13.107676 master-0 kubenswrapper[33142]: I1204 00:47:13.107622 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sts\" (UniqueName: \"kubernetes.io/projected/bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced-kube-api-access-25sts\") pod \"catalogd-controller-manager-754cfd84-zjpxn\" (UID: \"bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced\") " pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:13.135041 master-0 kubenswrapper[33142]: I1204 00:47:13.134973 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7nz\" (UniqueName: \"kubernetes.io/projected/e852069a-82f1-4121-9d86-277b8ca07370-kube-api-access-tg7nz\") pod \"machine-api-operator-7486ff55f-tnhrb\" (UID: \"e852069a-82f1-4121-9d86-277b8ca07370\") " pod="openshift-machine-api/machine-api-operator-7486ff55f-tnhrb" Dec 04 00:47:13.159207 master-0 kubenswrapper[33142]: I1204 00:47:13.159115 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"installer-3-master-0\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:13.167520 master-0 kubenswrapper[33142]: I1204 00:47:13.167419 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"metrics-server-6b4bbf8466-qk67v\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:13.190966 master-0 kubenswrapper[33142]: I1204 00:47:13.190872 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9v27\" (UniqueName: \"kubernetes.io/projected/5aabcb3b-483d-419b-98ce-0ffd0ce265e8-kube-api-access-k9v27\") pod \"kube-state-metrics-7dcc7f9bd6-cwhhx\" (UID: \"5aabcb3b-483d-419b-98ce-0ffd0ce265e8\") " pod="openshift-monitoring/kube-state-metrics-7dcc7f9bd6-cwhhx" Dec 04 00:47:13.203872 master-0 kubenswrapper[33142]: I1204 00:47:13.203821 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2zj\" (UniqueName: \"kubernetes.io/projected/b900991f-c6ec-45d1-a76b-44aec0f56cde-kube-api-access-vg2zj\") pod \"cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw\" (UID: \"b900991f-c6ec-45d1-a76b-44aec0f56cde\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw" Dec 04 00:47:13.223446 master-0 kubenswrapper[33142]: I1204 00:47:13.223386 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vtt\" (UniqueName: \"kubernetes.io/projected/3e104a8c-66dc-4a9a-836f-656e6f4cc923-kube-api-access-k4vtt\") pod \"machine-config-controller-74cddd4fb5-9nq7p\" (UID: \"3e104a8c-66dc-4a9a-836f-656e6f4cc923\") " pod="openshift-machine-config-operator/machine-config-controller-74cddd4fb5-9nq7p" Dec 04 00:47:13.243761 master-0 kubenswrapper[33142]: I1204 00:47:13.243703 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jms7r\" (UniqueName: \"kubernetes.io/projected/20835c26-301c-423e-b534-ec2a5e5af953-kube-api-access-jms7r\") pod \"multus-admission-controller-5bdcc987c4-s85ld\" (UID: \"20835c26-301c-423e-b534-ec2a5e5af953\") " pod="openshift-multus/multus-admission-controller-5bdcc987c4-s85ld" Dec 04 00:47:13.266559 master-0 kubenswrapper[33142]: I1204 00:47:13.266505 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68d85\" (UniqueName: \"kubernetes.io/projected/727020b5-1084-48ac-9aed-549e4eabbf81-kube-api-access-68d85\") pod \"machine-config-server-kl9fp\" (UID: \"727020b5-1084-48ac-9aed-549e4eabbf81\") " pod="openshift-machine-config-operator/machine-config-server-kl9fp" Dec 04 00:47:13.282826 master-0 kubenswrapper[33142]: I1204 00:47:13.282779 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctgw\" (UniqueName: \"kubernetes.io/projected/4adeb2c2-10ba-420a-be0b-fb2329ac3fe2-kube-api-access-nctgw\") pod \"node-exporter-pcpjf\" (UID: \"4adeb2c2-10ba-420a-be0b-fb2329ac3fe2\") " pod="openshift-monitoring/node-exporter-pcpjf" Dec 04 00:47:13.302030 master-0 kubenswrapper[33142]: I1204 00:47:13.301976 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rd8w\" (UniqueName: \"kubernetes.io/projected/df783888-6b82-48e8-aad0-ee77f7167115-kube-api-access-9rd8w\") pod \"ingress-canary-rn56p\" (UID: \"df783888-6b82-48e8-aad0-ee77f7167115\") " pod="openshift-ingress-canary/ingress-canary-rn56p" Dec 04 00:47:13.326795 master-0 kubenswrapper[33142]: I1204 00:47:13.326738 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsmd\" (UniqueName: \"kubernetes.io/projected/fb98438b-191c-4957-a9d1-8a64520f7f00-kube-api-access-qlsmd\") pod \"machine-config-daemon-dhr5k\" (UID: \"fb98438b-191c-4957-a9d1-8a64520f7f00\") " pod="openshift-machine-config-operator/machine-config-daemon-dhr5k" Dec 04 00:47:13.347269 master-0 kubenswrapper[33142]: I1204 00:47:13.347214 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"route-controller-manager-64497d959b-vghsb\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:13.367989 master-0 kubenswrapper[33142]: I1204 00:47:13.367899 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbks2\" (UniqueName: \"kubernetes.io/projected/1288d627-f7c2-47d5-aa02-2c86d5f82369-kube-api-access-xbks2\") pod \"openshift-state-metrics-57cbc648f8-tmqmn\" (UID: \"1288d627-f7c2-47d5-aa02-2c86d5f82369\") " pod="openshift-monitoring/openshift-state-metrics-57cbc648f8-tmqmn" Dec 04 00:47:13.385821 master-0 kubenswrapper[33142]: I1204 00:47:13.385779 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"controller-manager-6555cd6548-djfrg\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:13.402007 master-0 kubenswrapper[33142]: I1204 00:47:13.401909 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdw4\" (UniqueName: \"kubernetes.io/projected/8d4d3057-9f71-4b07-b463-51cc49d28bf3-kube-api-access-fvdw4\") pod \"prometheus-operator-565bdcb8-8dcsg\" (UID: \"8d4d3057-9f71-4b07-b463-51cc49d28bf3\") " pod="openshift-monitoring/prometheus-operator-565bdcb8-8dcsg" Dec 04 00:47:13.421282 master-0 kubenswrapper[33142]: E1204 00:47:13.421219 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:13.421282 master-0 kubenswrapper[33142]: E1204 00:47:13.421261 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:13.421529 master-0 kubenswrapper[33142]: E1204 00:47:13.421328 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:13.921309105 +0000 UTC m=+6.323310955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:13.461396 master-0 kubenswrapper[33142]: E1204 00:47:13.461299 33142 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="3.564s" Dec 04 00:47:13.461651 master-0 kubenswrapper[33142]: I1204 00:47:13.461466 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.461651 master-0 kubenswrapper[33142]: I1204 00:47:13.461497 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 00:47:13.461651 master-0 kubenswrapper[33142]: I1204 00:47:13.461512 33142 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="f1b21e83-7c96-4be2-8f13-9c8d1b622d36" Dec 04 00:47:13.470364 master-0 kubenswrapper[33142]: I1204 00:47:13.470297 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="" Dec 04 00:47:13.493660 master-0 kubenswrapper[33142]: I1204 00:47:13.493595 33142 kubelet_node_status.go:115] "Node was previously registered" node="master-0" Dec 04 00:47:13.493824 master-0 kubenswrapper[33142]: I1204 00:47:13.493736 33142 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 00:47:13.513498 master-0 kubenswrapper[33142]: I1204 00:47:13.513413 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.513734 master-0 kubenswrapper[33142]: I1204 00:47:13.513516 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:13.513734 master-0 kubenswrapper[33142]: I1204 00:47:13.513652 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:13.513734 master-0 kubenswrapper[33142]: I1204 00:47:13.513725 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:13.513999 master-0 kubenswrapper[33142]: I1204 00:47:13.513961 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:13.514081 master-0 kubenswrapper[33142]: I1204 00:47:13.514007 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 00:47:13.514081 master-0 kubenswrapper[33142]: I1204 00:47:13.514025 33142 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="f1b21e83-7c96-4be2-8f13-9c8d1b622d36" Dec 04 00:47:13.514386 master-0 kubenswrapper[33142]: I1204 00:47:13.514328 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:13.514471 master-0 kubenswrapper[33142]: I1204 00:47:13.514430 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.514528 master-0 kubenswrapper[33142]: I1204 00:47:13.514479 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.514528 master-0 kubenswrapper[33142]: I1204 00:47:13.514497 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:13.514528 master-0 kubenswrapper[33142]: I1204 00:47:13.514528 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.514679 master-0 kubenswrapper[33142]: I1204 00:47:13.514562 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:13.514679 master-0 kubenswrapper[33142]: I1204 00:47:13.514603 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:13.514679 master-0 kubenswrapper[33142]: I1204 00:47:13.514650 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68c95b6cf5-qgr6l" Dec 04 00:47:13.514817 master-0 kubenswrapper[33142]: I1204 00:47:13.514688 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:13.514817 master-0 kubenswrapper[33142]: I1204 00:47:13.514723 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cr7sj" Dec 04 00:47:13.514817 master-0 kubenswrapper[33142]: I1204 00:47:13.514741 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:13.515444 master-0 kubenswrapper[33142]: I1204 00:47:13.515389 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:13.521942 master-0 kubenswrapper[33142]: I1204 00:47:13.521861 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:13.781828 master-0 kubenswrapper[33142]: I1204 00:47:13.781723 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:13.825460 master-0 kubenswrapper[33142]: I1204 00:47:13.825402 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:13.830659 master-0 kubenswrapper[33142]: I1204 00:47:13.830588 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:13.872601 master-0 kubenswrapper[33142]: I1204 00:47:13.872510 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:13.967506 master-0 kubenswrapper[33142]: I1204 00:47:13.967415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:13.967721 master-0 kubenswrapper[33142]: E1204 00:47:13.967628 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:13.967721 master-0 kubenswrapper[33142]: E1204 00:47:13.967655 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:13.967829 master-0 kubenswrapper[33142]: E1204 00:47:13.967723 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:14.967702473 +0000 UTC m=+7.369704333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:14.062613 master-0 kubenswrapper[33142]: I1204 00:47:14.062451 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:14.260362 master-0 kubenswrapper[33142]: I1204 00:47:14.260288 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:47:14.263014 master-0 kubenswrapper[33142]: I1204 00:47:14.262495 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:14.268815 master-0 kubenswrapper[33142]: I1204 00:47:14.268279 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc" Dec 04 00:47:14.275272 master-0 kubenswrapper[33142]: I1204 00:47:14.275128 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:47:14.292812 master-0 kubenswrapper[33142]: I1204 00:47:14.292686 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:47:14.347674 master-0 kubenswrapper[33142]: I1204 00:47:14.347568 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:14.355405 master-0 kubenswrapper[33142]: I1204 00:47:14.355337 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:14.987299 master-0 kubenswrapper[33142]: I1204 00:47:14.987188 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:14.988293 master-0 kubenswrapper[33142]: E1204 00:47:14.987560 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:14.988293 master-0 kubenswrapper[33142]: E1204 00:47:14.987631 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:14.988293 master-0 kubenswrapper[33142]: E1204 00:47:14.987751 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:16.987717041 +0000 UTC m=+9.389718941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:15.179112 master-0 kubenswrapper[33142]: I1204 00:47:15.178992 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:15.184835 master-0 kubenswrapper[33142]: I1204 00:47:15.184733 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:47:15.282394 master-0 kubenswrapper[33142]: I1204 00:47:15.282232 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:47:15.610487 master-0 kubenswrapper[33142]: I1204 00:47:15.610382 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:15.614351 master-0 kubenswrapper[33142]: I1204 00:47:15.614301 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f97f57-x27s4" Dec 04 00:47:15.958687 master-0 kubenswrapper[33142]: I1204 00:47:15.958514 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=7.958489528 podStartE2EDuration="7.958489528s" podCreationTimestamp="2025-12-04 00:47:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:47:15.938083799 +0000 UTC m=+8.340085679" watchObservedRunningTime="2025-12-04 00:47:15.958489528 +0000 UTC m=+8.360491388" Dec 04 00:47:16.298756 master-0 kubenswrapper[33142]: I1204 00:47:16.298575 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podStartSLOduration=15.298549345 podStartE2EDuration="15.298549345s" podCreationTimestamp="2025-12-04 00:47:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:47:16.295972041 +0000 UTC m=+8.697973901" watchObservedRunningTime="2025-12-04 00:47:16.298549345 +0000 UTC m=+8.700551205" Dec 04 00:47:16.564638 master-0 kubenswrapper[33142]: I1204 00:47:16.564495 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:16.567540 master-0 kubenswrapper[33142]: I1204 00:47:16.567484 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-754cfd84-zjpxn" Dec 04 00:47:16.658814 master-0 kubenswrapper[33142]: I1204 00:47:16.658740 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:17.027905 master-0 kubenswrapper[33142]: I1204 00:47:17.027775 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:17.028377 master-0 kubenswrapper[33142]: E1204 00:47:17.028093 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:17.028377 master-0 kubenswrapper[33142]: E1204 00:47:17.028169 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:17.028377 master-0 kubenswrapper[33142]: E1204 00:47:17.028314 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:21.02828336 +0000 UTC m=+13.430285250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:17.304980 master-0 kubenswrapper[33142]: I1204 00:47:17.304771 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:17.309859 master-0 kubenswrapper[33142]: I1204 00:47:17.309533 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-75b4d49d4c-7s5z5" Dec 04 00:47:17.683447 master-0 kubenswrapper[33142]: I1204 00:47:17.683370 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:17.683970 master-0 kubenswrapper[33142]: I1204 00:47:17.683859 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-recovery-controller" containerID="cri-o://166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" gracePeriod=30 Dec 04 00:47:17.684074 master-0 kubenswrapper[33142]: I1204 00:47:17.683968 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" containerID="cri-o://ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" gracePeriod=30 Dec 04 00:47:17.684198 master-0 kubenswrapper[33142]: I1204 00:47:17.683955 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" containerID="cri-o://12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" gracePeriod=30 Dec 04 00:47:17.684355 master-0 kubenswrapper[33142]: I1204 00:47:17.684192 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" containerID="cri-o://c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" gracePeriod=30 Dec 04 00:47:17.686142 master-0 kubenswrapper[33142]: I1204 00:47:17.685765 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:17.686564 master-0 kubenswrapper[33142]: E1204 00:47:17.686511 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:47:17.686564 master-0 kubenswrapper[33142]: I1204 00:47:17.686554 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686590 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686604 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686634 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686647 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686669 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686684 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686706 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686719 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686740 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686754 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686771 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-recovery-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686784 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-recovery-controller" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686805 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" containerName="installer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686818 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" containerName="installer" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686836 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686850 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: E1204 00:47:17.686873 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.686885 master-0 kubenswrapper[33142]: I1204 00:47:17.686888 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.686908 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.686950 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.686975 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.686990 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.687009 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687024 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.687052 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687070 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.687094 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687111 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.687131 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687144 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: E1204 00:47:17.687162 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687175 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687377 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f099c1a6-5f9e-4d81-8656-dd8f003f0143" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687408 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="19deb5f6-135d-4a17-8eb8-7b996f4f2e9f" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687434 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687457 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b42d014-19a2-4c88-abd6-74b9191d6d16" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687495 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-recovery-controller" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687517 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="e19d444a-d0b0-4af1-b570-9520818c5301" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687544 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687564 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" containerName="collect-profiles" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687588 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="a37027d2-eeb1-416b-b67e-7ee233c42d04" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687612 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="af25c964-8d39-457a-9214-6cadfecf3943" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687632 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687661 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager-cert-syncer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687692 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c89c4eb9-3543-4fc1-bb2d-8395b5d573c4" containerName="assisted-installer-controller" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687715 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f80e5d69-5170-49df-b5e9-7991f63fd3dc" containerName="installer" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687750 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" containerName="collect-profiles" Dec 04 00:47:17.687851 master-0 kubenswrapper[33142]: I1204 00:47:17.687770 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="kube-controller-manager" Dec 04 00:47:17.689659 master-0 kubenswrapper[33142]: I1204 00:47:17.688404 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b999b2e31764aaaf13d451199f7b0e" containerName="cluster-policy-controller" Dec 04 00:47:17.696219 master-0 kubenswrapper[33142]: I1204 00:47:17.695707 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:17.738137 master-0 kubenswrapper[33142]: I1204 00:47:17.737960 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.738137 master-0 kubenswrapper[33142]: I1204 00:47:17.738100 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.839329 master-0 kubenswrapper[33142]: I1204 00:47:17.839269 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.839510 master-0 kubenswrapper[33142]: I1204 00:47:17.839390 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.839570 master-0 kubenswrapper[33142]: I1204 00:47:17.839480 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.839629 master-0 kubenswrapper[33142]: I1204 00:47:17.839495 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.906971 master-0 kubenswrapper[33142]: I1204 00:47:17.906753 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="61b999b2e31764aaaf13d451199f7b0e" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:47:17.959854 master-0 kubenswrapper[33142]: I1204 00:47:17.959710 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/1.log" Dec 04 00:47:17.960547 master-0 kubenswrapper[33142]: I1204 00:47:17.960512 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:47:17.962365 master-0 kubenswrapper[33142]: I1204 00:47:17.962328 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:47:17.963232 master-0 kubenswrapper[33142]: I1204 00:47:17.963197 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:47:17.963326 master-0 kubenswrapper[33142]: I1204 00:47:17.963304 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:17.966859 master-0 kubenswrapper[33142]: I1204 00:47:17.966824 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="61b999b2e31764aaaf13d451199f7b0e" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:47:18.042755 master-0 kubenswrapper[33142]: I1204 00:47:18.042687 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") pod \"61b999b2e31764aaaf13d451199f7b0e\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " Dec 04 00:47:18.043012 master-0 kubenswrapper[33142]: I1204 00:47:18.042866 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "61b999b2e31764aaaf13d451199f7b0e" (UID: "61b999b2e31764aaaf13d451199f7b0e"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:18.043070 master-0 kubenswrapper[33142]: I1204 00:47:18.043008 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") pod \"61b999b2e31764aaaf13d451199f7b0e\" (UID: \"61b999b2e31764aaaf13d451199f7b0e\") " Dec 04 00:47:18.043070 master-0 kubenswrapper[33142]: I1204 00:47:18.043053 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "61b999b2e31764aaaf13d451199f7b0e" (UID: "61b999b2e31764aaaf13d451199f7b0e"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:18.044168 master-0 kubenswrapper[33142]: I1204 00:47:18.043992 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:18.044247 master-0 kubenswrapper[33142]: I1204 00:47:18.044102 33142 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/61b999b2e31764aaaf13d451199f7b0e-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:18.060224 master-0 kubenswrapper[33142]: I1204 00:47:18.060158 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-87cd489bc-llsfr" Dec 04 00:47:18.075066 master-0 kubenswrapper[33142]: I1204 00:47:18.074991 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:18.082161 master-0 kubenswrapper[33142]: I1204 00:47:18.082105 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:47:18.083035 master-0 kubenswrapper[33142]: I1204 00:47:18.082958 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:18.088671 master-0 kubenswrapper[33142]: I1204 00:47:18.088620 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-7cf5cf757f-mmb2r" Dec 04 00:47:18.158728 master-0 kubenswrapper[33142]: I1204 00:47:18.157077 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:18.202869 master-0 kubenswrapper[33142]: I1204 00:47:18.202805 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:18.203074 master-0 kubenswrapper[33142]: I1204 00:47:18.202891 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:18.318771 master-0 kubenswrapper[33142]: I1204 00:47:18.318502 33142 generic.go:334] "Generic (PLEG): container finished" podID="b95b14d5-c3da-4aa7-9574-5cafff04192a" containerID="2cb11c1b461354eecb97801e0c4dd71a6f034656001e21b3f9f5eedfbcec7e60" exitCode=0 Dec 04 00:47:18.318771 master-0 kubenswrapper[33142]: I1204 00:47:18.318589 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"b95b14d5-c3da-4aa7-9574-5cafff04192a","Type":"ContainerDied","Data":"2cb11c1b461354eecb97801e0c4dd71a6f034656001e21b3f9f5eedfbcec7e60"} Dec 04 00:47:18.323730 master-0 kubenswrapper[33142]: I1204 00:47:18.323592 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/1.log" Dec 04 00:47:18.325060 master-0 kubenswrapper[33142]: I1204 00:47:18.324833 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/cluster-policy-controller/3.log" Dec 04 00:47:18.333901 master-0 kubenswrapper[33142]: I1204 00:47:18.333833 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager-cert-syncer/0.log" Dec 04 00:47:18.334976 master-0 kubenswrapper[33142]: I1204 00:47:18.334886 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_61b999b2e31764aaaf13d451199f7b0e/kube-controller-manager/0.log" Dec 04 00:47:18.335119 master-0 kubenswrapper[33142]: I1204 00:47:18.334981 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" exitCode=0 Dec 04 00:47:18.335119 master-0 kubenswrapper[33142]: I1204 00:47:18.335005 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" exitCode=2 Dec 04 00:47:18.335119 master-0 kubenswrapper[33142]: I1204 00:47:18.335019 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" exitCode=0 Dec 04 00:47:18.335119 master-0 kubenswrapper[33142]: I1204 00:47:18.335034 33142 generic.go:334] "Generic (PLEG): container finished" podID="61b999b2e31764aaaf13d451199f7b0e" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" exitCode=0 Dec 04 00:47:18.335119 master-0 kubenswrapper[33142]: I1204 00:47:18.335093 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:18.335626 master-0 kubenswrapper[33142]: I1204 00:47:18.335253 33142 scope.go:117] "RemoveContainer" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.362095 master-0 kubenswrapper[33142]: I1204 00:47:18.362037 33142 scope.go:117] "RemoveContainer" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.380876 master-0 kubenswrapper[33142]: I1204 00:47:18.380813 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="61b999b2e31764aaaf13d451199f7b0e" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:47:18.395087 master-0 kubenswrapper[33142]: I1204 00:47:18.395042 33142 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.412711 master-0 kubenswrapper[33142]: I1204 00:47:18.412680 33142 scope.go:117] "RemoveContainer" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.427869 master-0 kubenswrapper[33142]: I1204 00:47:18.427800 33142 scope.go:117] "RemoveContainer" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.445618 master-0 kubenswrapper[33142]: I1204 00:47:18.445571 33142 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.467100 master-0 kubenswrapper[33142]: I1204 00:47:18.467062 33142 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.506364 master-0 kubenswrapper[33142]: I1204 00:47:18.506326 33142 scope.go:117] "RemoveContainer" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.506843 master-0 kubenswrapper[33142]: E1204 00:47:18.506788 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": container with ID starting with 12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6 not found: ID does not exist" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.506978 master-0 kubenswrapper[33142]: I1204 00:47:18.506855 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} err="failed to get container status \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": rpc error: code = NotFound desc = could not find container \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": container with ID starting with 12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6 not found: ID does not exist" Dec 04 00:47:18.506978 master-0 kubenswrapper[33142]: I1204 00:47:18.506966 33142 scope.go:117] "RemoveContainer" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.507312 master-0 kubenswrapper[33142]: E1204 00:47:18.507284 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": container with ID starting with ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0 not found: ID does not exist" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.507360 master-0 kubenswrapper[33142]: I1204 00:47:18.507314 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} err="failed to get container status \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": rpc error: code = NotFound desc = could not find container \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": container with ID starting with ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0 not found: ID does not exist" Dec 04 00:47:18.507360 master-0 kubenswrapper[33142]: I1204 00:47:18.507332 33142 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.507628 master-0 kubenswrapper[33142]: E1204 00:47:18.507588 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": container with ID starting with 6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e not found: ID does not exist" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.507715 master-0 kubenswrapper[33142]: I1204 00:47:18.507644 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} err="failed to get container status \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": rpc error: code = NotFound desc = could not find container \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": container with ID starting with 6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e not found: ID does not exist" Dec 04 00:47:18.507772 master-0 kubenswrapper[33142]: I1204 00:47:18.507723 33142 scope.go:117] "RemoveContainer" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.508097 master-0 kubenswrapper[33142]: E1204 00:47:18.508066 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": container with ID starting with c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2 not found: ID does not exist" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.508160 master-0 kubenswrapper[33142]: I1204 00:47:18.508103 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} err="failed to get container status \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": rpc error: code = NotFound desc = could not find container \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": container with ID starting with c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2 not found: ID does not exist" Dec 04 00:47:18.508160 master-0 kubenswrapper[33142]: I1204 00:47:18.508123 33142 scope.go:117] "RemoveContainer" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.508429 master-0 kubenswrapper[33142]: E1204 00:47:18.508402 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": container with ID starting with 166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765 not found: ID does not exist" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.508491 master-0 kubenswrapper[33142]: I1204 00:47:18.508439 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} err="failed to get container status \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": rpc error: code = NotFound desc = could not find container \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": container with ID starting with 166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765 not found: ID does not exist" Dec 04 00:47:18.508491 master-0 kubenswrapper[33142]: I1204 00:47:18.508466 33142 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.508786 master-0 kubenswrapper[33142]: E1204 00:47:18.508760 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": container with ID starting with eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a not found: ID does not exist" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.508848 master-0 kubenswrapper[33142]: I1204 00:47:18.508787 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} err="failed to get container status \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": rpc error: code = NotFound desc = could not find container \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": container with ID starting with eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a not found: ID does not exist" Dec 04 00:47:18.508848 master-0 kubenswrapper[33142]: I1204 00:47:18.508803 33142 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.509101 master-0 kubenswrapper[33142]: E1204 00:47:18.509071 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": container with ID starting with ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d not found: ID does not exist" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.509153 master-0 kubenswrapper[33142]: I1204 00:47:18.509108 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} err="failed to get container status \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": rpc error: code = NotFound desc = could not find container \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": container with ID starting with ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d not found: ID does not exist" Dec 04 00:47:18.509153 master-0 kubenswrapper[33142]: I1204 00:47:18.509128 33142 scope.go:117] "RemoveContainer" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.509422 master-0 kubenswrapper[33142]: I1204 00:47:18.509390 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} err="failed to get container status \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": rpc error: code = NotFound desc = could not find container \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": container with ID starting with 12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6 not found: ID does not exist" Dec 04 00:47:18.509422 master-0 kubenswrapper[33142]: I1204 00:47:18.509418 33142 scope.go:117] "RemoveContainer" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.509774 master-0 kubenswrapper[33142]: I1204 00:47:18.509728 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} err="failed to get container status \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": rpc error: code = NotFound desc = could not find container \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": container with ID starting with ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0 not found: ID does not exist" Dec 04 00:47:18.509774 master-0 kubenswrapper[33142]: I1204 00:47:18.509766 33142 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.510184 master-0 kubenswrapper[33142]: I1204 00:47:18.510143 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} err="failed to get container status \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": rpc error: code = NotFound desc = could not find container \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": container with ID starting with 6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e not found: ID does not exist" Dec 04 00:47:18.510223 master-0 kubenswrapper[33142]: I1204 00:47:18.510180 33142 scope.go:117] "RemoveContainer" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.510504 master-0 kubenswrapper[33142]: I1204 00:47:18.510478 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} err="failed to get container status \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": rpc error: code = NotFound desc = could not find container \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": container with ID starting with c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2 not found: ID does not exist" Dec 04 00:47:18.510504 master-0 kubenswrapper[33142]: I1204 00:47:18.510501 33142 scope.go:117] "RemoveContainer" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.510839 master-0 kubenswrapper[33142]: I1204 00:47:18.510794 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} err="failed to get container status \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": rpc error: code = NotFound desc = could not find container \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": container with ID starting with 166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765 not found: ID does not exist" Dec 04 00:47:18.510839 master-0 kubenswrapper[33142]: I1204 00:47:18.510828 33142 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.511322 master-0 kubenswrapper[33142]: I1204 00:47:18.511296 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} err="failed to get container status \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": rpc error: code = NotFound desc = could not find container \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": container with ID starting with eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a not found: ID does not exist" Dec 04 00:47:18.511322 master-0 kubenswrapper[33142]: I1204 00:47:18.511320 33142 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.511586 master-0 kubenswrapper[33142]: I1204 00:47:18.511553 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} err="failed to get container status \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": rpc error: code = NotFound desc = could not find container \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": container with ID starting with ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d not found: ID does not exist" Dec 04 00:47:18.511651 master-0 kubenswrapper[33142]: I1204 00:47:18.511585 33142 scope.go:117] "RemoveContainer" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.511916 master-0 kubenswrapper[33142]: I1204 00:47:18.511887 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} err="failed to get container status \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": rpc error: code = NotFound desc = could not find container \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": container with ID starting with 12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6 not found: ID does not exist" Dec 04 00:47:18.512003 master-0 kubenswrapper[33142]: I1204 00:47:18.511914 33142 scope.go:117] "RemoveContainer" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.512335 master-0 kubenswrapper[33142]: I1204 00:47:18.512306 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} err="failed to get container status \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": rpc error: code = NotFound desc = could not find container \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": container with ID starting with ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0 not found: ID does not exist" Dec 04 00:47:18.512335 master-0 kubenswrapper[33142]: I1204 00:47:18.512329 33142 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.512737 master-0 kubenswrapper[33142]: I1204 00:47:18.512706 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} err="failed to get container status \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": rpc error: code = NotFound desc = could not find container \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": container with ID starting with 6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e not found: ID does not exist" Dec 04 00:47:18.512737 master-0 kubenswrapper[33142]: I1204 00:47:18.512731 33142 scope.go:117] "RemoveContainer" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.513157 master-0 kubenswrapper[33142]: I1204 00:47:18.513124 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} err="failed to get container status \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": rpc error: code = NotFound desc = could not find container \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": container with ID starting with c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2 not found: ID does not exist" Dec 04 00:47:18.513211 master-0 kubenswrapper[33142]: I1204 00:47:18.513156 33142 scope.go:117] "RemoveContainer" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.513455 master-0 kubenswrapper[33142]: I1204 00:47:18.513428 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} err="failed to get container status \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": rpc error: code = NotFound desc = could not find container \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": container with ID starting with 166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765 not found: ID does not exist" Dec 04 00:47:18.513455 master-0 kubenswrapper[33142]: I1204 00:47:18.513452 33142 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.513742 master-0 kubenswrapper[33142]: I1204 00:47:18.513715 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} err="failed to get container status \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": rpc error: code = NotFound desc = could not find container \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": container with ID starting with eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a not found: ID does not exist" Dec 04 00:47:18.513742 master-0 kubenswrapper[33142]: I1204 00:47:18.513738 33142 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.514068 master-0 kubenswrapper[33142]: I1204 00:47:18.514035 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} err="failed to get container status \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": rpc error: code = NotFound desc = could not find container \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": container with ID starting with ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d not found: ID does not exist" Dec 04 00:47:18.514117 master-0 kubenswrapper[33142]: I1204 00:47:18.514069 33142 scope.go:117] "RemoveContainer" containerID="12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6" Dec 04 00:47:18.514384 master-0 kubenswrapper[33142]: I1204 00:47:18.514362 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6"} err="failed to get container status \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": rpc error: code = NotFound desc = could not find container \"12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6\": container with ID starting with 12e41c072566c090add68e849ea8e4c11ec0080da8fa048a7b005ecee2f07ba6 not found: ID does not exist" Dec 04 00:47:18.514384 master-0 kubenswrapper[33142]: I1204 00:47:18.514381 33142 scope.go:117] "RemoveContainer" containerID="ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0" Dec 04 00:47:18.514639 master-0 kubenswrapper[33142]: I1204 00:47:18.514595 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0"} err="failed to get container status \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": rpc error: code = NotFound desc = could not find container \"ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0\": container with ID starting with ba71796bfbd4a66b0b4aaa802aa56afa287392480f00e3e0ad0847e7e3d644d0 not found: ID does not exist" Dec 04 00:47:18.514639 master-0 kubenswrapper[33142]: I1204 00:47:18.514633 33142 scope.go:117] "RemoveContainer" containerID="6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e" Dec 04 00:47:18.514938 master-0 kubenswrapper[33142]: I1204 00:47:18.514894 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e"} err="failed to get container status \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": rpc error: code = NotFound desc = could not find container \"6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e\": container with ID starting with 6fe77148e30b3983a2fcf364e5af2d931e6fa08b416f79d648cac2f71e2b499e not found: ID does not exist" Dec 04 00:47:18.515021 master-0 kubenswrapper[33142]: I1204 00:47:18.514919 33142 scope.go:117] "RemoveContainer" containerID="c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2" Dec 04 00:47:18.515269 master-0 kubenswrapper[33142]: I1204 00:47:18.515240 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2"} err="failed to get container status \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": rpc error: code = NotFound desc = could not find container \"c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2\": container with ID starting with c9b3b3c93e2dda0af683cd8d55f1bafdd0dbb8d7ec10e2c31a4f48e3b548b8b2 not found: ID does not exist" Dec 04 00:47:18.515269 master-0 kubenswrapper[33142]: I1204 00:47:18.515264 33142 scope.go:117] "RemoveContainer" containerID="166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765" Dec 04 00:47:18.515670 master-0 kubenswrapper[33142]: I1204 00:47:18.515639 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765"} err="failed to get container status \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": rpc error: code = NotFound desc = could not find container \"166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765\": container with ID starting with 166ff2661d908d2df7fbb5c391d4924c71a5532561b37eb4b364406bc6a0f765 not found: ID does not exist" Dec 04 00:47:18.515720 master-0 kubenswrapper[33142]: I1204 00:47:18.515668 33142 scope.go:117] "RemoveContainer" containerID="eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a" Dec 04 00:47:18.516058 master-0 kubenswrapper[33142]: I1204 00:47:18.516032 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a"} err="failed to get container status \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": rpc error: code = NotFound desc = could not find container \"eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a\": container with ID starting with eb78d1dbb02d0a35752d53073c6ed6c9948b0f3a49e30698d86bb4db6eef774a not found: ID does not exist" Dec 04 00:47:18.516058 master-0 kubenswrapper[33142]: I1204 00:47:18.516055 33142 scope.go:117] "RemoveContainer" containerID="ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d" Dec 04 00:47:18.516302 master-0 kubenswrapper[33142]: I1204 00:47:18.516273 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d"} err="failed to get container status \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": rpc error: code = NotFound desc = could not find container \"ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d\": container with ID starting with ff9dfd41eb2509dc1e1a8032f96c09d498248d411416009cf7ba91e8f3fad13d not found: ID does not exist" Dec 04 00:47:18.889819 master-0 kubenswrapper[33142]: I1204 00:47:18.889713 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:18.899466 master-0 kubenswrapper[33142]: I1204 00:47:18.899409 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-76bd5d69c7-8xfwz" Dec 04 00:47:18.905270 master-0 kubenswrapper[33142]: I1204 00:47:18.905199 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:18.982239 master-0 kubenswrapper[33142]: I1204 00:47:18.982175 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-cl29d" Dec 04 00:47:19.031659 master-0 kubenswrapper[33142]: I1204 00:47:19.031541 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 00:47:19.057964 master-0 kubenswrapper[33142]: I1204 00:47:19.056890 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 00:47:19.111700 master-0 kubenswrapper[33142]: I1204 00:47:19.111657 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:19.121958 master-0 kubenswrapper[33142]: I1204 00:47:19.121881 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:47:19.657686 master-0 kubenswrapper[33142]: I1204 00:47:19.657545 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:19.661364 master-0 kubenswrapper[33142]: I1204 00:47:19.661312 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-59f876d99-xlc5q" Dec 04 00:47:19.737248 master-0 kubenswrapper[33142]: I1204 00:47:19.736769 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:19.782908 master-0 kubenswrapper[33142]: I1204 00:47:19.782768 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") pod \"b95b14d5-c3da-4aa7-9574-5cafff04192a\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " Dec 04 00:47:19.782908 master-0 kubenswrapper[33142]: I1204 00:47:19.782895 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") pod \"b95b14d5-c3da-4aa7-9574-5cafff04192a\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " Dec 04 00:47:19.783262 master-0 kubenswrapper[33142]: I1204 00:47:19.782965 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") pod \"b95b14d5-c3da-4aa7-9574-5cafff04192a\" (UID: \"b95b14d5-c3da-4aa7-9574-5cafff04192a\") " Dec 04 00:47:19.783306 master-0 kubenswrapper[33142]: I1204 00:47:19.783270 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock" (OuterVolumeSpecName: "var-lock") pod "b95b14d5-c3da-4aa7-9574-5cafff04192a" (UID: "b95b14d5-c3da-4aa7-9574-5cafff04192a"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:19.783807 master-0 kubenswrapper[33142]: I1204 00:47:19.783776 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "b95b14d5-c3da-4aa7-9574-5cafff04192a" (UID: "b95b14d5-c3da-4aa7-9574-5cafff04192a"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:19.786621 master-0 kubenswrapper[33142]: I1204 00:47:19.786578 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "b95b14d5-c3da-4aa7-9574-5cafff04192a" (UID: "b95b14d5-c3da-4aa7-9574-5cafff04192a"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:47:19.884450 master-0 kubenswrapper[33142]: I1204 00:47:19.884359 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b95b14d5-c3da-4aa7-9574-5cafff04192a-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:19.884450 master-0 kubenswrapper[33142]: I1204 00:47:19.884423 33142 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:19.884450 master-0 kubenswrapper[33142]: I1204 00:47:19.884444 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b95b14d5-c3da-4aa7-9574-5cafff04192a-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:19.912767 master-0 kubenswrapper[33142]: I1204 00:47:19.912574 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b999b2e31764aaaf13d451199f7b0e" path="/var/lib/kubelet/pods/61b999b2e31764aaaf13d451199f7b0e/volumes" Dec 04 00:47:20.038410 master-0 kubenswrapper[33142]: I1204 00:47:20.038328 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:47:20.038747 master-0 kubenswrapper[33142]: I1204 00:47:20.038667 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="cbad610cd8689b0972c02840bb486a62" containerName="startup-monitor" containerID="cri-o://5d0a33c64da0b1dd5560e6a19900c4795c94210bc6ff9cbffed5612130d3fbf2" gracePeriod=5 Dec 04 00:47:20.055424 master-0 kubenswrapper[33142]: I1204 00:47:20.055362 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:20.103626 master-0 kubenswrapper[33142]: I1204 00:47:20.103547 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:20.224057 master-0 kubenswrapper[33142]: I1204 00:47:20.223685 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:47:20.227210 master-0 kubenswrapper[33142]: I1204 00:47:20.227186 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5f2j" Dec 04 00:47:20.351806 master-0 kubenswrapper[33142]: I1204 00:47:20.351733 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"b95b14d5-c3da-4aa7-9574-5cafff04192a","Type":"ContainerDied","Data":"bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd"} Dec 04 00:47:20.351806 master-0 kubenswrapper[33142]: I1204 00:47:20.351805 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb89af45791311a4bf8e6a567db6cba3f10c99e491f519f4235449d8cbbe85bd" Dec 04 00:47:20.353568 master-0 kubenswrapper[33142]: I1204 00:47:20.351830 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 00:47:21.101838 master-0 kubenswrapper[33142]: I1204 00:47:21.101754 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:21.102552 master-0 kubenswrapper[33142]: E1204 00:47:21.102001 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:21.102552 master-0 kubenswrapper[33142]: E1204 00:47:21.102026 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:21.102552 master-0 kubenswrapper[33142]: E1204 00:47:21.102074 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:29.102058188 +0000 UTC m=+21.504060048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:21.131625 master-0 kubenswrapper[33142]: I1204 00:47:21.131536 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:21.667443 master-0 kubenswrapper[33142]: I1204 00:47:21.667342 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:21.675526 master-0 kubenswrapper[33142]: I1204 00:47:21.675478 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-56f6ccc758-vsg29" Dec 04 00:47:21.811711 master-0 kubenswrapper[33142]: I1204 00:47:21.810822 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:21.836580 master-0 kubenswrapper[33142]: I1204 00:47:21.835887 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:21.847146 master-0 kubenswrapper[33142]: I1204 00:47:21.846340 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-dvxb6" Dec 04 00:47:21.878949 master-0 kubenswrapper[33142]: I1204 00:47:21.878874 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-zc792" Dec 04 00:47:22.055669 master-0 kubenswrapper[33142]: I1204 00:47:22.055480 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:22.055976 master-0 kubenswrapper[33142]: I1204 00:47:22.055838 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 00:47:22.081217 master-0 kubenswrapper[33142]: I1204 00:47:22.081158 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgflj" Dec 04 00:47:22.515327 master-0 kubenswrapper[33142]: I1204 00:47:22.514902 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:22.516778 master-0 kubenswrapper[33142]: I1204 00:47:22.516737 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-5f78c89466-mwkdg" Dec 04 00:47:24.107510 master-0 kubenswrapper[33142]: I1204 00:47:24.107435 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:24.168440 master-0 kubenswrapper[33142]: I1204 00:47:24.168370 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-m4q5k" Dec 04 00:47:24.531279 master-0 kubenswrapper[33142]: I1204 00:47:24.531090 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:25.392793 master-0 kubenswrapper[33142]: I1204 00:47:25.392755 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_cbad610cd8689b0972c02840bb486a62/startup-monitor/0.log" Dec 04 00:47:25.393373 master-0 kubenswrapper[33142]: I1204 00:47:25.393351 33142 generic.go:334] "Generic (PLEG): container finished" podID="cbad610cd8689b0972c02840bb486a62" containerID="5d0a33c64da0b1dd5560e6a19900c4795c94210bc6ff9cbffed5612130d3fbf2" exitCode=137 Dec 04 00:47:25.643226 master-0 kubenswrapper[33142]: I1204 00:47:25.643036 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_cbad610cd8689b0972c02840bb486a62/startup-monitor/0.log" Dec 04 00:47:25.643226 master-0 kubenswrapper[33142]: I1204 00:47:25.643176 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:25.774076 master-0 kubenswrapper[33142]: I1204 00:47:25.773967 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") pod \"cbad610cd8689b0972c02840bb486a62\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " Dec 04 00:47:25.774401 master-0 kubenswrapper[33142]: I1204 00:47:25.774095 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") pod \"cbad610cd8689b0972c02840bb486a62\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " Dec 04 00:47:25.774401 master-0 kubenswrapper[33142]: I1204 00:47:25.774179 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests" (OuterVolumeSpecName: "manifests") pod "cbad610cd8689b0972c02840bb486a62" (UID: "cbad610cd8689b0972c02840bb486a62"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:25.774401 master-0 kubenswrapper[33142]: I1204 00:47:25.774206 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") pod \"cbad610cd8689b0972c02840bb486a62\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " Dec 04 00:47:25.774621 master-0 kubenswrapper[33142]: I1204 00:47:25.774383 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "cbad610cd8689b0972c02840bb486a62" (UID: "cbad610cd8689b0972c02840bb486a62"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:25.774621 master-0 kubenswrapper[33142]: I1204 00:47:25.774469 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") pod \"cbad610cd8689b0972c02840bb486a62\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " Dec 04 00:47:25.774621 master-0 kubenswrapper[33142]: I1204 00:47:25.774527 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") pod \"cbad610cd8689b0972c02840bb486a62\" (UID: \"cbad610cd8689b0972c02840bb486a62\") " Dec 04 00:47:25.774621 master-0 kubenswrapper[33142]: I1204 00:47:25.774586 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock" (OuterVolumeSpecName: "var-lock") pod "cbad610cd8689b0972c02840bb486a62" (UID: "cbad610cd8689b0972c02840bb486a62"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:25.774891 master-0 kubenswrapper[33142]: I1204 00:47:25.774684 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log" (OuterVolumeSpecName: "var-log") pod "cbad610cd8689b0972c02840bb486a62" (UID: "cbad610cd8689b0972c02840bb486a62"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:25.775650 master-0 kubenswrapper[33142]: I1204 00:47:25.775337 33142 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:25.775650 master-0 kubenswrapper[33142]: I1204 00:47:25.775386 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:25.775650 master-0 kubenswrapper[33142]: I1204 00:47:25.775410 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:25.775650 master-0 kubenswrapper[33142]: I1204 00:47:25.775428 33142 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:25.781809 master-0 kubenswrapper[33142]: I1204 00:47:25.781715 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "cbad610cd8689b0972c02840bb486a62" (UID: "cbad610cd8689b0972c02840bb486a62"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:47:25.877055 master-0 kubenswrapper[33142]: I1204 00:47:25.876958 33142 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/cbad610cd8689b0972c02840bb486a62-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:47:25.911572 master-0 kubenswrapper[33142]: I1204 00:47:25.911387 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbad610cd8689b0972c02840bb486a62" path="/var/lib/kubelet/pods/cbad610cd8689b0972c02840bb486a62/volumes" Dec 04 00:47:25.911838 master-0 kubenswrapper[33142]: I1204 00:47:25.911805 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 00:47:25.926811 master-0 kubenswrapper[33142]: I1204 00:47:25.926739 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:47:25.926811 master-0 kubenswrapper[33142]: I1204 00:47:25.926784 33142 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="c592fa1c-4e43-42fb-90b5-475aa1b60546" Dec 04 00:47:25.930314 master-0 kubenswrapper[33142]: I1204 00:47:25.930244 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:47:25.930314 master-0 kubenswrapper[33142]: I1204 00:47:25.930304 33142 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="c592fa1c-4e43-42fb-90b5-475aa1b60546" Dec 04 00:47:26.402678 master-0 kubenswrapper[33142]: I1204 00:47:26.402600 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_cbad610cd8689b0972c02840bb486a62/startup-monitor/0.log" Dec 04 00:47:26.402678 master-0 kubenswrapper[33142]: I1204 00:47:26.402680 33142 scope.go:117] "RemoveContainer" containerID="5d0a33c64da0b1dd5560e6a19900c4795c94210bc6ff9cbffed5612130d3fbf2" Dec 04 00:47:26.403624 master-0 kubenswrapper[33142]: I1204 00:47:26.402758 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:47:28.898110 master-0 kubenswrapper[33142]: I1204 00:47:28.898024 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:28.925736 master-0 kubenswrapper[33142]: I1204 00:47:28.925576 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="f701c1d9-20b5-41f6-8864-02624409f941" Dec 04 00:47:28.925736 master-0 kubenswrapper[33142]: I1204 00:47:28.925731 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="f701c1d9-20b5-41f6-8864-02624409f941" Dec 04 00:47:28.943107 master-0 kubenswrapper[33142]: I1204 00:47:28.943012 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:28.943359 master-0 kubenswrapper[33142]: I1204 00:47:28.943333 33142 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:28.948503 master-0 kubenswrapper[33142]: I1204 00:47:28.948353 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:28.955317 master-0 kubenswrapper[33142]: I1204 00:47:28.955250 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:28.959677 master-0 kubenswrapper[33142]: I1204 00:47:28.959619 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:47:28.988395 master-0 kubenswrapper[33142]: W1204 00:47:28.988321 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295a01fb7c14d9ac3c44b1615db211d7.slice/crio-ae75a737e3caf50b2759d82edfe95dcc414e4dc4208eaaaf71006a15afec627a WatchSource:0}: Error finding container ae75a737e3caf50b2759d82edfe95dcc414e4dc4208eaaaf71006a15afec627a: Status 404 returned error can't find the container with id ae75a737e3caf50b2759d82edfe95dcc414e4dc4208eaaaf71006a15afec627a Dec 04 00:47:29.122863 master-0 kubenswrapper[33142]: I1204 00:47:29.122792 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:29.123124 master-0 kubenswrapper[33142]: E1204 00:47:29.122975 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:29.123124 master-0 kubenswrapper[33142]: E1204 00:47:29.122998 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:29.123124 master-0 kubenswrapper[33142]: E1204 00:47:29.123084 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:47:45.123033874 +0000 UTC m=+37.525035724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:29.441871 master-0 kubenswrapper[33142]: I1204 00:47:29.441693 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"f62d4295a6df3d75089f4e9cc4bdbc623b9908c05d1fb1666ea2d9e2e102a56e"} Dec 04 00:47:29.441871 master-0 kubenswrapper[33142]: I1204 00:47:29.441748 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"ae75a737e3caf50b2759d82edfe95dcc414e4dc4208eaaaf71006a15afec627a"} Dec 04 00:47:30.460717 master-0 kubenswrapper[33142]: I1204 00:47:30.460634 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"6c04a6465a60cad27aaeb9552551a4268a706b1b3d17d6ca722d3b5267fe28d7"} Dec 04 00:47:30.460717 master-0 kubenswrapper[33142]: I1204 00:47:30.460700 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"affb4b606d4a460d9fa96dc6ef006e5a40d7b5d8bfb995af1fe9f65b0b0f1b79"} Dec 04 00:47:30.460717 master-0 kubenswrapper[33142]: I1204 00:47:30.460712 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"434f681e919ca1d4a7e6d3cc6871129aaf80f11e7828dbb5c2fc533ee961dd5e"} Dec 04 00:47:30.481324 master-0 kubenswrapper[33142]: I1204 00:47:30.481240 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=2.481216104 podStartE2EDuration="2.481216104s" podCreationTimestamp="2025-12-04 00:47:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:47:30.480492833 +0000 UTC m=+22.882494683" watchObservedRunningTime="2025-12-04 00:47:30.481216104 +0000 UTC m=+22.883217954" Dec 04 00:47:38.210405 master-0 kubenswrapper[33142]: I1204 00:47:38.210316 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:38.217783 master-0 kubenswrapper[33142]: I1204 00:47:38.217687 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:47:38.956381 master-0 kubenswrapper[33142]: I1204 00:47:38.956264 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:38.956381 master-0 kubenswrapper[33142]: I1204 00:47:38.956334 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:38.956381 master-0 kubenswrapper[33142]: I1204 00:47:38.956355 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:38.956381 master-0 kubenswrapper[33142]: I1204 00:47:38.956374 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:38.957037 master-0 kubenswrapper[33142]: I1204 00:47:38.956742 33142 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:47:38.957037 master-0 kubenswrapper[33142]: I1204 00:47:38.956850 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:47:38.964173 master-0 kubenswrapper[33142]: I1204 00:47:38.964103 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:39.554362 master-0 kubenswrapper[33142]: I1204 00:47:39.554277 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:45.160208 master-0 kubenswrapper[33142]: I1204 00:47:45.160123 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:47:45.163320 master-0 kubenswrapper[33142]: E1204 00:47:45.161324 33142 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:45.163320 master-0 kubenswrapper[33142]: E1204 00:47:45.161461 33142 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:45.163320 master-0 kubenswrapper[33142]: E1204 00:47:45.161685 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access podName:a37027d2-eeb1-416b-b67e-7ee233c42d04 nodeName:}" failed. No retries permitted until 2025-12-04 00:48:17.161651758 +0000 UTC m=+69.563653648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access") pod "installer-3-master-0" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 00:47:48.957015 master-0 kubenswrapper[33142]: I1204 00:47:48.956883 33142 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:47:48.958064 master-0 kubenswrapper[33142]: I1204 00:47:48.957014 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:47:56.793755 master-0 kubenswrapper[33142]: I1204 00:47:56.793639 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: E1204 00:47:56.794041 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b95b14d5-c3da-4aa7-9574-5cafff04192a" containerName="installer" Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: I1204 00:47:56.794060 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95b14d5-c3da-4aa7-9574-5cafff04192a" containerName="installer" Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: E1204 00:47:56.794115 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cbad610cd8689b0972c02840bb486a62" containerName="startup-monitor" Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: I1204 00:47:56.794122 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbad610cd8689b0972c02840bb486a62" containerName="startup-monitor" Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: I1204 00:47:56.794265 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b95b14d5-c3da-4aa7-9574-5cafff04192a" containerName="installer" Dec 04 00:47:56.794367 master-0 kubenswrapper[33142]: I1204 00:47:56.794288 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="cbad610cd8689b0972c02840bb486a62" containerName="startup-monitor" Dec 04 00:47:56.794904 master-0 kubenswrapper[33142]: I1204 00:47:56.794874 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:56.797188 master-0 kubenswrapper[33142]: I1204 00:47:56.797157 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-8xh6q" Dec 04 00:47:56.797390 master-0 kubenswrapper[33142]: I1204 00:47:56.797313 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 00:47:56.805253 master-0 kubenswrapper[33142]: I1204 00:47:56.805191 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 00:47:56.931770 master-0 kubenswrapper[33142]: I1204 00:47:56.931727 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:56.932112 master-0 kubenswrapper[33142]: I1204 00:47:56.932089 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:56.932292 master-0 kubenswrapper[33142]: I1204 00:47:56.932248 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.033031 master-0 kubenswrapper[33142]: I1204 00:47:57.032978 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.033270 master-0 kubenswrapper[33142]: I1204 00:47:57.033064 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.033270 master-0 kubenswrapper[33142]: I1204 00:47:57.033124 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.033270 master-0 kubenswrapper[33142]: I1204 00:47:57.033126 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.033270 master-0 kubenswrapper[33142]: I1204 00:47:57.033182 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.052699 master-0 kubenswrapper[33142]: I1204 00:47:57.052590 33142 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 00:47:57.056447 master-0 kubenswrapper[33142]: I1204 00:47:57.056406 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access\") pod \"installer-4-master-0\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.123734 master-0 kubenswrapper[33142]: I1204 00:47:57.123652 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:47:57.621234 master-0 kubenswrapper[33142]: I1204 00:47:57.619464 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 00:47:57.730960 master-0 kubenswrapper[33142]: I1204 00:47:57.730833 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"6f06fa67-196e-4ec9-b0f8-6d6956f8158c","Type":"ContainerStarted","Data":"48cc63e92be2a1af5e45970baa7c0eef425b7fc60c7e271ea3c44ea60e89cf00"} Dec 04 00:47:58.742981 master-0 kubenswrapper[33142]: I1204 00:47:58.742819 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"6f06fa67-196e-4ec9-b0f8-6d6956f8158c","Type":"ContainerStarted","Data":"6c9523df3b185d5834a373e521b4e6c8dd7f2be6eb50d278f9cabff5520e99de"} Dec 04 00:47:58.769719 master-0 kubenswrapper[33142]: I1204 00:47:58.769603 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-4-master-0" podStartSLOduration=2.769579499 podStartE2EDuration="2.769579499s" podCreationTimestamp="2025-12-04 00:47:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:47:58.767024805 +0000 UTC m=+51.169026695" watchObservedRunningTime="2025-12-04 00:47:58.769579499 +0000 UTC m=+51.171581369" Dec 04 00:47:58.962318 master-0 kubenswrapper[33142]: I1204 00:47:58.962245 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:47:58.969905 master-0 kubenswrapper[33142]: I1204 00:47:58.969832 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:48:17.172973 master-0 kubenswrapper[33142]: I1204 00:48:17.172859 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:48:17.178467 master-0 kubenswrapper[33142]: I1204 00:48:17.178388 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"installer-3-master-0\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 00:48:17.375520 master-0 kubenswrapper[33142]: I1204 00:48:17.375416 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") pod \"a37027d2-eeb1-416b-b67e-7ee233c42d04\" (UID: \"a37027d2-eeb1-416b-b67e-7ee233c42d04\") " Dec 04 00:48:17.378370 master-0 kubenswrapper[33142]: I1204 00:48:17.378278 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "a37027d2-eeb1-416b-b67e-7ee233c42d04" (UID: "a37027d2-eeb1-416b-b67e-7ee233c42d04"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:48:17.477357 master-0 kubenswrapper[33142]: I1204 00:48:17.477171 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a37027d2-eeb1-416b-b67e-7ee233c42d04-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:35.880518 master-0 kubenswrapper[33142]: E1204 00:48:35.880444 33142 file.go:109] "Unable to process watch event" err="can't process config file \"/etc/kubernetes/manifests/kube-apiserver-startup-monitor-pod.yaml\": /etc/kubernetes/manifests/kube-apiserver-startup-monitor-pod.yaml: couldn't parse as pod(Object 'Kind' is missing in 'null'), please check config file" Dec 04 00:48:35.881976 master-0 kubenswrapper[33142]: I1204 00:48:35.881891 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:48:35.883036 master-0 kubenswrapper[33142]: I1204 00:48:35.882998 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:48:35.883177 master-0 kubenswrapper[33142]: I1204 00:48:35.883141 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.883394 master-0 kubenswrapper[33142]: I1204 00:48:35.883322 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver" containerID="cri-o://90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4" gracePeriod=15 Dec 04 00:48:35.883472 master-0 kubenswrapper[33142]: I1204 00:48:35.883406 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-check-endpoints" containerID="cri-o://5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb" gracePeriod=15 Dec 04 00:48:35.883545 master-0 kubenswrapper[33142]: I1204 00:48:35.883461 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1" gracePeriod=15 Dec 04 00:48:35.883596 master-0 kubenswrapper[33142]: I1204 00:48:35.883450 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c" gracePeriod=15 Dec 04 00:48:35.883774 master-0 kubenswrapper[33142]: I1204 00:48:35.883614 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-syncer" containerID="cri-o://831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e" gracePeriod=15 Dec 04 00:48:35.884959 master-0 kubenswrapper[33142]: I1204 00:48:35.884894 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:48:35.885364 master-0 kubenswrapper[33142]: E1204 00:48:35.885329 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-insecure-readyz" Dec 04 00:48:35.885364 master-0 kubenswrapper[33142]: I1204 00:48:35.885357 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-insecure-readyz" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: E1204 00:48:35.885377 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: I1204 00:48:35.885387 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: E1204 00:48:35.885405 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="setup" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: I1204 00:48:35.885414 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="setup" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: E1204 00:48:35.885426 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: I1204 00:48:35.885434 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: E1204 00:48:35.885450 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-check-endpoints" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: I1204 00:48:35.885458 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-check-endpoints" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: E1204 00:48:35.885478 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-syncer" Dec 04 00:48:35.885482 master-0 kubenswrapper[33142]: I1204 00:48:35.885487 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-syncer" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885639 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-insecure-readyz" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885671 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885685 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-check-endpoints" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885713 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-syncer" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885726 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="setup" Dec 04 00:48:35.885910 master-0 kubenswrapper[33142]: I1204 00:48:35.885741 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="382c2026eb84cf3d7672e1fe1646be64" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:48:35.949483 master-0 kubenswrapper[33142]: I1204 00:48:35.949433 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:48:35.961989 master-0 kubenswrapper[33142]: I1204 00:48:35.961944 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:35.962130 master-0 kubenswrapper[33142]: I1204 00:48:35.962025 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.962218 master-0 kubenswrapper[33142]: I1204 00:48:35.962133 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.962218 master-0 kubenswrapper[33142]: I1204 00:48:35.962160 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:35.962218 master-0 kubenswrapper[33142]: I1204 00:48:35.962184 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.962218 master-0 kubenswrapper[33142]: I1204 00:48:35.962209 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.962480 master-0 kubenswrapper[33142]: I1204 00:48:35.962439 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:35.962900 master-0 kubenswrapper[33142]: I1204 00:48:35.962526 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.023833 master-0 kubenswrapper[33142]: I1204 00:48:36.023792 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_382c2026eb84cf3d7672e1fe1646be64/kube-apiserver-cert-syncer/0.log" Dec 04 00:48:36.025010 master-0 kubenswrapper[33142]: I1204 00:48:36.024914 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb" exitCode=0 Dec 04 00:48:36.025010 master-0 kubenswrapper[33142]: I1204 00:48:36.024957 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c" exitCode=0 Dec 04 00:48:36.025010 master-0 kubenswrapper[33142]: I1204 00:48:36.024966 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1" exitCode=0 Dec 04 00:48:36.025010 master-0 kubenswrapper[33142]: I1204 00:48:36.024974 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e" exitCode=2 Dec 04 00:48:36.064368 master-0 kubenswrapper[33142]: I1204 00:48:36.064301 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.064368 master-0 kubenswrapper[33142]: I1204 00:48:36.064205 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.064682 master-0 kubenswrapper[33142]: I1204 00:48:36.064440 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.064682 master-0 kubenswrapper[33142]: I1204 00:48:36.064525 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.064682 master-0 kubenswrapper[33142]: I1204 00:48:36.064586 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.064682 master-0 kubenswrapper[33142]: I1204 00:48:36.064645 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.064970 master-0 kubenswrapper[33142]: I1204 00:48:36.064840 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.064970 master-0 kubenswrapper[33142]: I1204 00:48:36.064700 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.064970 master-0 kubenswrapper[33142]: I1204 00:48:36.064915 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.065170 master-0 kubenswrapper[33142]: I1204 00:48:36.065011 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.065170 master-0 kubenswrapper[33142]: I1204 00:48:36.064966 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.065170 master-0 kubenswrapper[33142]: I1204 00:48:36.065083 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:36.065170 master-0 kubenswrapper[33142]: I1204 00:48:36.065113 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.065170 master-0 kubenswrapper[33142]: I1204 00:48:36.065136 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.065473 master-0 kubenswrapper[33142]: I1204 00:48:36.065240 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.065473 master-0 kubenswrapper[33142]: I1204 00:48:36.065254 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.242843 master-0 kubenswrapper[33142]: I1204 00:48:36.242624 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:48:36.277549 master-0 kubenswrapper[33142]: W1204 00:48:36.277479 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98a8d85d3901d33f6fe192bdc7172aa.slice/crio-516d56bee942c4c1e1d50b8e234c2fad59b8d5ebe10b43fe70f55047c515ef51 WatchSource:0}: Error finding container 516d56bee942c4c1e1d50b8e234c2fad59b8d5ebe10b43fe70f55047c515ef51: Status 404 returned error can't find the container with id 516d56bee942c4c1e1d50b8e234c2fad59b8d5ebe10b43fe70f55047c515ef51 Dec 04 00:48:36.283354 master-0 kubenswrapper[33142]: E1204 00:48:36.283110 33142 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187ddcb90945f08d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:c98a8d85d3901d33f6fe192bdc7172aa,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:48:36.281741453 +0000 UTC m=+88.683743343,LastTimestamp:2025-12-04 00:48:36.281741453 +0000 UTC m=+88.683743343,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:48:37.040483 master-0 kubenswrapper[33142]: I1204 00:48:37.040381 33142 generic.go:334] "Generic (PLEG): container finished" podID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" containerID="6c9523df3b185d5834a373e521b4e6c8dd7f2be6eb50d278f9cabff5520e99de" exitCode=0 Dec 04 00:48:37.041333 master-0 kubenswrapper[33142]: I1204 00:48:37.040545 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"6f06fa67-196e-4ec9-b0f8-6d6956f8158c","Type":"ContainerDied","Data":"6c9523df3b185d5834a373e521b4e6c8dd7f2be6eb50d278f9cabff5520e99de"} Dec 04 00:48:37.042273 master-0 kubenswrapper[33142]: I1204 00:48:37.042189 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:37.043980 master-0 kubenswrapper[33142]: I1204 00:48:37.043847 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:37.044218 master-0 kubenswrapper[33142]: I1204 00:48:37.044154 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"c98a8d85d3901d33f6fe192bdc7172aa","Type":"ContainerStarted","Data":"999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5"} Dec 04 00:48:37.044375 master-0 kubenswrapper[33142]: I1204 00:48:37.044217 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"c98a8d85d3901d33f6fe192bdc7172aa","Type":"ContainerStarted","Data":"516d56bee942c4c1e1d50b8e234c2fad59b8d5ebe10b43fe70f55047c515ef51"} Dec 04 00:48:37.045642 master-0 kubenswrapper[33142]: I1204 00:48:37.045567 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:37.046711 master-0 kubenswrapper[33142]: I1204 00:48:37.046639 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:37.904863 master-0 kubenswrapper[33142]: I1204 00:48:37.904752 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:37.905865 master-0 kubenswrapper[33142]: I1204 00:48:37.905780 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.272647 master-0 kubenswrapper[33142]: I1204 00:48:38.272613 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_382c2026eb84cf3d7672e1fe1646be64/kube-apiserver-cert-syncer/0.log" Dec 04 00:48:38.273708 master-0 kubenswrapper[33142]: I1204 00:48:38.273680 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:38.274813 master-0 kubenswrapper[33142]: I1204 00:48:38.274749 33142 status_manager.go:851] "Failed to get status for pod" podUID="382c2026eb84cf3d7672e1fe1646be64" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.275525 master-0 kubenswrapper[33142]: I1204 00:48:38.275483 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.276867 master-0 kubenswrapper[33142]: I1204 00:48:38.276012 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.306473 master-0 kubenswrapper[33142]: I1204 00:48:38.306400 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") pod \"382c2026eb84cf3d7672e1fe1646be64\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " Dec 04 00:48:38.306473 master-0 kubenswrapper[33142]: I1204 00:48:38.306465 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") pod \"382c2026eb84cf3d7672e1fe1646be64\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " Dec 04 00:48:38.306747 master-0 kubenswrapper[33142]: I1204 00:48:38.306551 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") pod \"382c2026eb84cf3d7672e1fe1646be64\" (UID: \"382c2026eb84cf3d7672e1fe1646be64\") " Dec 04 00:48:38.306964 master-0 kubenswrapper[33142]: I1204 00:48:38.306869 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "382c2026eb84cf3d7672e1fe1646be64" (UID: "382c2026eb84cf3d7672e1fe1646be64"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:48:38.306964 master-0 kubenswrapper[33142]: I1204 00:48:38.306902 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "382c2026eb84cf3d7672e1fe1646be64" (UID: "382c2026eb84cf3d7672e1fe1646be64"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:48:38.307048 master-0 kubenswrapper[33142]: I1204 00:48:38.306962 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "382c2026eb84cf3d7672e1fe1646be64" (UID: "382c2026eb84cf3d7672e1fe1646be64"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:48:38.408373 master-0 kubenswrapper[33142]: I1204 00:48:38.408255 33142 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:38.408373 master-0 kubenswrapper[33142]: I1204 00:48:38.408341 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:38.408373 master-0 kubenswrapper[33142]: I1204 00:48:38.408362 33142 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/382c2026eb84cf3d7672e1fe1646be64-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:38.451775 master-0 kubenswrapper[33142]: I1204 00:48:38.451707 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:48:38.453136 master-0 kubenswrapper[33142]: I1204 00:48:38.453044 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.453986 master-0 kubenswrapper[33142]: I1204 00:48:38.453871 33142 status_manager.go:851] "Failed to get status for pod" podUID="382c2026eb84cf3d7672e1fe1646be64" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.454781 master-0 kubenswrapper[33142]: I1204 00:48:38.454703 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:38.508866 master-0 kubenswrapper[33142]: I1204 00:48:38.508797 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock\") pod \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " Dec 04 00:48:38.508866 master-0 kubenswrapper[33142]: I1204 00:48:38.508862 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir\") pod \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " Dec 04 00:48:38.509200 master-0 kubenswrapper[33142]: I1204 00:48:38.508872 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock" (OuterVolumeSpecName: "var-lock") pod "6f06fa67-196e-4ec9-b0f8-6d6956f8158c" (UID: "6f06fa67-196e-4ec9-b0f8-6d6956f8158c"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:48:38.509200 master-0 kubenswrapper[33142]: I1204 00:48:38.508896 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access\") pod \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\" (UID: \"6f06fa67-196e-4ec9-b0f8-6d6956f8158c\") " Dec 04 00:48:38.509200 master-0 kubenswrapper[33142]: I1204 00:48:38.509139 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "6f06fa67-196e-4ec9-b0f8-6d6956f8158c" (UID: "6f06fa67-196e-4ec9-b0f8-6d6956f8158c"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:48:38.509545 master-0 kubenswrapper[33142]: I1204 00:48:38.509490 33142 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:38.509545 master-0 kubenswrapper[33142]: I1204 00:48:38.509531 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:38.513558 master-0 kubenswrapper[33142]: I1204 00:48:38.513495 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "6f06fa67-196e-4ec9-b0f8-6d6956f8158c" (UID: "6f06fa67-196e-4ec9-b0f8-6d6956f8158c"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:48:38.611827 master-0 kubenswrapper[33142]: I1204 00:48:38.611704 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6f06fa67-196e-4ec9-b0f8-6d6956f8158c-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:48:39.110292 master-0 kubenswrapper[33142]: I1204 00:48:39.110180 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"6f06fa67-196e-4ec9-b0f8-6d6956f8158c","Type":"ContainerDied","Data":"48cc63e92be2a1af5e45970baa7c0eef425b7fc60c7e271ea3c44ea60e89cf00"} Dec 04 00:48:39.110292 master-0 kubenswrapper[33142]: I1204 00:48:39.110280 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48cc63e92be2a1af5e45970baa7c0eef425b7fc60c7e271ea3c44ea60e89cf00" Dec 04 00:48:39.110292 master-0 kubenswrapper[33142]: I1204 00:48:39.110229 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 00:48:39.115986 master-0 kubenswrapper[33142]: I1204 00:48:39.115876 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_382c2026eb84cf3d7672e1fe1646be64/kube-apiserver-cert-syncer/0.log" Dec 04 00:48:39.117469 master-0 kubenswrapper[33142]: I1204 00:48:39.117402 33142 generic.go:334] "Generic (PLEG): container finished" podID="382c2026eb84cf3d7672e1fe1646be64" containerID="90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4" exitCode=0 Dec 04 00:48:39.117582 master-0 kubenswrapper[33142]: I1204 00:48:39.117492 33142 scope.go:117] "RemoveContainer" containerID="5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb" Dec 04 00:48:39.117582 master-0 kubenswrapper[33142]: I1204 00:48:39.117535 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:39.151643 master-0 kubenswrapper[33142]: I1204 00:48:39.147432 33142 scope.go:117] "RemoveContainer" containerID="89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c" Dec 04 00:48:39.152859 master-0 kubenswrapper[33142]: I1204 00:48:39.152766 33142 status_manager.go:851] "Failed to get status for pod" podUID="382c2026eb84cf3d7672e1fe1646be64" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.153589 master-0 kubenswrapper[33142]: I1204 00:48:39.153502 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.154346 master-0 kubenswrapper[33142]: I1204 00:48:39.154280 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.155478 master-0 kubenswrapper[33142]: I1204 00:48:39.155357 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.156566 master-0 kubenswrapper[33142]: I1204 00:48:39.156475 33142 status_manager.go:851] "Failed to get status for pod" podUID="382c2026eb84cf3d7672e1fe1646be64" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.157611 master-0 kubenswrapper[33142]: I1204 00:48:39.157528 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:39.176227 master-0 kubenswrapper[33142]: I1204 00:48:39.176139 33142 scope.go:117] "RemoveContainer" containerID="98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1" Dec 04 00:48:39.199776 master-0 kubenswrapper[33142]: I1204 00:48:39.199698 33142 scope.go:117] "RemoveContainer" containerID="831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e" Dec 04 00:48:39.226847 master-0 kubenswrapper[33142]: I1204 00:48:39.226798 33142 scope.go:117] "RemoveContainer" containerID="90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4" Dec 04 00:48:39.252366 master-0 kubenswrapper[33142]: I1204 00:48:39.252320 33142 scope.go:117] "RemoveContainer" containerID="610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15" Dec 04 00:48:39.276325 master-0 kubenswrapper[33142]: I1204 00:48:39.276220 33142 scope.go:117] "RemoveContainer" containerID="5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb" Dec 04 00:48:39.276895 master-0 kubenswrapper[33142]: E1204 00:48:39.276797 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb\": container with ID starting with 5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb not found: ID does not exist" containerID="5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb" Dec 04 00:48:39.276895 master-0 kubenswrapper[33142]: I1204 00:48:39.276858 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb"} err="failed to get container status \"5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb\": rpc error: code = NotFound desc = could not find container \"5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb\": container with ID starting with 5cfae32d2e9bb0ac8f5bad7b7860030403389a32b64c29926231d7e8605a74eb not found: ID does not exist" Dec 04 00:48:39.277040 master-0 kubenswrapper[33142]: I1204 00:48:39.276899 33142 scope.go:117] "RemoveContainer" containerID="89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c" Dec 04 00:48:39.277423 master-0 kubenswrapper[33142]: E1204 00:48:39.277360 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c\": container with ID starting with 89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c not found: ID does not exist" containerID="89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c" Dec 04 00:48:39.277489 master-0 kubenswrapper[33142]: I1204 00:48:39.277446 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c"} err="failed to get container status \"89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c\": rpc error: code = NotFound desc = could not find container \"89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c\": container with ID starting with 89ff66833855b40699d95130116b943cf8c636ede3daac0283e66e69d898c98c not found: ID does not exist" Dec 04 00:48:39.277540 master-0 kubenswrapper[33142]: I1204 00:48:39.277487 33142 scope.go:117] "RemoveContainer" containerID="98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1" Dec 04 00:48:39.278285 master-0 kubenswrapper[33142]: E1204 00:48:39.278238 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1\": container with ID starting with 98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1 not found: ID does not exist" containerID="98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1" Dec 04 00:48:39.278353 master-0 kubenswrapper[33142]: I1204 00:48:39.278278 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1"} err="failed to get container status \"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1\": rpc error: code = NotFound desc = could not find container \"98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1\": container with ID starting with 98dc55287e766cbb2b229efb3a2df1b6fe5fc9d8519cfc59817a8f4db5ce42b1 not found: ID does not exist" Dec 04 00:48:39.278353 master-0 kubenswrapper[33142]: I1204 00:48:39.278301 33142 scope.go:117] "RemoveContainer" containerID="831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e" Dec 04 00:48:39.278646 master-0 kubenswrapper[33142]: E1204 00:48:39.278609 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e\": container with ID starting with 831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e not found: ID does not exist" containerID="831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e" Dec 04 00:48:39.278646 master-0 kubenswrapper[33142]: I1204 00:48:39.278637 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e"} err="failed to get container status \"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e\": rpc error: code = NotFound desc = could not find container \"831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e\": container with ID starting with 831a154f568bae279dae108f71903db192770dd847ad93164da8653b3300422e not found: ID does not exist" Dec 04 00:48:39.278736 master-0 kubenswrapper[33142]: I1204 00:48:39.278654 33142 scope.go:117] "RemoveContainer" containerID="90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4" Dec 04 00:48:39.279062 master-0 kubenswrapper[33142]: E1204 00:48:39.278999 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4\": container with ID starting with 90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4 not found: ID does not exist" containerID="90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4" Dec 04 00:48:39.279127 master-0 kubenswrapper[33142]: I1204 00:48:39.279067 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4"} err="failed to get container status \"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4\": rpc error: code = NotFound desc = could not find container \"90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4\": container with ID starting with 90cd4b90c238c102e2230fc863b8b4af9b4a28bbf12f9122c02f7d2d87aa8bf4 not found: ID does not exist" Dec 04 00:48:39.279127 master-0 kubenswrapper[33142]: I1204 00:48:39.279113 33142 scope.go:117] "RemoveContainer" containerID="610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15" Dec 04 00:48:39.279557 master-0 kubenswrapper[33142]: E1204 00:48:39.279506 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15\": container with ID starting with 610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15 not found: ID does not exist" containerID="610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15" Dec 04 00:48:39.279655 master-0 kubenswrapper[33142]: I1204 00:48:39.279554 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15"} err="failed to get container status \"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15\": rpc error: code = NotFound desc = could not find container \"610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15\": container with ID starting with 610223f93969f20fdb650dfa0b2e07753b61d56e37ba52fdc29f6a4901026e15 not found: ID does not exist" Dec 04 00:48:39.917997 master-0 kubenswrapper[33142]: I1204 00:48:39.917860 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382c2026eb84cf3d7672e1fe1646be64" path="/var/lib/kubelet/pods/382c2026eb84cf3d7672e1fe1646be64/volumes" Dec 04 00:48:41.822437 master-0 kubenswrapper[33142]: E1204 00:48:41.822247 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:41.823820 master-0 kubenswrapper[33142]: E1204 00:48:41.823516 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:41.825222 master-0 kubenswrapper[33142]: E1204 00:48:41.825139 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:41.826302 master-0 kubenswrapper[33142]: E1204 00:48:41.826204 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:41.827526 master-0 kubenswrapper[33142]: E1204 00:48:41.827429 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:41.827526 master-0 kubenswrapper[33142]: I1204 00:48:41.827511 33142 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 00:48:41.828723 master-0 kubenswrapper[33142]: E1204 00:48:41.828614 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 00:48:42.030890 master-0 kubenswrapper[33142]: E1204 00:48:42.030775 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 00:48:42.432895 master-0 kubenswrapper[33142]: E1204 00:48:42.432783 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 00:48:43.234341 master-0 kubenswrapper[33142]: E1204 00:48:43.234218 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 00:48:44.836351 master-0 kubenswrapper[33142]: E1204 00:48:44.836265 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 00:48:45.500810 master-0 kubenswrapper[33142]: E1204 00:48:45.500737 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:48:45Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:48:45Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:48:45Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:48:45Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":false},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:45.501473 master-0 kubenswrapper[33142]: E1204 00:48:45.501445 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:45.502092 master-0 kubenswrapper[33142]: E1204 00:48:45.502051 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:45.502691 master-0 kubenswrapper[33142]: E1204 00:48:45.502659 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:45.503214 master-0 kubenswrapper[33142]: E1204 00:48:45.503184 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:45.503214 master-0 kubenswrapper[33142]: E1204 00:48:45.503208 33142 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 00:48:45.894196 master-0 kubenswrapper[33142]: E1204 00:48:45.894030 33142 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187ddcb90945f08d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:c98a8d85d3901d33f6fe192bdc7172aa,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:48:36.281741453 +0000 UTC m=+88.683743343,LastTimestamp:2025-12-04 00:48:36.281741453 +0000 UTC m=+88.683743343,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 00:48:46.897799 master-0 kubenswrapper[33142]: I1204 00:48:46.897720 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:46.899038 master-0 kubenswrapper[33142]: I1204 00:48:46.898909 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:46.900080 master-0 kubenswrapper[33142]: I1204 00:48:46.899995 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:46.918365 master-0 kubenswrapper[33142]: I1204 00:48:46.918321 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:46.918365 master-0 kubenswrapper[33142]: I1204 00:48:46.918350 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:46.919179 master-0 kubenswrapper[33142]: E1204 00:48:46.919117 33142 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:46.919837 master-0 kubenswrapper[33142]: I1204 00:48:46.919788 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:46.948973 master-0 kubenswrapper[33142]: W1204 00:48:46.948868 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5aa2d6b41f5e21a89224256dc48af14.slice/crio-7d764080ad988605a32b4bb7b512b9ea2c2c9258a4cdc32cfb3940e06ac68496 WatchSource:0}: Error finding container 7d764080ad988605a32b4bb7b512b9ea2c2c9258a4cdc32cfb3940e06ac68496: Status 404 returned error can't find the container with id 7d764080ad988605a32b4bb7b512b9ea2c2c9258a4cdc32cfb3940e06ac68496 Dec 04 00:48:47.187649 master-0 kubenswrapper[33142]: I1204 00:48:47.187270 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"7d764080ad988605a32b4bb7b512b9ea2c2c9258a4cdc32cfb3940e06ac68496"} Dec 04 00:48:47.907478 master-0 kubenswrapper[33142]: I1204 00:48:47.907194 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:47.908265 master-0 kubenswrapper[33142]: I1204 00:48:47.907907 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:47.908665 master-0 kubenswrapper[33142]: I1204 00:48:47.908598 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:48.040709 master-0 kubenswrapper[33142]: E1204 00:48:48.040593 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 00:48:48.199643 master-0 kubenswrapper[33142]: I1204 00:48:48.199526 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134"} Dec 04 00:48:49.210966 master-0 kubenswrapper[33142]: I1204 00:48:49.210822 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134" exitCode=0 Dec 04 00:48:49.210966 master-0 kubenswrapper[33142]: I1204 00:48:49.210887 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerDied","Data":"98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134"} Dec 04 00:48:49.211846 master-0 kubenswrapper[33142]: I1204 00:48:49.211397 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:49.211846 master-0 kubenswrapper[33142]: I1204 00:48:49.211438 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:49.212533 master-0 kubenswrapper[33142]: I1204 00:48:49.212435 33142 status_manager.go:851] "Failed to get status for pod" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:49.212691 master-0 kubenswrapper[33142]: E1204 00:48:49.212559 33142 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:49.213323 master-0 kubenswrapper[33142]: I1204 00:48:49.213245 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:49.214846 master-0 kubenswrapper[33142]: I1204 00:48:49.214065 33142 status_manager.go:851] "Failed to get status for pod" podUID="c98a8d85d3901d33f6fe192bdc7172aa" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:48:50.219670 master-0 kubenswrapper[33142]: I1204 00:48:50.219624 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/0.log" Dec 04 00:48:50.220122 master-0 kubenswrapper[33142]: I1204 00:48:50.219683 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="f62d4295a6df3d75089f4e9cc4bdbc623b9908c05d1fb1666ea2d9e2e102a56e" exitCode=1 Dec 04 00:48:50.220122 master-0 kubenswrapper[33142]: I1204 00:48:50.219733 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerDied","Data":"f62d4295a6df3d75089f4e9cc4bdbc623b9908c05d1fb1666ea2d9e2e102a56e"} Dec 04 00:48:50.220336 master-0 kubenswrapper[33142]: I1204 00:48:50.220303 33142 scope.go:117] "RemoveContainer" containerID="f62d4295a6df3d75089f4e9cc4bdbc623b9908c05d1fb1666ea2d9e2e102a56e" Dec 04 00:48:50.222121 master-0 kubenswrapper[33142]: I1204 00:48:50.222097 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"4df2cb29b82229d73ae3a9909b0f61c318f04f7cf315695a73503bb1f3f366e4"} Dec 04 00:48:50.222166 master-0 kubenswrapper[33142]: I1204 00:48:50.222126 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"073116e8ee3ba017c62e6fb773e751e54ee82fd30580131f16aab80e80c914dc"} Dec 04 00:48:50.222166 master-0 kubenswrapper[33142]: I1204 00:48:50.222139 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"16ddf7a0f5fadc950f5280850f172d574c8621f3cdfd40608601f3ff4a72b647"} Dec 04 00:48:51.233070 master-0 kubenswrapper[33142]: I1204 00:48:51.233008 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/0.log" Dec 04 00:48:51.233902 master-0 kubenswrapper[33142]: I1204 00:48:51.233130 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32"} Dec 04 00:48:51.237601 master-0 kubenswrapper[33142]: I1204 00:48:51.237549 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"fb0a574850f5bf577a94e1f9c68432c425c21763f02b58dffd16f6d55bbcb7c4"} Dec 04 00:48:51.237822 master-0 kubenswrapper[33142]: I1204 00:48:51.237792 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"f5aa2d6b41f5e21a89224256dc48af14","Type":"ContainerStarted","Data":"d9e03a4b5ad6a117210534969ebf8562a889101df45cb5bd4a0436ae4789287d"} Dec 04 00:48:51.238050 master-0 kubenswrapper[33142]: I1204 00:48:51.238016 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:51.238269 master-0 kubenswrapper[33142]: I1204 00:48:51.238082 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:51.238424 master-0 kubenswrapper[33142]: I1204 00:48:51.238395 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:51.926990 master-0 kubenswrapper[33142]: I1204 00:48:51.924629 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:51.926990 master-0 kubenswrapper[33142]: I1204 00:48:51.924675 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: I1204 00:48:51.984523 33142 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]log ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]etcd ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-api-request-count-filter ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-startkubeinformers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-config-consumer ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-filter ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiextensions-informers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiextensions-controllers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/crd-informer-synced ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-system-namespaces-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-cluster-authentication-info-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-legacy-token-tracking-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-service-ip-repair-controllers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [-]poststarthook/rbac/bootstrap-roles failed: reason withheld Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-config-producer ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/bootstrap-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-aggregator-informers ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-status-local-available-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-status-remote-available-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-registration-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-wait-for-first-sync ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-discovery-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/kube-apiserver-autoregistration ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]autoregister-completion ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-openapi-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-openapiv3-controller ok Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: livez check failed Dec 04 00:48:51.987955 master-0 kubenswrapper[33142]: I1204 00:48:51.984609 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:48:56.284442 master-0 kubenswrapper[33142]: I1204 00:48:56.284249 33142 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:48:56.295273 master-0 kubenswrapper[33142]: I1204 00:48:56.295161 33142 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3dc72f42-f3b6-4593-be1b-87ec471a2b04\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-12-04T00:48:49Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-12-04T00:48:49Z\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2025-12-04T00:48:46Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver kube-apiserver-cert-syncer kube-apiserver-cert-regeneration-controller kube-apiserver-insecure-readyz kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-12-04T00:48:46Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver kube-apiserver-cert-syncer kube-apiserver-cert-regeneration-controller kube-apiserver-insecure-readyz kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}}}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2025-12-04T00:48:48Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2025-12-04T00:48:48Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]}],\\\"phase\\\":\\\"Pending\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-master-0\": pods \"kube-apiserver-master-0\" not found" Dec 04 00:48:56.534633 master-0 kubenswrapper[33142]: I1204 00:48:56.534471 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="f5aa2d6b41f5e21a89224256dc48af14" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:48:57.288959 master-0 kubenswrapper[33142]: I1204 00:48:57.288841 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:57.288959 master-0 kubenswrapper[33142]: I1204 00:48:57.288917 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="3dc72f42-f3b6-4593-be1b-87ec471a2b04" Dec 04 00:48:57.293455 master-0 kubenswrapper[33142]: I1204 00:48:57.293371 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="f5aa2d6b41f5e21a89224256dc48af14" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:48:58.956482 master-0 kubenswrapper[33142]: I1204 00:48:58.956390 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:48:58.957145 master-0 kubenswrapper[33142]: I1204 00:48:58.956784 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:48:58.958188 master-0 kubenswrapper[33142]: I1204 00:48:58.958137 33142 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:48:58.958280 master-0 kubenswrapper[33142]: I1204 00:48:58.958192 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:49:05.982312 master-0 kubenswrapper[33142]: I1204 00:49:05.982195 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 00:49:06.191222 master-0 kubenswrapper[33142]: I1204 00:49:06.191145 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 00:49:06.589337 master-0 kubenswrapper[33142]: I1204 00:49:06.589237 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 00:49:06.743969 master-0 kubenswrapper[33142]: I1204 00:49:06.743836 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 00:49:07.223533 master-0 kubenswrapper[33142]: I1204 00:49:07.223474 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 00:49:07.492086 master-0 kubenswrapper[33142]: I1204 00:49:07.491867 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 00:49:07.614324 master-0 kubenswrapper[33142]: I1204 00:49:07.614249 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 00:49:07.975351 master-0 kubenswrapper[33142]: I1204 00:49:07.975249 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 00:49:07.988685 master-0 kubenswrapper[33142]: I1204 00:49:07.988586 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 00:49:08.025841 master-0 kubenswrapper[33142]: I1204 00:49:08.025753 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 00:49:08.292298 master-0 kubenswrapper[33142]: I1204 00:49:08.292108 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 00:49:08.358150 master-0 kubenswrapper[33142]: I1204 00:49:08.358049 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 00:49:08.378442 master-0 kubenswrapper[33142]: I1204 00:49:08.378363 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 00:49:08.431974 master-0 kubenswrapper[33142]: I1204 00:49:08.431852 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 00:49:08.449734 master-0 kubenswrapper[33142]: I1204 00:49:08.449655 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 00:49:08.493271 master-0 kubenswrapper[33142]: I1204 00:49:08.493197 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 00:49:08.671829 master-0 kubenswrapper[33142]: I1204 00:49:08.671740 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 00:49:08.752967 master-0 kubenswrapper[33142]: I1204 00:49:08.752864 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 00:49:08.779954 master-0 kubenswrapper[33142]: I1204 00:49:08.779821 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 00:49:08.829694 master-0 kubenswrapper[33142]: I1204 00:49:08.829604 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-lmpqm" Dec 04 00:49:08.916489 master-0 kubenswrapper[33142]: I1204 00:49:08.916402 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-sk926" Dec 04 00:49:08.951734 master-0 kubenswrapper[33142]: I1204 00:49:08.951603 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-68bvv" Dec 04 00:49:08.956632 master-0 kubenswrapper[33142]: I1204 00:49:08.956544 33142 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:49:08.956757 master-0 kubenswrapper[33142]: I1204 00:49:08.956651 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:49:09.182338 master-0 kubenswrapper[33142]: I1204 00:49:09.182235 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 00:49:09.195925 master-0 kubenswrapper[33142]: I1204 00:49:09.195836 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 00:49:09.278151 master-0 kubenswrapper[33142]: I1204 00:49:09.277918 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 00:49:09.346804 master-0 kubenswrapper[33142]: I1204 00:49:09.346728 33142 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 00:49:09.347379 master-0 kubenswrapper[33142]: I1204 00:49:09.347096 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podStartSLOduration=34.347072534 podStartE2EDuration="34.347072534s" podCreationTimestamp="2025-12-04 00:48:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:48:56.510500229 +0000 UTC m=+108.912502089" watchObservedRunningTime="2025-12-04 00:49:09.347072534 +0000 UTC m=+121.749074454" Dec 04 00:49:09.355777 master-0 kubenswrapper[33142]: I1204 00:49:09.355735 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:49:09.355875 master-0 kubenswrapper[33142]: I1204 00:49:09.355808 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:49:09.363460 master-0 kubenswrapper[33142]: I1204 00:49:09.363365 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:49:09.390301 master-0 kubenswrapper[33142]: I1204 00:49:09.390187 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=13.390165228 podStartE2EDuration="13.390165228s" podCreationTimestamp="2025-12-04 00:48:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:49:09.388709176 +0000 UTC m=+121.790711066" watchObservedRunningTime="2025-12-04 00:49:09.390165228 +0000 UTC m=+121.792167088" Dec 04 00:49:09.416805 master-0 kubenswrapper[33142]: I1204 00:49:09.416706 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 00:49:09.421558 master-0 kubenswrapper[33142]: I1204 00:49:09.421473 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 00:49:09.512867 master-0 kubenswrapper[33142]: I1204 00:49:09.512785 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:49:09.564002 master-0 kubenswrapper[33142]: I1204 00:49:09.563784 33142 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 00:49:09.721906 master-0 kubenswrapper[33142]: I1204 00:49:09.721774 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-hkhgp" Dec 04 00:49:09.739430 master-0 kubenswrapper[33142]: I1204 00:49:09.739344 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 00:49:09.757849 master-0 kubenswrapper[33142]: I1204 00:49:09.757788 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 00:49:09.791751 master-0 kubenswrapper[33142]: I1204 00:49:09.791665 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 00:49:09.890314 master-0 kubenswrapper[33142]: I1204 00:49:09.890252 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 00:49:09.967370 master-0 kubenswrapper[33142]: I1204 00:49:09.967284 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 00:49:09.983258 master-0 kubenswrapper[33142]: I1204 00:49:09.983195 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 00:49:10.018352 master-0 kubenswrapper[33142]: I1204 00:49:10.018285 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 00:49:10.158628 master-0 kubenswrapper[33142]: I1204 00:49:10.158427 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 00:49:10.186052 master-0 kubenswrapper[33142]: I1204 00:49:10.185971 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 00:49:10.266966 master-0 kubenswrapper[33142]: I1204 00:49:10.266844 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:49:10.401460 master-0 kubenswrapper[33142]: I1204 00:49:10.401364 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 00:49:10.494995 master-0 kubenswrapper[33142]: I1204 00:49:10.494847 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 00:49:10.731087 master-0 kubenswrapper[33142]: I1204 00:49:10.730911 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-cmtsx" Dec 04 00:49:10.859829 master-0 kubenswrapper[33142]: I1204 00:49:10.859760 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 00:49:10.905353 master-0 kubenswrapper[33142]: I1204 00:49:10.905294 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-d7vtk" Dec 04 00:49:11.012771 master-0 kubenswrapper[33142]: I1204 00:49:11.012598 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 00:49:11.036891 master-0 kubenswrapper[33142]: I1204 00:49:11.036789 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-94kgq" Dec 04 00:49:11.050588 master-0 kubenswrapper[33142]: I1204 00:49:11.050534 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 00:49:11.153508 master-0 kubenswrapper[33142]: I1204 00:49:11.153390 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 00:49:11.226857 master-0 kubenswrapper[33142]: I1204 00:49:11.226762 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 00:49:11.242047 master-0 kubenswrapper[33142]: I1204 00:49:11.242008 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 00:49:11.440682 master-0 kubenswrapper[33142]: I1204 00:49:11.440596 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 00:49:11.572065 master-0 kubenswrapper[33142]: I1204 00:49:11.571982 33142 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 00:49:11.617377 master-0 kubenswrapper[33142]: I1204 00:49:11.617288 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 00:49:11.633311 master-0 kubenswrapper[33142]: I1204 00:49:11.633238 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"cluster-samples-operator-dockercfg-rmj52" Dec 04 00:49:11.681079 master-0 kubenswrapper[33142]: I1204 00:49:11.681007 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 00:49:11.877374 master-0 kubenswrapper[33142]: I1204 00:49:11.877278 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 00:49:11.926187 master-0 kubenswrapper[33142]: I1204 00:49:11.926098 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:49:11.931263 master-0 kubenswrapper[33142]: I1204 00:49:11.931207 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:49:11.971419 master-0 kubenswrapper[33142]: I1204 00:49:11.971353 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 00:49:11.991109 master-0 kubenswrapper[33142]: I1204 00:49:11.991033 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 00:49:12.002661 master-0 kubenswrapper[33142]: I1204 00:49:12.002586 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 00:49:12.014595 master-0 kubenswrapper[33142]: I1204 00:49:12.014535 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 00:49:12.060526 master-0 kubenswrapper[33142]: I1204 00:49:12.060468 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 00:49:12.079913 master-0 kubenswrapper[33142]: I1204 00:49:12.079856 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 00:49:12.106156 master-0 kubenswrapper[33142]: I1204 00:49:12.106093 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 00:49:12.210542 master-0 kubenswrapper[33142]: I1204 00:49:12.210300 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 00:49:12.229063 master-0 kubenswrapper[33142]: I1204 00:49:12.228963 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-gvp2m" Dec 04 00:49:12.275768 master-0 kubenswrapper[33142]: I1204 00:49:12.275254 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 00:49:12.294868 master-0 kubenswrapper[33142]: I1204 00:49:12.294789 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 00:49:12.331769 master-0 kubenswrapper[33142]: I1204 00:49:12.331694 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-wdzq5" Dec 04 00:49:12.528187 master-0 kubenswrapper[33142]: I1204 00:49:12.528029 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 00:49:12.551900 master-0 kubenswrapper[33142]: I1204 00:49:12.551868 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:49:12.615007 master-0 kubenswrapper[33142]: I1204 00:49:12.614898 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:49:12.630276 master-0 kubenswrapper[33142]: I1204 00:49:12.630197 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 00:49:12.681298 master-0 kubenswrapper[33142]: I1204 00:49:12.681227 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 00:49:12.681866 master-0 kubenswrapper[33142]: I1204 00:49:12.681819 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 00:49:12.720436 master-0 kubenswrapper[33142]: I1204 00:49:12.720325 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 00:49:12.753976 master-0 kubenswrapper[33142]: I1204 00:49:12.753899 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 00:49:12.774519 master-0 kubenswrapper[33142]: I1204 00:49:12.774428 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 00:49:12.840149 master-0 kubenswrapper[33142]: I1204 00:49:12.839983 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:49:12.932742 master-0 kubenswrapper[33142]: I1204 00:49:12.932668 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 00:49:13.014482 master-0 kubenswrapper[33142]: I1204 00:49:13.014393 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 00:49:13.103763 master-0 kubenswrapper[33142]: I1204 00:49:13.103700 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 00:49:13.134175 master-0 kubenswrapper[33142]: I1204 00:49:13.134092 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 00:49:13.138891 master-0 kubenswrapper[33142]: I1204 00:49:13.138858 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 00:49:13.151848 master-0 kubenswrapper[33142]: I1204 00:49:13.151794 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 00:49:13.173612 master-0 kubenswrapper[33142]: I1204 00:49:13.173560 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 00:49:13.209078 master-0 kubenswrapper[33142]: I1204 00:49:13.208990 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 00:49:13.262785 master-0 kubenswrapper[33142]: I1204 00:49:13.262690 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 00:49:13.369049 master-0 kubenswrapper[33142]: I1204 00:49:13.368794 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 00:49:13.420712 master-0 kubenswrapper[33142]: I1204 00:49:13.420593 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 00:49:13.461307 master-0 kubenswrapper[33142]: I1204 00:49:13.461204 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 00:49:13.548515 master-0 kubenswrapper[33142]: I1204 00:49:13.548402 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 00:49:13.711232 master-0 kubenswrapper[33142]: I1204 00:49:13.710737 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 00:49:13.763442 master-0 kubenswrapper[33142]: I1204 00:49:13.763362 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 00:49:13.793034 master-0 kubenswrapper[33142]: I1204 00:49:13.792910 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 00:49:13.826841 master-0 kubenswrapper[33142]: I1204 00:49:13.826736 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 00:49:13.838671 master-0 kubenswrapper[33142]: I1204 00:49:13.838566 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-x6jwn" Dec 04 00:49:13.868610 master-0 kubenswrapper[33142]: I1204 00:49:13.868500 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:49:13.895150 master-0 kubenswrapper[33142]: I1204 00:49:13.895069 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 00:49:13.914621 master-0 kubenswrapper[33142]: I1204 00:49:13.914555 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-dnxpd" Dec 04 00:49:13.918474 master-0 kubenswrapper[33142]: I1204 00:49:13.918402 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-grlj9" Dec 04 00:49:13.967805 master-0 kubenswrapper[33142]: I1204 00:49:13.967656 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 00:49:13.980057 master-0 kubenswrapper[33142]: I1204 00:49:13.979968 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-v4pfc" Dec 04 00:49:13.983022 master-0 kubenswrapper[33142]: I1204 00:49:13.982981 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 00:49:14.029735 master-0 kubenswrapper[33142]: I1204 00:49:14.029655 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 00:49:14.064517 master-0 kubenswrapper[33142]: I1204 00:49:14.064404 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 00:49:14.069073 master-0 kubenswrapper[33142]: I1204 00:49:14.068997 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 00:49:14.137814 master-0 kubenswrapper[33142]: I1204 00:49:14.137686 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:49:14.152108 master-0 kubenswrapper[33142]: I1204 00:49:14.151998 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 00:49:14.195142 master-0 kubenswrapper[33142]: I1204 00:49:14.195046 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 00:49:14.239640 master-0 kubenswrapper[33142]: I1204 00:49:14.239422 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 00:49:14.244124 master-0 kubenswrapper[33142]: I1204 00:49:14.244050 33142 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 00:49:14.447446 master-0 kubenswrapper[33142]: I1204 00:49:14.447360 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 00:49:14.486430 master-0 kubenswrapper[33142]: I1204 00:49:14.486332 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 00:49:14.518658 master-0 kubenswrapper[33142]: I1204 00:49:14.518484 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:49:14.767110 master-0 kubenswrapper[33142]: I1204 00:49:14.767013 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 00:49:14.774508 master-0 kubenswrapper[33142]: I1204 00:49:14.774369 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 00:49:14.912855 master-0 kubenswrapper[33142]: I1204 00:49:14.912764 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 00:49:15.036335 master-0 kubenswrapper[33142]: I1204 00:49:15.036143 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 00:49:15.113695 master-0 kubenswrapper[33142]: I1204 00:49:15.113585 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 00:49:15.117305 master-0 kubenswrapper[33142]: I1204 00:49:15.117226 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 00:49:15.347219 master-0 kubenswrapper[33142]: I1204 00:49:15.347148 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:49:15.458957 master-0 kubenswrapper[33142]: I1204 00:49:15.458863 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 00:49:15.484393 master-0 kubenswrapper[33142]: I1204 00:49:15.484308 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 00:49:15.494279 master-0 kubenswrapper[33142]: I1204 00:49:15.494232 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 00:49:15.544398 master-0 kubenswrapper[33142]: I1204 00:49:15.544327 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 00:49:15.682554 master-0 kubenswrapper[33142]: I1204 00:49:15.682388 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-b7gnv" Dec 04 00:49:15.716866 master-0 kubenswrapper[33142]: I1204 00:49:15.716751 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 00:49:15.723758 master-0 kubenswrapper[33142]: I1204 00:49:15.723696 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 00:49:15.730542 master-0 kubenswrapper[33142]: I1204 00:49:15.730494 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 00:49:15.828971 master-0 kubenswrapper[33142]: I1204 00:49:15.828843 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 00:49:15.948168 master-0 kubenswrapper[33142]: I1204 00:49:15.947955 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 00:49:15.968966 master-0 kubenswrapper[33142]: I1204 00:49:15.968841 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 00:49:16.137293 master-0 kubenswrapper[33142]: I1204 00:49:16.137209 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 00:49:16.149344 master-0 kubenswrapper[33142]: I1204 00:49:16.149260 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 00:49:16.153033 master-0 kubenswrapper[33142]: I1204 00:49:16.152991 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 00:49:16.287660 master-0 kubenswrapper[33142]: I1204 00:49:16.287424 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 00:49:16.335522 master-0 kubenswrapper[33142]: I1204 00:49:16.335395 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 00:49:16.359580 master-0 kubenswrapper[33142]: I1204 00:49:16.359504 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 00:49:16.397309 master-0 kubenswrapper[33142]: I1204 00:49:16.397243 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 00:49:16.492160 master-0 kubenswrapper[33142]: I1204 00:49:16.492100 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 00:49:16.520455 master-0 kubenswrapper[33142]: I1204 00:49:16.520393 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 00:49:16.737106 master-0 kubenswrapper[33142]: I1204 00:49:16.737049 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-p78gv" Dec 04 00:49:16.838438 master-0 kubenswrapper[33142]: I1204 00:49:16.838283 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 00:49:16.916089 master-0 kubenswrapper[33142]: I1204 00:49:16.915992 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 00:49:16.952857 master-0 kubenswrapper[33142]: I1204 00:49:16.952770 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 00:49:16.986632 master-0 kubenswrapper[33142]: I1204 00:49:16.986544 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 00:49:17.052804 master-0 kubenswrapper[33142]: I1204 00:49:17.052706 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 00:49:17.092879 master-0 kubenswrapper[33142]: I1204 00:49:17.092692 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 00:49:17.200096 master-0 kubenswrapper[33142]: I1204 00:49:17.200000 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 00:49:17.260040 master-0 kubenswrapper[33142]: I1204 00:49:17.259918 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:49:17.375669 master-0 kubenswrapper[33142]: I1204 00:49:17.375600 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 00:49:17.471170 master-0 kubenswrapper[33142]: I1204 00:49:17.470878 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 00:49:17.643073 master-0 kubenswrapper[33142]: I1204 00:49:17.642895 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:49:17.766530 master-0 kubenswrapper[33142]: I1204 00:49:17.766430 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 00:49:17.851303 master-0 kubenswrapper[33142]: I1204 00:49:17.851222 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 00:49:18.006410 master-0 kubenswrapper[33142]: I1204 00:49:18.006251 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 00:49:18.111648 master-0 kubenswrapper[33142]: I1204 00:49:18.111570 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 00:49:18.150032 master-0 kubenswrapper[33142]: I1204 00:49:18.149954 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 00:49:18.232732 master-0 kubenswrapper[33142]: I1204 00:49:18.232661 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 00:49:18.234055 master-0 kubenswrapper[33142]: I1204 00:49:18.234008 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 00:49:18.331306 master-0 kubenswrapper[33142]: I1204 00:49:18.331149 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 00:49:18.402830 master-0 kubenswrapper[33142]: I1204 00:49:18.402764 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-zg65n" Dec 04 00:49:18.425116 master-0 kubenswrapper[33142]: I1204 00:49:18.425046 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 00:49:18.506352 master-0 kubenswrapper[33142]: I1204 00:49:18.506260 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:49:18.530223 master-0 kubenswrapper[33142]: I1204 00:49:18.530144 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 00:49:18.545518 master-0 kubenswrapper[33142]: I1204 00:49:18.545464 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 00:49:18.597836 master-0 kubenswrapper[33142]: I1204 00:49:18.597674 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 00:49:18.607694 master-0 kubenswrapper[33142]: I1204 00:49:18.607625 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:49:18.608062 master-0 kubenswrapper[33142]: I1204 00:49:18.607972 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="c98a8d85d3901d33f6fe192bdc7172aa" containerName="startup-monitor" containerID="cri-o://999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5" gracePeriod=5 Dec 04 00:49:18.655050 master-0 kubenswrapper[33142]: I1204 00:49:18.654988 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 00:49:18.690286 master-0 kubenswrapper[33142]: I1204 00:49:18.690199 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 00:49:18.694910 master-0 kubenswrapper[33142]: I1204 00:49:18.694866 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 00:49:18.793329 master-0 kubenswrapper[33142]: I1204 00:49:18.793290 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 00:49:18.836039 master-0 kubenswrapper[33142]: I1204 00:49:18.835954 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 00:49:18.891239 master-0 kubenswrapper[33142]: I1204 00:49:18.891083 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-kfhzx" Dec 04 00:49:18.956425 master-0 kubenswrapper[33142]: I1204 00:49:18.956343 33142 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/kube-controller-manager namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" start-of-body= Dec 04 00:49:18.956746 master-0 kubenswrapper[33142]: I1204 00:49:18.956472 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": dial tcp 192.168.32.10:10257: connect: connection refused" Dec 04 00:49:18.956746 master-0 kubenswrapper[33142]: I1204 00:49:18.956559 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:49:18.957576 master-0 kubenswrapper[33142]: I1204 00:49:18.957488 33142 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="kube-controller-manager" containerStatusID={"Type":"cri-o","ID":"8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container kube-controller-manager failed startup probe, will be restarted" Dec 04 00:49:18.957718 master-0 kubenswrapper[33142]: I1204 00:49:18.957679 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" containerID="cri-o://8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32" gracePeriod=30 Dec 04 00:49:19.039269 master-0 kubenswrapper[33142]: I1204 00:49:19.039160 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:49:19.069259 master-0 kubenswrapper[33142]: I1204 00:49:19.069198 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 00:49:19.074674 master-0 kubenswrapper[33142]: I1204 00:49:19.074619 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 00:49:19.086570 master-0 kubenswrapper[33142]: I1204 00:49:19.086525 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 00:49:19.132572 master-0 kubenswrapper[33142]: I1204 00:49:19.132531 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 00:49:19.147825 master-0 kubenswrapper[33142]: I1204 00:49:19.147691 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 00:49:19.246233 master-0 kubenswrapper[33142]: I1204 00:49:19.246166 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 00:49:19.263392 master-0 kubenswrapper[33142]: I1204 00:49:19.263294 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 00:49:19.325583 master-0 kubenswrapper[33142]: I1204 00:49:19.325502 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-mfl95" Dec 04 00:49:19.672920 master-0 kubenswrapper[33142]: I1204 00:49:19.672824 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 00:49:19.727114 master-0 kubenswrapper[33142]: I1204 00:49:19.727042 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-f6xzw" Dec 04 00:49:19.727477 master-0 kubenswrapper[33142]: I1204 00:49:19.727268 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 00:49:19.739402 master-0 kubenswrapper[33142]: I1204 00:49:19.739349 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 00:49:19.746984 master-0 kubenswrapper[33142]: I1204 00:49:19.746876 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:49:19.938528 master-0 kubenswrapper[33142]: I1204 00:49:19.938305 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 00:49:19.940774 master-0 kubenswrapper[33142]: I1204 00:49:19.938871 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 00:49:20.057273 master-0 kubenswrapper[33142]: I1204 00:49:20.057196 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 00:49:20.059376 master-0 kubenswrapper[33142]: I1204 00:49:20.059331 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 00:49:20.167575 master-0 kubenswrapper[33142]: I1204 00:49:20.167510 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:49:20.219316 master-0 kubenswrapper[33142]: I1204 00:49:20.219144 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 00:49:20.239579 master-0 kubenswrapper[33142]: I1204 00:49:20.239505 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 00:49:20.258473 master-0 kubenswrapper[33142]: I1204 00:49:20.258410 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 00:49:20.294917 master-0 kubenswrapper[33142]: I1204 00:49:20.294841 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 00:49:20.318181 master-0 kubenswrapper[33142]: I1204 00:49:20.318111 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 00:49:20.379687 master-0 kubenswrapper[33142]: I1204 00:49:20.379626 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-7kmmpv795dabm" Dec 04 00:49:20.384741 master-0 kubenswrapper[33142]: I1204 00:49:20.384673 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 00:49:20.469203 master-0 kubenswrapper[33142]: I1204 00:49:20.469140 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 00:49:20.479806 master-0 kubenswrapper[33142]: I1204 00:49:20.479542 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 00:49:20.489773 master-0 kubenswrapper[33142]: I1204 00:49:20.489711 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:49:20.551819 master-0 kubenswrapper[33142]: I1204 00:49:20.551653 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 00:49:20.586913 master-0 kubenswrapper[33142]: I1204 00:49:20.586855 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-8qsb6" Dec 04 00:49:20.675398 master-0 kubenswrapper[33142]: I1204 00:49:20.675338 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 00:49:20.732882 master-0 kubenswrapper[33142]: I1204 00:49:20.732712 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 00:49:20.754131 master-0 kubenswrapper[33142]: I1204 00:49:20.754044 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:49:20.758501 master-0 kubenswrapper[33142]: I1204 00:49:20.758428 33142 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 00:49:20.797829 master-0 kubenswrapper[33142]: I1204 00:49:20.797761 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:49:20.799999 master-0 kubenswrapper[33142]: I1204 00:49:20.799944 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 00:49:20.819698 master-0 kubenswrapper[33142]: I1204 00:49:20.819636 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 00:49:20.857592 master-0 kubenswrapper[33142]: I1204 00:49:20.857542 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 00:49:20.905974 master-0 kubenswrapper[33142]: I1204 00:49:20.905893 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 00:49:20.940224 master-0 kubenswrapper[33142]: I1204 00:49:20.940144 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 00:49:20.946970 master-0 kubenswrapper[33142]: I1204 00:49:20.946946 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 00:49:21.211108 master-0 kubenswrapper[33142]: I1204 00:49:21.211020 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 00:49:21.283875 master-0 kubenswrapper[33142]: I1204 00:49:21.283789 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 00:49:21.312966 master-0 kubenswrapper[33142]: I1204 00:49:21.312843 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 00:49:21.364959 master-0 kubenswrapper[33142]: I1204 00:49:21.364865 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-dockercfg-pzz8t" Dec 04 00:49:21.376676 master-0 kubenswrapper[33142]: I1204 00:49:21.376625 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4xsx2" Dec 04 00:49:21.475753 master-0 kubenswrapper[33142]: I1204 00:49:21.475527 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 00:49:21.708863 master-0 kubenswrapper[33142]: I1204 00:49:21.708739 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 00:49:21.764654 master-0 kubenswrapper[33142]: I1204 00:49:21.764440 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-rjr9s" Dec 04 00:49:21.789317 master-0 kubenswrapper[33142]: I1204 00:49:21.789219 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:49:21.822881 master-0 kubenswrapper[33142]: I1204 00:49:21.822796 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 00:49:21.898022 master-0 kubenswrapper[33142]: I1204 00:49:21.897957 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 00:49:21.913996 master-0 kubenswrapper[33142]: I1204 00:49:21.913895 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 00:49:21.959872 master-0 kubenswrapper[33142]: I1204 00:49:21.959760 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 00:49:21.990062 master-0 kubenswrapper[33142]: I1204 00:49:21.989961 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 00:49:22.136338 master-0 kubenswrapper[33142]: I1204 00:49:22.136258 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-pvgwv" Dec 04 00:49:22.261379 master-0 kubenswrapper[33142]: I1204 00:49:22.261327 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 00:49:22.322584 master-0 kubenswrapper[33142]: I1204 00:49:22.322524 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 00:49:22.343408 master-0 kubenswrapper[33142]: I1204 00:49:22.343358 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:49:22.353385 master-0 kubenswrapper[33142]: I1204 00:49:22.353347 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 00:49:22.359883 master-0 kubenswrapper[33142]: I1204 00:49:22.359840 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 00:49:22.374853 master-0 kubenswrapper[33142]: I1204 00:49:22.374776 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 00:49:22.478035 master-0 kubenswrapper[33142]: I1204 00:49:22.477849 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 00:49:22.586069 master-0 kubenswrapper[33142]: I1204 00:49:22.585987 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-xscpn" Dec 04 00:49:22.708501 master-0 kubenswrapper[33142]: I1204 00:49:22.708417 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 00:49:22.962266 master-0 kubenswrapper[33142]: I1204 00:49:22.962193 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 00:49:23.153700 master-0 kubenswrapper[33142]: I1204 00:49:23.153590 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:49:23.235536 master-0 kubenswrapper[33142]: I1204 00:49:23.235343 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 00:49:23.253898 master-0 kubenswrapper[33142]: I1204 00:49:23.253813 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 00:49:23.372486 master-0 kubenswrapper[33142]: I1204 00:49:23.372382 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 00:49:23.696328 master-0 kubenswrapper[33142]: I1204 00:49:23.696236 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-dockercfg-868vg" Dec 04 00:49:23.735634 master-0 kubenswrapper[33142]: I1204 00:49:23.735592 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 00:49:24.047044 master-0 kubenswrapper[33142]: I1204 00:49:24.046807 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 00:49:24.208053 master-0 kubenswrapper[33142]: I1204 00:49:24.208008 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_c98a8d85d3901d33f6fe192bdc7172aa/startup-monitor/0.log" Dec 04 00:49:24.208283 master-0 kubenswrapper[33142]: I1204 00:49:24.208080 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:49:24.301087 master-0 kubenswrapper[33142]: I1204 00:49:24.300702 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log\") pod \"c98a8d85d3901d33f6fe192bdc7172aa\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " Dec 04 00:49:24.301087 master-0 kubenswrapper[33142]: I1204 00:49:24.300909 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests\") pod \"c98a8d85d3901d33f6fe192bdc7172aa\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " Dec 04 00:49:24.301087 master-0 kubenswrapper[33142]: I1204 00:49:24.301008 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir\") pod \"c98a8d85d3901d33f6fe192bdc7172aa\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301090 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir\") pod \"c98a8d85d3901d33f6fe192bdc7172aa\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301134 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log" (OuterVolumeSpecName: "var-log") pod "c98a8d85d3901d33f6fe192bdc7172aa" (UID: "c98a8d85d3901d33f6fe192bdc7172aa"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301142 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock\") pod \"c98a8d85d3901d33f6fe192bdc7172aa\" (UID: \"c98a8d85d3901d33f6fe192bdc7172aa\") " Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301204 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock" (OuterVolumeSpecName: "var-lock") pod "c98a8d85d3901d33f6fe192bdc7172aa" (UID: "c98a8d85d3901d33f6fe192bdc7172aa"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301272 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "c98a8d85d3901d33f6fe192bdc7172aa" (UID: "c98a8d85d3901d33f6fe192bdc7172aa"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:49:24.301427 master-0 kubenswrapper[33142]: I1204 00:49:24.301378 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests" (OuterVolumeSpecName: "manifests") pod "c98a8d85d3901d33f6fe192bdc7172aa" (UID: "c98a8d85d3901d33f6fe192bdc7172aa"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:49:24.301756 master-0 kubenswrapper[33142]: I1204 00:49:24.301671 33142 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 00:49:24.301756 master-0 kubenswrapper[33142]: I1204 00:49:24.301702 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:49:24.301756 master-0 kubenswrapper[33142]: I1204 00:49:24.301720 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:49:24.301756 master-0 kubenswrapper[33142]: I1204 00:49:24.301738 33142 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 00:49:24.304245 master-0 kubenswrapper[33142]: I1204 00:49:24.304168 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 00:49:24.309125 master-0 kubenswrapper[33142]: I1204 00:49:24.309073 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "c98a8d85d3901d33f6fe192bdc7172aa" (UID: "c98a8d85d3901d33f6fe192bdc7172aa"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:49:24.324852 master-0 kubenswrapper[33142]: I1204 00:49:24.324761 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:49:24.345874 master-0 kubenswrapper[33142]: I1204 00:49:24.345815 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 00:49:24.401309 master-0 kubenswrapper[33142]: I1204 00:49:24.401216 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 00:49:24.402960 master-0 kubenswrapper[33142]: I1204 00:49:24.402884 33142 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/c98a8d85d3901d33f6fe192bdc7172aa-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:49:24.481777 master-0 kubenswrapper[33142]: I1204 00:49:24.481712 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 00:49:24.559046 master-0 kubenswrapper[33142]: I1204 00:49:24.558705 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_c98a8d85d3901d33f6fe192bdc7172aa/startup-monitor/0.log" Dec 04 00:49:24.559046 master-0 kubenswrapper[33142]: I1204 00:49:24.558795 33142 generic.go:334] "Generic (PLEG): container finished" podID="c98a8d85d3901d33f6fe192bdc7172aa" containerID="999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5" exitCode=137 Dec 04 00:49:24.559046 master-0 kubenswrapper[33142]: I1204 00:49:24.558862 33142 scope.go:117] "RemoveContainer" containerID="999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5" Dec 04 00:49:24.559046 master-0 kubenswrapper[33142]: I1204 00:49:24.559017 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:49:24.585547 master-0 kubenswrapper[33142]: I1204 00:49:24.585504 33142 scope.go:117] "RemoveContainer" containerID="999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5" Dec 04 00:49:24.586306 master-0 kubenswrapper[33142]: E1204 00:49:24.586251 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5\": container with ID starting with 999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5 not found: ID does not exist" containerID="999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5" Dec 04 00:49:24.586387 master-0 kubenswrapper[33142]: I1204 00:49:24.586330 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5"} err="failed to get container status \"999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5\": rpc error: code = NotFound desc = could not find container \"999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5\": container with ID starting with 999260a6a75be9e9494348b24480d142f5a757c3441eeb635cb21116de2127b5 not found: ID does not exist" Dec 04 00:49:25.911592 master-0 kubenswrapper[33142]: I1204 00:49:25.911482 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98a8d85d3901d33f6fe192bdc7172aa" path="/var/lib/kubelet/pods/c98a8d85d3901d33f6fe192bdc7172aa/volumes" Dec 04 00:49:25.912482 master-0 kubenswrapper[33142]: I1204 00:49:25.912113 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 00:49:25.938300 master-0 kubenswrapper[33142]: I1204 00:49:25.938228 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:49:25.938300 master-0 kubenswrapper[33142]: I1204 00:49:25.938274 33142 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="f66edc20-3b95-41c6-b095-3f1c13d70149" Dec 04 00:49:25.947497 master-0 kubenswrapper[33142]: I1204 00:49:25.947391 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:49:25.947497 master-0 kubenswrapper[33142]: I1204 00:49:25.947472 33142 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="f66edc20-3b95-41c6-b095-3f1c13d70149" Dec 04 00:49:49.788626 master-0 kubenswrapper[33142]: I1204 00:49:49.788539 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/1.log" Dec 04 00:49:49.790601 master-0 kubenswrapper[33142]: I1204 00:49:49.790569 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/0.log" Dec 04 00:49:49.790683 master-0 kubenswrapper[33142]: I1204 00:49:49.790630 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32" exitCode=137 Dec 04 00:49:49.790735 master-0 kubenswrapper[33142]: I1204 00:49:49.790674 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerDied","Data":"8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32"} Dec 04 00:49:49.790735 master-0 kubenswrapper[33142]: I1204 00:49:49.790714 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1"} Dec 04 00:49:49.790816 master-0 kubenswrapper[33142]: I1204 00:49:49.790744 33142 scope.go:117] "RemoveContainer" containerID="f62d4295a6df3d75089f4e9cc4bdbc623b9908c05d1fb1666ea2d9e2e102a56e" Dec 04 00:49:50.802609 master-0 kubenswrapper[33142]: I1204 00:49:50.802519 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/1.log" Dec 04 00:49:58.955649 master-0 kubenswrapper[33142]: I1204 00:49:58.955546 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:49:58.955649 master-0 kubenswrapper[33142]: I1204 00:49:58.955659 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:49:58.962084 master-0 kubenswrapper[33142]: I1204 00:49:58.962019 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:49:59.892148 master-0 kubenswrapper[33142]: I1204 00:49:59.892052 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:50:14.385936 master-0 kubenswrapper[33142]: I1204 00:50:14.385846 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: E1204 00:50:14.386164 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" containerName="installer" Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: I1204 00:50:14.386181 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" containerName="installer" Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: E1204 00:50:14.386196 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c98a8d85d3901d33f6fe192bdc7172aa" containerName="startup-monitor" Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: I1204 00:50:14.386205 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98a8d85d3901d33f6fe192bdc7172aa" containerName="startup-monitor" Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: I1204 00:50:14.386399 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f06fa67-196e-4ec9-b0f8-6d6956f8158c" containerName="installer" Dec 04 00:50:14.386682 master-0 kubenswrapper[33142]: I1204 00:50:14.386419 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c98a8d85d3901d33f6fe192bdc7172aa" containerName="startup-monitor" Dec 04 00:50:14.386996 master-0 kubenswrapper[33142]: I1204 00:50:14.386943 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.389650 master-0 kubenswrapper[33142]: I1204 00:50:14.389603 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Dec 04 00:50:14.390013 master-0 kubenswrapper[33142]: I1204 00:50:14.389986 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Dec 04 00:50:14.390491 master-0 kubenswrapper[33142]: I1204 00:50:14.390432 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Dec 04 00:50:14.390902 master-0 kubenswrapper[33142]: I1204 00:50:14.390883 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Dec 04 00:50:14.391095 master-0 kubenswrapper[33142]: I1204 00:50:14.391082 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Dec 04 00:50:14.391237 master-0 kubenswrapper[33142]: I1204 00:50:14.391226 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Dec 04 00:50:14.391385 master-0 kubenswrapper[33142]: I1204 00:50:14.391373 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Dec 04 00:50:14.391528 master-0 kubenswrapper[33142]: I1204 00:50:14.391500 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Dec 04 00:50:14.391620 master-0 kubenswrapper[33142]: I1204 00:50:14.391608 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Dec 04 00:50:14.391732 master-0 kubenswrapper[33142]: I1204 00:50:14.391514 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-k98bs" Dec 04 00:50:14.391837 master-0 kubenswrapper[33142]: I1204 00:50:14.391422 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Dec 04 00:50:14.391997 master-0 kubenswrapper[33142]: I1204 00:50:14.391872 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Dec 04 00:50:14.400738 master-0 kubenswrapper[33142]: I1204 00:50:14.400606 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Dec 04 00:50:14.403449 master-0 kubenswrapper[33142]: I1204 00:50:14.403419 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Dec 04 00:50:14.407520 master-0 kubenswrapper[33142]: I1204 00:50:14.407491 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:50:14.545566 master-0 kubenswrapper[33142]: I1204 00:50:14.545448 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545566 master-0 kubenswrapper[33142]: I1204 00:50:14.545557 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545607 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545626 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ts4\" (UniqueName: \"kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545666 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545704 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545760 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545817 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.545863 master-0 kubenswrapper[33142]: I1204 00:50:14.545859 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.546170 master-0 kubenswrapper[33142]: I1204 00:50:14.545918 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.546170 master-0 kubenswrapper[33142]: I1204 00:50:14.545972 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.546170 master-0 kubenswrapper[33142]: I1204 00:50:14.546013 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.546170 master-0 kubenswrapper[33142]: I1204 00:50:14.546032 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.647836 master-0 kubenswrapper[33142]: I1204 00:50:14.647672 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648058 master-0 kubenswrapper[33142]: I1204 00:50:14.647832 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648058 master-0 kubenswrapper[33142]: I1204 00:50:14.647963 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648128 master-0 kubenswrapper[33142]: I1204 00:50:14.648071 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648187 master-0 kubenswrapper[33142]: I1204 00:50:14.648146 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648235 master-0 kubenswrapper[33142]: I1204 00:50:14.648214 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648316 master-0 kubenswrapper[33142]: I1204 00:50:14.648281 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648390 master-0 kubenswrapper[33142]: I1204 00:50:14.648354 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648467 master-0 kubenswrapper[33142]: I1204 00:50:14.648432 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648524 master-0 kubenswrapper[33142]: I1204 00:50:14.648488 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648569 master-0 kubenswrapper[33142]: I1204 00:50:14.648541 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59ts4\" (UniqueName: \"kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648647 master-0 kubenswrapper[33142]: I1204 00:50:14.648610 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.648749 master-0 kubenswrapper[33142]: I1204 00:50:14.648714 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.649840 master-0 kubenswrapper[33142]: I1204 00:50:14.649797 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.650067 master-0 kubenswrapper[33142]: E1204 00:50:14.650031 33142 secret.go:189] Couldn't get secret openshift-authentication/v4-0-config-system-session: secret "v4-0-config-system-session" not found Dec 04 00:50:14.650153 master-0 kubenswrapper[33142]: E1204 00:50:14.650116 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:15.150094849 +0000 UTC m=+187.552096689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "v4-0-config-system-session" (UniqueName: "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : secret "v4-0-config-system-session" not found Dec 04 00:50:14.650386 master-0 kubenswrapper[33142]: E1204 00:50:14.650354 33142 configmap.go:193] Couldn't get configMap openshift-authentication/v4-0-config-system-cliconfig: configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:14.650469 master-0 kubenswrapper[33142]: E1204 00:50:14.650399 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:15.150387107 +0000 UTC m=+187.552388957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "v4-0-config-system-cliconfig" (UniqueName: "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:14.651331 master-0 kubenswrapper[33142]: I1204 00:50:14.651283 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.651331 master-0 kubenswrapper[33142]: I1204 00:50:14.651315 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.651745 master-0 kubenswrapper[33142]: I1204 00:50:14.651719 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.651894 master-0 kubenswrapper[33142]: I1204 00:50:14.651843 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.653734 master-0 kubenswrapper[33142]: I1204 00:50:14.653674 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.654264 master-0 kubenswrapper[33142]: I1204 00:50:14.654224 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.659422 master-0 kubenswrapper[33142]: I1204 00:50:14.659357 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.659422 master-0 kubenswrapper[33142]: I1204 00:50:14.659421 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.659870 master-0 kubenswrapper[33142]: I1204 00:50:14.659729 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:14.679096 master-0 kubenswrapper[33142]: I1204 00:50:14.679039 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ts4\" (UniqueName: \"kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:15.158903 master-0 kubenswrapper[33142]: I1204 00:50:15.158797 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:15.159176 master-0 kubenswrapper[33142]: I1204 00:50:15.158961 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:15.159176 master-0 kubenswrapper[33142]: E1204 00:50:15.159092 33142 secret.go:189] Couldn't get secret openshift-authentication/v4-0-config-system-session: secret "v4-0-config-system-session" not found Dec 04 00:50:15.159243 master-0 kubenswrapper[33142]: E1204 00:50:15.159154 33142 configmap.go:193] Couldn't get configMap openshift-authentication/v4-0-config-system-cliconfig: configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:15.159243 master-0 kubenswrapper[33142]: E1204 00:50:15.159199 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:16.159176448 +0000 UTC m=+188.561178308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-session" (UniqueName: "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : secret "v4-0-config-system-session" not found Dec 04 00:50:15.159317 master-0 kubenswrapper[33142]: E1204 00:50:15.159251 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:16.159225279 +0000 UTC m=+188.561227129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-cliconfig" (UniqueName: "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:16.175397 master-0 kubenswrapper[33142]: I1204 00:50:16.175289 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:16.175397 master-0 kubenswrapper[33142]: I1204 00:50:16.175409 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:16.176422 master-0 kubenswrapper[33142]: E1204 00:50:16.175545 33142 secret.go:189] Couldn't get secret openshift-authentication/v4-0-config-system-session: secret "v4-0-config-system-session" not found Dec 04 00:50:16.176422 master-0 kubenswrapper[33142]: E1204 00:50:16.175596 33142 configmap.go:193] Couldn't get configMap openshift-authentication/v4-0-config-system-cliconfig: configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:16.176422 master-0 kubenswrapper[33142]: E1204 00:50:16.175658 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:18.175636085 +0000 UTC m=+190.577637935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-session" (UniqueName: "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : secret "v4-0-config-system-session" not found Dec 04 00:50:16.176422 master-0 kubenswrapper[33142]: E1204 00:50:16.175678 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:18.175671826 +0000 UTC m=+190.577673676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-cliconfig" (UniqueName: "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:18.208423 master-0 kubenswrapper[33142]: I1204 00:50:18.208346 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:18.209292 master-0 kubenswrapper[33142]: I1204 00:50:18.208504 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:18.209292 master-0 kubenswrapper[33142]: E1204 00:50:18.209221 33142 configmap.go:193] Couldn't get configMap openshift-authentication/v4-0-config-system-cliconfig: configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:18.209444 master-0 kubenswrapper[33142]: E1204 00:50:18.209375 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:22.209331194 +0000 UTC m=+194.611333084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-cliconfig" (UniqueName: "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:18.214722 master-0 kubenswrapper[33142]: I1204 00:50:18.214596 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:22.268161 master-0 kubenswrapper[33142]: I1204 00:50:22.268027 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:22.269220 master-0 kubenswrapper[33142]: E1204 00:50:22.268331 33142 configmap.go:193] Couldn't get configMap openshift-authentication/v4-0-config-system-cliconfig: configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:22.269220 master-0 kubenswrapper[33142]: E1204 00:50:22.268430 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig podName:23cc12f5-3da5-4272-a3df-cb0ab0a32718 nodeName:}" failed. No retries permitted until 2025-12-04 00:50:30.268400431 +0000 UTC m=+202.670402281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "v4-0-config-system-cliconfig" (UniqueName: "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig") pod "oauth-openshift-84bd77d659-plb85" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718") : configmap "v4-0-config-system-cliconfig" not found Dec 04 00:50:30.299276 master-0 kubenswrapper[33142]: I1204 00:50:30.299163 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:30.300095 master-0 kubenswrapper[33142]: I1204 00:50:30.300004 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"oauth-openshift-84bd77d659-plb85\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:30.345252 master-0 kubenswrapper[33142]: I1204 00:50:30.345176 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:30.799918 master-0 kubenswrapper[33142]: I1204 00:50:30.799753 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:50:30.806321 master-0 kubenswrapper[33142]: I1204 00:50:30.806266 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:50:31.159088 master-0 kubenswrapper[33142]: I1204 00:50:31.158908 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" event={"ID":"23cc12f5-3da5-4272-a3df-cb0ab0a32718","Type":"ContainerStarted","Data":"70f0a3a28d7dc860ee7089aa6586ea328119dd78a069f04303d87f25143b2a06"} Dec 04 00:50:33.175904 master-0 kubenswrapper[33142]: I1204 00:50:33.174973 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" event={"ID":"23cc12f5-3da5-4272-a3df-cb0ab0a32718","Type":"ContainerStarted","Data":"660313aa5b5561dfdacebf1438ea58923202dcd370e3475f11979dba87dbea21"} Dec 04 00:50:33.175904 master-0 kubenswrapper[33142]: I1204 00:50:33.175812 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:33.320023 master-0 kubenswrapper[33142]: I1204 00:50:33.319896 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:50:33.357605 master-0 kubenswrapper[33142]: I1204 00:50:33.357470 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" podStartSLOduration=17.508546708 podStartE2EDuration="19.357439602s" podCreationTimestamp="2025-12-04 00:50:14 +0000 UTC" firstStartedPulling="2025-12-04 00:50:30.806094651 +0000 UTC m=+203.208096531" lastFinishedPulling="2025-12-04 00:50:32.654987575 +0000 UTC m=+205.056989425" observedRunningTime="2025-12-04 00:50:33.210150018 +0000 UTC m=+205.612151878" watchObservedRunningTime="2025-12-04 00:50:33.357439602 +0000 UTC m=+205.759441442" Dec 04 00:50:41.352035 master-0 kubenswrapper[33142]: I1204 00:50:41.351968 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:50:55.745160 master-0 kubenswrapper[33142]: I1204 00:50:55.745078 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:50:55.748909 master-0 kubenswrapper[33142]: I1204 00:50:55.748852 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.755502 master-0 kubenswrapper[33142]: I1204 00:50:55.755443 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 00:50:55.756538 master-0 kubenswrapper[33142]: I1204 00:50:55.756252 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 00:50:55.758064 master-0 kubenswrapper[33142]: I1204 00:50:55.756755 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-wmf68" Dec 04 00:50:55.758064 master-0 kubenswrapper[33142]: I1204 00:50:55.756942 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 00:50:55.758064 master-0 kubenswrapper[33142]: I1204 00:50:55.757193 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 00:50:55.758064 master-0 kubenswrapper[33142]: I1204 00:50:55.757257 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 00:50:55.758424 master-0 kubenswrapper[33142]: I1204 00:50:55.758332 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 00:50:55.760319 master-0 kubenswrapper[33142]: I1204 00:50:55.758587 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 00:50:55.787432 master-0 kubenswrapper[33142]: I1204 00:50:55.787366 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 00:50:55.813964 master-0 kubenswrapper[33142]: I1204 00:50:55.813861 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:50:55.894311 master-0 kubenswrapper[33142]: I1204 00:50:55.893964 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894311 master-0 kubenswrapper[33142]: I1204 00:50:55.894041 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894311 master-0 kubenswrapper[33142]: I1204 00:50:55.894083 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894311 master-0 kubenswrapper[33142]: I1204 00:50:55.894109 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894378 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894692 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894786 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894839 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894857 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xrb\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.894972 master-0 kubenswrapper[33142]: I1204 00:50:55.894955 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.895502 master-0 kubenswrapper[33142]: I1204 00:50:55.895025 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996674 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996753 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996791 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996810 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996832 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996852 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.996873 master-0 kubenswrapper[33142]: I1204 00:50:55.996877 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.997722 master-0 kubenswrapper[33142]: I1204 00:50:55.996902 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.997722 master-0 kubenswrapper[33142]: I1204 00:50:55.996920 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.997722 master-0 kubenswrapper[33142]: I1204 00:50:55.996959 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25xrb\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.997722 master-0 kubenswrapper[33142]: I1204 00:50:55.996984 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.997722 master-0 kubenswrapper[33142]: I1204 00:50:55.997010 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.998094 master-0 kubenswrapper[33142]: I1204 00:50:55.998013 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.998466 master-0 kubenswrapper[33142]: I1204 00:50:55.998423 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:55.999182 master-0 kubenswrapper[33142]: I1204 00:50:55.999147 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.000863 master-0 kubenswrapper[33142]: I1204 00:50:56.000337 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.000863 master-0 kubenswrapper[33142]: I1204 00:50:56.000606 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.001808 master-0 kubenswrapper[33142]: I1204 00:50:56.001742 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.004329 master-0 kubenswrapper[33142]: I1204 00:50:56.002516 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.004329 master-0 kubenswrapper[33142]: I1204 00:50:56.003130 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.004329 master-0 kubenswrapper[33142]: I1204 00:50:56.003251 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.004329 master-0 kubenswrapper[33142]: I1204 00:50:56.003496 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.004329 master-0 kubenswrapper[33142]: I1204 00:50:56.004026 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.014703 master-0 kubenswrapper[33142]: I1204 00:50:56.014660 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xrb\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb\") pod \"alertmanager-main-0\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.088881 master-0 kubenswrapper[33142]: I1204 00:50:56.088797 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:50:56.571599 master-0 kubenswrapper[33142]: I1204 00:50:56.571526 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:50:56.746073 master-0 kubenswrapper[33142]: I1204 00:50:56.745997 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6db5f86c74-5rwks"] Dec 04 00:50:56.748601 master-0 kubenswrapper[33142]: I1204 00:50:56.748546 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.750247 master-0 kubenswrapper[33142]: I1204 00:50:56.750195 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-web" Dec 04 00:50:56.755689 master-0 kubenswrapper[33142]: I1204 00:50:56.755643 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-metrics" Dec 04 00:50:56.755914 master-0 kubenswrapper[33142]: I1204 00:50:56.755743 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-grpc-tls-1l53g1qbkrl8c" Dec 04 00:50:56.756068 master-0 kubenswrapper[33142]: I1204 00:50:56.755971 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-rules" Dec 04 00:50:56.756068 master-0 kubenswrapper[33142]: I1204 00:50:56.756065 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-dockercfg-87ldl" Dec 04 00:50:56.756297 master-0 kubenswrapper[33142]: I1204 00:50:56.756161 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy" Dec 04 00:50:56.757392 master-0 kubenswrapper[33142]: I1204 00:50:56.757353 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-tls" Dec 04 00:50:56.765997 master-0 kubenswrapper[33142]: I1204 00:50:56.765899 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6db5f86c74-5rwks"] Dec 04 00:50:56.813814 master-0 kubenswrapper[33142]: I1204 00:50:56.813673 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.813814 master-0 kubenswrapper[33142]: I1204 00:50:56.813725 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.813814 master-0 kubenswrapper[33142]: I1204 00:50:56.813759 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjqn\" (UniqueName: \"kubernetes.io/projected/697e7e4b-be49-48e2-9675-63b179187c48-kube-api-access-8xjqn\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.813814 master-0 kubenswrapper[33142]: I1204 00:50:56.813783 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697e7e4b-be49-48e2-9675-63b179187c48-metrics-client-ca\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.813814 master-0 kubenswrapper[33142]: I1204 00:50:56.813821 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.814238 master-0 kubenswrapper[33142]: I1204 00:50:56.813889 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.814238 master-0 kubenswrapper[33142]: I1204 00:50:56.813920 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-grpc-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.814238 master-0 kubenswrapper[33142]: I1204 00:50:56.813988 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.914922 master-0 kubenswrapper[33142]: I1204 00:50:56.914841 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.915182 master-0 kubenswrapper[33142]: I1204 00:50:56.914991 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-grpc-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.915958 master-0 kubenswrapper[33142]: I1204 00:50:56.915877 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.916205 master-0 kubenswrapper[33142]: I1204 00:50:56.916075 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.916261 master-0 kubenswrapper[33142]: I1204 00:50:56.916233 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.916334 master-0 kubenswrapper[33142]: I1204 00:50:56.916295 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjqn\" (UniqueName: \"kubernetes.io/projected/697e7e4b-be49-48e2-9675-63b179187c48-kube-api-access-8xjqn\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.916461 master-0 kubenswrapper[33142]: I1204 00:50:56.916421 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697e7e4b-be49-48e2-9675-63b179187c48-metrics-client-ca\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.917265 master-0 kubenswrapper[33142]: I1204 00:50:56.917187 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.917661 master-0 kubenswrapper[33142]: I1204 00:50:56.917626 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697e7e4b-be49-48e2-9675-63b179187c48-metrics-client-ca\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.919655 master-0 kubenswrapper[33142]: I1204 00:50:56.919618 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-grpc-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.919835 master-0 kubenswrapper[33142]: I1204 00:50:56.919803 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.919915 master-0 kubenswrapper[33142]: I1204 00:50:56.919862 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.925080 master-0 kubenswrapper[33142]: I1204 00:50:56.921484 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.925080 master-0 kubenswrapper[33142]: I1204 00:50:56.922137 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-tls\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.925080 master-0 kubenswrapper[33142]: I1204 00:50:56.923217 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/697e7e4b-be49-48e2-9675-63b179187c48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:56.939197 master-0 kubenswrapper[33142]: I1204 00:50:56.939152 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjqn\" (UniqueName: \"kubernetes.io/projected/697e7e4b-be49-48e2-9675-63b179187c48-kube-api-access-8xjqn\") pod \"thanos-querier-6db5f86c74-5rwks\" (UID: \"697e7e4b-be49-48e2-9675-63b179187c48\") " pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:57.072648 master-0 kubenswrapper[33142]: I1204 00:50:57.072400 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:50:57.395530 master-0 kubenswrapper[33142]: I1204 00:50:57.395457 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"c45530bfeb63f93bb7bff09eef12c73cae09b69646a6f52660aaad5653923556"} Dec 04 00:50:57.548668 master-0 kubenswrapper[33142]: I1204 00:50:57.548599 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6db5f86c74-5rwks"] Dec 04 00:50:57.559789 master-0 kubenswrapper[33142]: W1204 00:50:57.559739 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697e7e4b_be49_48e2_9675_63b179187c48.slice/crio-c3b720e5180371b097695ab7901f3f472ec522a8042f389d5e381dc65845a00d WatchSource:0}: Error finding container c3b720e5180371b097695ab7901f3f472ec522a8042f389d5e381dc65845a00d: Status 404 returned error can't find the container with id c3b720e5180371b097695ab7901f3f472ec522a8042f389d5e381dc65845a00d Dec 04 00:50:58.406577 master-0 kubenswrapper[33142]: I1204 00:50:58.406483 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="31016be5d0c7e35636c6bcaec97c32d23fdfd166ac7d3370bbc96793ab36802b" exitCode=0 Dec 04 00:50:58.407216 master-0 kubenswrapper[33142]: I1204 00:50:58.406570 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"31016be5d0c7e35636c6bcaec97c32d23fdfd166ac7d3370bbc96793ab36802b"} Dec 04 00:50:58.408644 master-0 kubenswrapper[33142]: I1204 00:50:58.408611 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"c3b720e5180371b097695ab7901f3f472ec522a8042f389d5e381dc65845a00d"} Dec 04 00:50:59.464428 master-0 kubenswrapper[33142]: I1204 00:50:59.464340 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dfc8cdd-mb55t"] Dec 04 00:50:59.469137 master-0 kubenswrapper[33142]: I1204 00:50:59.465287 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.469137 master-0 kubenswrapper[33142]: I1204 00:50:59.467182 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-1rpv9olfurpru" Dec 04 00:50:59.482442 master-0 kubenswrapper[33142]: I1204 00:50:59.482363 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:50:59.482662 master-0 kubenswrapper[33142]: I1204 00:50:59.482598 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" podUID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" containerName="metrics-server" containerID="cri-o://77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432" gracePeriod=170 Dec 04 00:50:59.534772 master-0 kubenswrapper[33142]: I1204 00:50:59.534694 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dfc8cdd-mb55t"] Dec 04 00:50:59.561815 master-0 kubenswrapper[33142]: I1204 00:50:59.561752 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f67fa153-3692-4544-9bbb-f26ad8094470-audit-log\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.561815 master-0 kubenswrapper[33142]: I1204 00:50:59.561820 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-metrics-server-audit-profiles\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.562093 master-0 kubenswrapper[33142]: I1204 00:50:59.561854 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2jh6\" (UniqueName: \"kubernetes.io/projected/f67fa153-3692-4544-9bbb-f26ad8094470-kube-api-access-v2jh6\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.562093 master-0 kubenswrapper[33142]: I1204 00:50:59.561872 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-server-tls\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.562093 master-0 kubenswrapper[33142]: I1204 00:50:59.561919 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-client-certs\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.562093 master-0 kubenswrapper[33142]: I1204 00:50:59.561971 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.562093 master-0 kubenswrapper[33142]: I1204 00:50:59.562006 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-client-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666348 master-0 kubenswrapper[33142]: I1204 00:50:59.666229 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v2jh6\" (UniqueName: \"kubernetes.io/projected/f67fa153-3692-4544-9bbb-f26ad8094470-kube-api-access-v2jh6\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666562 master-0 kubenswrapper[33142]: I1204 00:50:59.666355 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-server-tls\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666562 master-0 kubenswrapper[33142]: I1204 00:50:59.666405 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-client-certs\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666562 master-0 kubenswrapper[33142]: I1204 00:50:59.666441 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666562 master-0 kubenswrapper[33142]: I1204 00:50:59.666504 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-client-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666719 master-0 kubenswrapper[33142]: I1204 00:50:59.666574 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f67fa153-3692-4544-9bbb-f26ad8094470-audit-log\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.666719 master-0 kubenswrapper[33142]: I1204 00:50:59.666608 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-metrics-server-audit-profiles\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.667604 master-0 kubenswrapper[33142]: I1204 00:50:59.667547 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f67fa153-3692-4544-9bbb-f26ad8094470-audit-log\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.667907 master-0 kubenswrapper[33142]: I1204 00:50:59.667864 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.668541 master-0 kubenswrapper[33142]: I1204 00:50:59.668510 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f67fa153-3692-4544-9bbb-f26ad8094470-metrics-server-audit-profiles\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.670726 master-0 kubenswrapper[33142]: I1204 00:50:59.670679 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-client-certs\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.671046 master-0 kubenswrapper[33142]: I1204 00:50:59.670981 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-client-ca-bundle\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.673103 master-0 kubenswrapper[33142]: I1204 00:50:59.673059 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f67fa153-3692-4544-9bbb-f26ad8094470-secret-metrics-server-tls\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.686241 master-0 kubenswrapper[33142]: I1204 00:50:59.686185 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2jh6\" (UniqueName: \"kubernetes.io/projected/f67fa153-3692-4544-9bbb-f26ad8094470-kube-api-access-v2jh6\") pod \"metrics-server-dfc8cdd-mb55t\" (UID: \"f67fa153-3692-4544-9bbb-f26ad8094470\") " pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.720279 master-0 kubenswrapper[33142]: I1204 00:50:59.720132 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69695c56bc-5tscf"] Dec 04 00:50:59.721575 master-0 kubenswrapper[33142]: I1204 00:50:59.721542 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.723803 master-0 kubenswrapper[33142]: I1204 00:50:59.723777 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-kube-rbac-proxy-config" Dec 04 00:50:59.723904 master-0 kubenswrapper[33142]: I1204 00:50:59.723813 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-dockercfg-lcjtq" Dec 04 00:50:59.724155 master-0 kubenswrapper[33142]: I1204 00:50:59.724099 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client" Dec 04 00:50:59.724235 master-0 kubenswrapper[33142]: I1204 00:50:59.724191 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-tls" Dec 04 00:50:59.724308 master-0 kubenswrapper[33142]: I1204 00:50:59.724126 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-client-serving-certs-ca-bundle" Dec 04 00:50:59.726465 master-0 kubenswrapper[33142]: I1204 00:50:59.726278 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"federate-client-certs" Dec 04 00:50:59.734015 master-0 kubenswrapper[33142]: I1204 00:50:59.733956 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69695c56bc-5tscf"] Dec 04 00:50:59.734346 master-0 kubenswrapper[33142]: I1204 00:50:59.734303 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-trusted-ca-bundle-56c9b9fa8d9gs" Dec 04 00:50:59.767920 master-0 kubenswrapper[33142]: I1204 00:50:59.767867 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768110 master-0 kubenswrapper[33142]: I1204 00:50:59.767954 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-federate-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768110 master-0 kubenswrapper[33142]: I1204 00:50:59.768005 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvw7\" (UniqueName: \"kubernetes.io/projected/b4dc6d45-957e-479c-ade4-1a03ebeef927-kube-api-access-mhvw7\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768110 master-0 kubenswrapper[33142]: I1204 00:50:59.768069 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768110 master-0 kubenswrapper[33142]: I1204 00:50:59.768103 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768258 master-0 kubenswrapper[33142]: I1204 00:50:59.768125 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-metrics-client-ca\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768258 master-0 kubenswrapper[33142]: I1204 00:50:59.768155 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-serving-certs-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.768331 master-0 kubenswrapper[33142]: I1204 00:50:59.768277 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.790701 master-0 kubenswrapper[33142]: I1204 00:50:59.790651 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:50:59.868867 master-0 kubenswrapper[33142]: I1204 00:50:59.868798 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.868867 master-0 kubenswrapper[33142]: I1204 00:50:59.868849 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-metrics-client-ca\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.868867 master-0 kubenswrapper[33142]: I1204 00:50:59.868870 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-serving-certs-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.869218 master-0 kubenswrapper[33142]: I1204 00:50:59.868900 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.869218 master-0 kubenswrapper[33142]: I1204 00:50:59.868958 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.869218 master-0 kubenswrapper[33142]: I1204 00:50:59.868987 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-federate-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.869218 master-0 kubenswrapper[33142]: I1204 00:50:59.869030 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvw7\" (UniqueName: \"kubernetes.io/projected/b4dc6d45-957e-479c-ade4-1a03ebeef927-kube-api-access-mhvw7\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.869218 master-0 kubenswrapper[33142]: I1204 00:50:59.869062 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.870019 master-0 kubenswrapper[33142]: I1204 00:50:59.869798 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-serving-certs-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.870019 master-0 kubenswrapper[33142]: I1204 00:50:59.869885 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-metrics-client-ca\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.870291 master-0 kubenswrapper[33142]: I1204 00:50:59.870190 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.873045 master-0 kubenswrapper[33142]: I1204 00:50:59.873009 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.873831 master-0 kubenswrapper[33142]: I1204 00:50:59.873799 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-telemeter-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.875108 master-0 kubenswrapper[33142]: I1204 00:50:59.875070 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.875327 master-0 kubenswrapper[33142]: I1204 00:50:59.875263 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4dc6d45-957e-479c-ade4-1a03ebeef927-federate-client-tls\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:50:59.887037 master-0 kubenswrapper[33142]: I1204 00:50:59.887002 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvw7\" (UniqueName: \"kubernetes.io/projected/b4dc6d45-957e-479c-ade4-1a03ebeef927-kube-api-access-mhvw7\") pod \"telemeter-client-69695c56bc-5tscf\" (UID: \"b4dc6d45-957e-479c-ade4-1a03ebeef927\") " pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:51:00.063319 master-0 kubenswrapper[33142]: I1204 00:51:00.063189 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" Dec 04 00:51:01.042226 master-0 kubenswrapper[33142]: I1204 00:51:01.042172 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dfc8cdd-mb55t"] Dec 04 00:51:01.046024 master-0 kubenswrapper[33142]: W1204 00:51:01.045886 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67fa153_3692_4544_9bbb_f26ad8094470.slice/crio-22cd4a6d337f5e22b717bec040cd4c118a0f9dd2a57889c2bf34dce62cd132f0 WatchSource:0}: Error finding container 22cd4a6d337f5e22b717bec040cd4c118a0f9dd2a57889c2bf34dce62cd132f0: Status 404 returned error can't find the container with id 22cd4a6d337f5e22b717bec040cd4c118a0f9dd2a57889c2bf34dce62cd132f0 Dec 04 00:51:01.130989 master-0 kubenswrapper[33142]: I1204 00:51:01.130915 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:51:01.133262 master-0 kubenswrapper[33142]: I1204 00:51:01.133156 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.136961 master-0 kubenswrapper[33142]: I1204 00:51:01.136404 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 00:51:01.137498 master-0 kubenswrapper[33142]: I1204 00:51:01.137443 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 00:51:01.137734 master-0 kubenswrapper[33142]: I1204 00:51:01.137690 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 00:51:01.137870 master-0 kubenswrapper[33142]: I1204 00:51:01.137842 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 00:51:01.138120 master-0 kubenswrapper[33142]: I1204 00:51:01.138090 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 00:51:01.138205 master-0 kubenswrapper[33142]: I1204 00:51:01.138164 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-br9vs" Dec 04 00:51:01.138205 master-0 kubenswrapper[33142]: I1204 00:51:01.138177 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 00:51:01.138298 master-0 kubenswrapper[33142]: I1204 00:51:01.138242 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 00:51:01.138483 master-0 kubenswrapper[33142]: I1204 00:51:01.138454 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 00:51:01.138483 master-0 kubenswrapper[33142]: I1204 00:51:01.138479 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 00:51:01.144210 master-0 kubenswrapper[33142]: I1204 00:51:01.144140 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-33dcm3qc457cs" Dec 04 00:51:01.156814 master-0 kubenswrapper[33142]: I1204 00:51:01.155054 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 00:51:01.157812 master-0 kubenswrapper[33142]: I1204 00:51:01.157767 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 00:51:01.173448 master-0 kubenswrapper[33142]: I1204 00:51:01.173380 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:51:01.183386 master-0 kubenswrapper[33142]: I1204 00:51:01.183335 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69695c56bc-5tscf"] Dec 04 00:51:01.210979 master-0 kubenswrapper[33142]: I1204 00:51:01.210901 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211121 master-0 kubenswrapper[33142]: I1204 00:51:01.211056 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211121 master-0 kubenswrapper[33142]: I1204 00:51:01.211104 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211250 master-0 kubenswrapper[33142]: I1204 00:51:01.211142 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211250 master-0 kubenswrapper[33142]: I1204 00:51:01.211187 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211250 master-0 kubenswrapper[33142]: I1204 00:51:01.211219 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211250 master-0 kubenswrapper[33142]: I1204 00:51:01.211237 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211524 master-0 kubenswrapper[33142]: I1204 00:51:01.211478 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211524 master-0 kubenswrapper[33142]: I1204 00:51:01.211511 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211639 master-0 kubenswrapper[33142]: I1204 00:51:01.211555 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211639 master-0 kubenswrapper[33142]: I1204 00:51:01.211589 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211639 master-0 kubenswrapper[33142]: I1204 00:51:01.211609 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.211939 master-0 kubenswrapper[33142]: I1204 00:51:01.211850 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.212080 master-0 kubenswrapper[33142]: I1204 00:51:01.212044 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.212252 master-0 kubenswrapper[33142]: I1204 00:51:01.212223 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vx4b\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.212326 master-0 kubenswrapper[33142]: I1204 00:51:01.212256 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.212326 master-0 kubenswrapper[33142]: I1204 00:51:01.212299 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.212418 master-0 kubenswrapper[33142]: I1204 00:51:01.212345 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314449 master-0 kubenswrapper[33142]: I1204 00:51:01.314385 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314449 master-0 kubenswrapper[33142]: I1204 00:51:01.314443 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314472 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314494 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314523 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314541 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314566 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314593 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314619 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314649 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314678 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314701 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vx4b\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.314715 master-0 kubenswrapper[33142]: I1204 00:51:01.314719 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.315127 master-0 kubenswrapper[33142]: I1204 00:51:01.314748 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.315127 master-0 kubenswrapper[33142]: I1204 00:51:01.314777 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.315127 master-0 kubenswrapper[33142]: I1204 00:51:01.314805 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.315127 master-0 kubenswrapper[33142]: I1204 00:51:01.314824 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.315127 master-0 kubenswrapper[33142]: I1204 00:51:01.314843 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.317334 master-0 kubenswrapper[33142]: I1204 00:51:01.316957 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.318395 master-0 kubenswrapper[33142]: I1204 00:51:01.318357 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.319714 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.320124 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.320390 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.320655 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.321037 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.321778 master-0 kubenswrapper[33142]: I1204 00:51:01.321717 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.322348 master-0 kubenswrapper[33142]: I1204 00:51:01.322311 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.323014 master-0 kubenswrapper[33142]: I1204 00:51:01.322982 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.324326 master-0 kubenswrapper[33142]: I1204 00:51:01.324207 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.324326 master-0 kubenswrapper[33142]: I1204 00:51:01.324219 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.324326 master-0 kubenswrapper[33142]: I1204 00:51:01.324261 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.324326 master-0 kubenswrapper[33142]: I1204 00:51:01.324286 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.324721 master-0 kubenswrapper[33142]: I1204 00:51:01.324687 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.325210 master-0 kubenswrapper[33142]: I1204 00:51:01.325173 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.330254 master-0 kubenswrapper[33142]: I1204 00:51:01.330204 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.343995 master-0 kubenswrapper[33142]: I1204 00:51:01.343912 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vx4b\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b\") pod \"prometheus-k8s-0\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:01.443234 master-0 kubenswrapper[33142]: I1204 00:51:01.443158 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" event={"ID":"b4dc6d45-957e-479c-ade4-1a03ebeef927","Type":"ContainerStarted","Data":"936144d30d6da0f3f21fd1a242912dcc7ffd43c88b1457453d0dfc32313fd9c9"} Dec 04 00:51:01.445602 master-0 kubenswrapper[33142]: I1204 00:51:01.445533 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" event={"ID":"f67fa153-3692-4544-9bbb-f26ad8094470","Type":"ContainerStarted","Data":"4f267f9445fe74c0bf68084b7bc1cd1770daf23dcd8bd1f56618980f30047a96"} Dec 04 00:51:01.445672 master-0 kubenswrapper[33142]: I1204 00:51:01.445609 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" event={"ID":"f67fa153-3692-4544-9bbb-f26ad8094470","Type":"ContainerStarted","Data":"22cd4a6d337f5e22b717bec040cd4c118a0f9dd2a57889c2bf34dce62cd132f0"} Dec 04 00:51:01.449480 master-0 kubenswrapper[33142]: I1204 00:51:01.449439 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"d344059697c171c9543feb745b02c0f41edae6d0375ef4f31a2390465b4af52e"} Dec 04 00:51:01.449579 master-0 kubenswrapper[33142]: I1204 00:51:01.449488 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"1590a370115643af776ec49f6be908ea0a2961012c965f626da9d379be0ad735"} Dec 04 00:51:01.449579 master-0 kubenswrapper[33142]: I1204 00:51:01.449506 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"6047e59de6d3739ed7cfa067e16161b9acd9f90daab68f4dbaf275d5c83236e2"} Dec 04 00:51:01.449579 master-0 kubenswrapper[33142]: I1204 00:51:01.449522 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"ceac519cc78a0621f4e0f66fd933eef622f25925b900684fc9e3470b09d7fbfc"} Dec 04 00:51:01.452053 master-0 kubenswrapper[33142]: I1204 00:51:01.451972 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"2250ebc8860e2b1e152c91eb6bec7fcd013722cb01fd3fc630bb554b7a1f84de"} Dec 04 00:51:01.452053 master-0 kubenswrapper[33142]: I1204 00:51:01.452041 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"400f34118cbb54d2f02da15a393f20df74a0f6755c09e403ca40bd7aedfa3362"} Dec 04 00:51:01.452053 master-0 kubenswrapper[33142]: I1204 00:51:01.452061 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"181483e3a5ffef0ca41e0f53d90f845c80f378400dae60ce33cf94b1fde0b37f"} Dec 04 00:51:01.468457 master-0 kubenswrapper[33142]: I1204 00:51:01.468367 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" podStartSLOduration=2.4683379739999998 podStartE2EDuration="2.468337974s" podCreationTimestamp="2025-12-04 00:50:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:51:01.463385734 +0000 UTC m=+233.865387594" watchObservedRunningTime="2025-12-04 00:51:01.468337974 +0000 UTC m=+233.870339824" Dec 04 00:51:01.489567 master-0 kubenswrapper[33142]: I1204 00:51:01.489496 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:02.033089 master-0 kubenswrapper[33142]: I1204 00:51:02.033019 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:51:02.464723 master-0 kubenswrapper[33142]: I1204 00:51:02.464656 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"719f415f557af07f94cc105e49d26d81b6e217134e978957e8b57ef12542d68c"} Dec 04 00:51:02.467617 master-0 kubenswrapper[33142]: I1204 00:51:02.467567 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="3578f23afad3fbf0e79530532c6563a78014d3e68e7a72febf782bc78ecc28cf" exitCode=0 Dec 04 00:51:02.469044 master-0 kubenswrapper[33142]: I1204 00:51:02.469010 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"3578f23afad3fbf0e79530532c6563a78014d3e68e7a72febf782bc78ecc28cf"} Dec 04 00:51:02.469112 master-0 kubenswrapper[33142]: I1204 00:51:02.469046 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"13e58be298789b162735677d4cc481e45f0a3c502aae0af262cb714cccd12e36"} Dec 04 00:51:03.487824 master-0 kubenswrapper[33142]: I1204 00:51:03.487732 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerStarted","Data":"f14e74b3f0bd2e54f5e3dfefeb97bc72332a4df5c0dda0f58990bbee645076d3"} Dec 04 00:51:03.493522 master-0 kubenswrapper[33142]: I1204 00:51:03.493395 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"3f107b1aae2ded7a6634d9d9c42c6872d68992a00d05f6b1f5850b15ab827f5e"} Dec 04 00:51:03.493522 master-0 kubenswrapper[33142]: I1204 00:51:03.493445 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"23124f8652538f278dc1f09439f879a6e1dad5e8aa060ef059d69d41450e2aae"} Dec 04 00:51:03.535787 master-0 kubenswrapper[33142]: I1204 00:51:03.535653 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.501284035 podStartE2EDuration="8.535626751s" podCreationTimestamp="2025-12-04 00:50:55 +0000 UTC" firstStartedPulling="2025-12-04 00:50:56.566390507 +0000 UTC m=+228.968392387" lastFinishedPulling="2025-12-04 00:51:02.600733253 +0000 UTC m=+235.002735103" observedRunningTime="2025-12-04 00:51:03.530214398 +0000 UTC m=+235.932216268" watchObservedRunningTime="2025-12-04 00:51:03.535626751 +0000 UTC m=+235.937628601" Dec 04 00:51:04.503890 master-0 kubenswrapper[33142]: I1204 00:51:04.503806 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" event={"ID":"b4dc6d45-957e-479c-ade4-1a03ebeef927","Type":"ContainerStarted","Data":"8d18d160db17e1423f73ae17a018ed013e7511ab47d24c8444f45f8c1c26ca87"} Dec 04 00:51:04.503890 master-0 kubenswrapper[33142]: I1204 00:51:04.503876 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" event={"ID":"b4dc6d45-957e-479c-ade4-1a03ebeef927","Type":"ContainerStarted","Data":"77ddecf22c20e5b49e81f0d26dc0853e0563a377d144c4056912a7590d4cd414"} Dec 04 00:51:04.503890 master-0 kubenswrapper[33142]: I1204 00:51:04.503894 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" event={"ID":"b4dc6d45-957e-479c-ade4-1a03ebeef927","Type":"ContainerStarted","Data":"5f8f96a75c78da4bcb0e7f043908e9c479ae8748d97833ed20083f8e3ec30339"} Dec 04 00:51:04.516883 master-0 kubenswrapper[33142]: I1204 00:51:04.516820 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" event={"ID":"697e7e4b-be49-48e2-9675-63b179187c48","Type":"ContainerStarted","Data":"65ff2f03703976f4479c8303e4418126549c899d9601c262350b4ddeba7d63a5"} Dec 04 00:51:04.517067 master-0 kubenswrapper[33142]: I1204 00:51:04.516960 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:51:04.538684 master-0 kubenswrapper[33142]: I1204 00:51:04.538601 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69695c56bc-5tscf" podStartSLOduration=3.418316219 podStartE2EDuration="5.538579703s" podCreationTimestamp="2025-12-04 00:50:59 +0000 UTC" firstStartedPulling="2025-12-04 00:51:01.189041249 +0000 UTC m=+233.591043099" lastFinishedPulling="2025-12-04 00:51:03.309304693 +0000 UTC m=+235.711306583" observedRunningTime="2025-12-04 00:51:04.535017922 +0000 UTC m=+236.937019792" watchObservedRunningTime="2025-12-04 00:51:04.538579703 +0000 UTC m=+236.940581553" Dec 04 00:51:04.578165 master-0 kubenswrapper[33142]: I1204 00:51:04.578038 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" podStartSLOduration=3.539186142 podStartE2EDuration="8.578008107s" podCreationTimestamp="2025-12-04 00:50:56 +0000 UTC" firstStartedPulling="2025-12-04 00:50:57.565003026 +0000 UTC m=+229.967004876" lastFinishedPulling="2025-12-04 00:51:02.603824991 +0000 UTC m=+235.005826841" observedRunningTime="2025-12-04 00:51:04.573050237 +0000 UTC m=+236.975052107" watchObservedRunningTime="2025-12-04 00:51:04.578008107 +0000 UTC m=+236.980009967" Dec 04 00:51:06.377879 master-0 kubenswrapper[33142]: I1204 00:51:06.377817 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" podUID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" containerName="oauth-openshift" containerID="cri-o://660313aa5b5561dfdacebf1438ea58923202dcd370e3475f11979dba87dbea21" gracePeriod=15 Dec 04 00:51:06.536782 master-0 kubenswrapper[33142]: I1204 00:51:06.536715 33142 generic.go:334] "Generic (PLEG): container finished" podID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" containerID="660313aa5b5561dfdacebf1438ea58923202dcd370e3475f11979dba87dbea21" exitCode=0 Dec 04 00:51:06.537005 master-0 kubenswrapper[33142]: I1204 00:51:06.536792 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" event={"ID":"23cc12f5-3da5-4272-a3df-cb0ab0a32718","Type":"ContainerDied","Data":"660313aa5b5561dfdacebf1438ea58923202dcd370e3475f11979dba87dbea21"} Dec 04 00:51:06.918744 master-0 kubenswrapper[33142]: I1204 00:51:06.918693 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:51:06.970916 master-0 kubenswrapper[33142]: I1204 00:51:06.968609 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-895d57dc4-nj2gh"] Dec 04 00:51:06.970916 master-0 kubenswrapper[33142]: E1204 00:51:06.969037 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" containerName="oauth-openshift" Dec 04 00:51:06.970916 master-0 kubenswrapper[33142]: I1204 00:51:06.969057 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" containerName="oauth-openshift" Dec 04 00:51:06.970916 master-0 kubenswrapper[33142]: I1204 00:51:06.969331 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" containerName="oauth-openshift" Dec 04 00:51:06.970916 master-0 kubenswrapper[33142]: I1204 00:51:06.969906 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:06.986483 master-0 kubenswrapper[33142]: I1204 00:51:06.986076 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-895d57dc4-nj2gh"] Dec 04 00:51:07.065571 master-0 kubenswrapper[33142]: I1204 00:51:07.065511 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065571 master-0 kubenswrapper[33142]: I1204 00:51:07.065569 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065699 master-0 kubenswrapper[33142]: I1204 00:51:07.065616 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065699 master-0 kubenswrapper[33142]: I1204 00:51:07.065643 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065761 master-0 kubenswrapper[33142]: I1204 00:51:07.065752 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59ts4\" (UniqueName: \"kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065808 master-0 kubenswrapper[33142]: I1204 00:51:07.065785 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065841 master-0 kubenswrapper[33142]: I1204 00:51:07.065810 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065878 master-0 kubenswrapper[33142]: I1204 00:51:07.065858 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065911 master-0 kubenswrapper[33142]: I1204 00:51:07.065898 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.065963 master-0 kubenswrapper[33142]: I1204 00:51:07.065916 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.066002 master-0 kubenswrapper[33142]: I1204 00:51:07.065984 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.066036 master-0 kubenswrapper[33142]: I1204 00:51:07.066003 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.066036 master-0 kubenswrapper[33142]: I1204 00:51:07.066028 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection\") pod \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\" (UID: \"23cc12f5-3da5-4272-a3df-cb0ab0a32718\") " Dec 04 00:51:07.066226 master-0 kubenswrapper[33142]: I1204 00:51:07.066189 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.066300 master-0 kubenswrapper[33142]: I1204 00:51:07.066240 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.066300 master-0 kubenswrapper[33142]: I1204 00:51:07.066283 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.066386 master-0 kubenswrapper[33142]: I1204 00:51:07.066325 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066424 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxll\" (UniqueName: \"kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066476 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066506 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066548 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066583 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066611 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066642 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066670 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.067600 master-0 kubenswrapper[33142]: I1204 00:51:07.066695 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.068140 master-0 kubenswrapper[33142]: I1204 00:51:07.068098 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:51:07.068346 master-0 kubenswrapper[33142]: I1204 00:51:07.068299 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:51:07.068444 master-0 kubenswrapper[33142]: I1204 00:51:07.068397 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:51:07.070220 master-0 kubenswrapper[33142]: I1204 00:51:07.070173 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:51:07.070298 master-0 kubenswrapper[33142]: I1204 00:51:07.070268 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.070376 master-0 kubenswrapper[33142]: I1204 00:51:07.070300 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:51:07.070715 master-0 kubenswrapper[33142]: I1204 00:51:07.070679 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.071664 master-0 kubenswrapper[33142]: I1204 00:51:07.071625 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.072499 master-0 kubenswrapper[33142]: I1204 00:51:07.072324 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.072499 master-0 kubenswrapper[33142]: I1204 00:51:07.072427 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.073484 master-0 kubenswrapper[33142]: I1204 00:51:07.073454 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4" (OuterVolumeSpecName: "kube-api-access-59ts4") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "kube-api-access-59ts4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:51:07.073989 master-0 kubenswrapper[33142]: I1204 00:51:07.073867 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.081478 master-0 kubenswrapper[33142]: I1204 00:51:07.081187 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "23cc12f5-3da5-4272-a3df-cb0ab0a32718" (UID: "23cc12f5-3da5-4272-a3df-cb0ab0a32718"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:51:07.087029 master-0 kubenswrapper[33142]: I1204 00:51:07.086632 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6db5f86c74-5rwks" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169534 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxll\" (UniqueName: \"kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169604 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169644 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169724 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169753 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169817 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169850 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169886 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169920 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.169978 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170013 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170107 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170144 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170200 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-session\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170219 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-router-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170235 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-59ts4\" (UniqueName: \"kubernetes.io/projected/23cc12f5-3da5-4272-a3df-cb0ab0a32718-kube-api-access-59ts4\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170251 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-ocp-branding-template\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.170218 master-0 kubenswrapper[33142]: I1204 00:51:07.170265 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170280 33142 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-policies\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170293 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-cliconfig\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170308 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-login\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170324 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170337 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-error\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170352 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-user-template-provider-selection\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170365 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/23cc12f5-3da5-4272-a3df-cb0ab0a32718-v4-0-config-system-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.170377 33142 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/23cc12f5-3da5-4272-a3df-cb0ab0a32718-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:51:07.171686 master-0 kubenswrapper[33142]: I1204 00:51:07.171587 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.172788 master-0 kubenswrapper[33142]: I1204 00:51:07.172750 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.173076 master-0 kubenswrapper[33142]: I1204 00:51:07.173030 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.173408 master-0 kubenswrapper[33142]: I1204 00:51:07.173318 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.174156 master-0 kubenswrapper[33142]: I1204 00:51:07.174125 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.174481 master-0 kubenswrapper[33142]: I1204 00:51:07.174439 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.174594 master-0 kubenswrapper[33142]: I1204 00:51:07.174461 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.175655 master-0 kubenswrapper[33142]: I1204 00:51:07.175615 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.176018 master-0 kubenswrapper[33142]: I1204 00:51:07.175988 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.176193 master-0 kubenswrapper[33142]: I1204 00:51:07.176159 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.179765 master-0 kubenswrapper[33142]: I1204 00:51:07.178949 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.182968 master-0 kubenswrapper[33142]: I1204 00:51:07.182901 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.194813 master-0 kubenswrapper[33142]: I1204 00:51:07.194277 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxll\" (UniqueName: \"kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll\") pod \"oauth-openshift-895d57dc4-nj2gh\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.331248 master-0 kubenswrapper[33142]: I1204 00:51:07.331188 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:07.569101 master-0 kubenswrapper[33142]: I1204 00:51:07.569041 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"daabdb748e1c714450ef9d83eb79cc3c8cd31889f1d74c72b2a2d3d806ef3ab4"} Dec 04 00:51:07.569101 master-0 kubenswrapper[33142]: I1204 00:51:07.569097 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"6ed23a0a1eb12986104e22dab79d67db3d7c9755e77165272221f4b1c0afdb3f"} Dec 04 00:51:07.569101 master-0 kubenswrapper[33142]: I1204 00:51:07.569111 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"94d90e74c22ad5d515c17a9ae4738cd5f749fc5f3f91002bbcb36643b3d4c951"} Dec 04 00:51:07.569662 master-0 kubenswrapper[33142]: I1204 00:51:07.569122 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"cfceebb485f61f7b0cda284796e2a6846cc0b7d447206490f77feda543d10e7e"} Dec 04 00:51:07.569662 master-0 kubenswrapper[33142]: I1204 00:51:07.569132 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"d0a9c8f979f554245cb3bfe5adf3d3f015694c65f7ac9ea8bfd41dc45a001a01"} Dec 04 00:51:07.569662 master-0 kubenswrapper[33142]: I1204 00:51:07.569140 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerStarted","Data":"32d3b141ebb22426932cebc2f95078b41d845016ed113358108f954bffd6cd1f"} Dec 04 00:51:07.572276 master-0 kubenswrapper[33142]: I1204 00:51:07.572200 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" event={"ID":"23cc12f5-3da5-4272-a3df-cb0ab0a32718","Type":"ContainerDied","Data":"70f0a3a28d7dc860ee7089aa6586ea328119dd78a069f04303d87f25143b2a06"} Dec 04 00:51:07.572366 master-0 kubenswrapper[33142]: I1204 00:51:07.572295 33142 scope.go:117] "RemoveContainer" containerID="660313aa5b5561dfdacebf1438ea58923202dcd370e3475f11979dba87dbea21" Dec 04 00:51:07.572421 master-0 kubenswrapper[33142]: I1204 00:51:07.572411 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-84bd77d659-plb85" Dec 04 00:51:07.606011 master-0 kubenswrapper[33142]: I1204 00:51:07.605871 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.718922793 podStartE2EDuration="6.605840907s" podCreationTimestamp="2025-12-04 00:51:01 +0000 UTC" firstStartedPulling="2025-12-04 00:51:02.469400871 +0000 UTC m=+234.871402731" lastFinishedPulling="2025-12-04 00:51:06.356318985 +0000 UTC m=+238.758320845" observedRunningTime="2025-12-04 00:51:07.59922441 +0000 UTC m=+240.001226270" watchObservedRunningTime="2025-12-04 00:51:07.605840907 +0000 UTC m=+240.007842767" Dec 04 00:51:07.628275 master-0 kubenswrapper[33142]: I1204 00:51:07.628191 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:51:07.640963 master-0 kubenswrapper[33142]: I1204 00:51:07.640887 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-84bd77d659-plb85"] Dec 04 00:51:07.768503 master-0 kubenswrapper[33142]: I1204 00:51:07.768285 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-895d57dc4-nj2gh"] Dec 04 00:51:07.912900 master-0 kubenswrapper[33142]: I1204 00:51:07.912512 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23cc12f5-3da5-4272-a3df-cb0ab0a32718" path="/var/lib/kubelet/pods/23cc12f5-3da5-4272-a3df-cb0ab0a32718/volumes" Dec 04 00:51:08.584507 master-0 kubenswrapper[33142]: I1204 00:51:08.584333 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" event={"ID":"70d82c00-2cea-43f5-afec-fbac31edec74","Type":"ContainerStarted","Data":"7c3677d545a044ed1570e10df227f82a7498b7a18635e8394eccc48368d9d791"} Dec 04 00:51:08.584507 master-0 kubenswrapper[33142]: I1204 00:51:08.584508 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" event={"ID":"70d82c00-2cea-43f5-afec-fbac31edec74","Type":"ContainerStarted","Data":"455c7abbebbee162c05f607623bc0266c71c721f80ad62a1caca5ae241d77f09"} Dec 04 00:51:08.585743 master-0 kubenswrapper[33142]: I1204 00:51:08.584549 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:08.594037 master-0 kubenswrapper[33142]: I1204 00:51:08.593965 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:51:08.635029 master-0 kubenswrapper[33142]: I1204 00:51:08.634415 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" podStartSLOduration=27.634356681 podStartE2EDuration="27.634356681s" podCreationTimestamp="2025-12-04 00:50:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:51:08.623767462 +0000 UTC m=+241.025769342" watchObservedRunningTime="2025-12-04 00:51:08.634356681 +0000 UTC m=+241.036358571" Dec 04 00:51:11.490704 master-0 kubenswrapper[33142]: I1204 00:51:11.490626 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:51:12.446819 master-0 kubenswrapper[33142]: I1204 00:51:12.446712 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 00:51:12.448592 master-0 kubenswrapper[33142]: I1204 00:51:12.448545 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.453192 master-0 kubenswrapper[33142]: I1204 00:51:12.453129 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-8xh6q" Dec 04 00:51:12.453307 master-0 kubenswrapper[33142]: I1204 00:51:12.453178 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 00:51:12.463063 master-0 kubenswrapper[33142]: I1204 00:51:12.462994 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 00:51:12.559258 master-0 kubenswrapper[33142]: I1204 00:51:12.559152 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.560002 master-0 kubenswrapper[33142]: I1204 00:51:12.559333 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.560002 master-0 kubenswrapper[33142]: I1204 00:51:12.559386 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.661478 master-0 kubenswrapper[33142]: I1204 00:51:12.661358 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.661478 master-0 kubenswrapper[33142]: I1204 00:51:12.661461 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.661478 master-0 kubenswrapper[33142]: I1204 00:51:12.661487 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.661968 master-0 kubenswrapper[33142]: I1204 00:51:12.661523 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.661968 master-0 kubenswrapper[33142]: I1204 00:51:12.661635 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.694407 master-0 kubenswrapper[33142]: I1204 00:51:12.694304 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access\") pod \"installer-5-master-0\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:12.781302 master-0 kubenswrapper[33142]: I1204 00:51:12.781134 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:51:13.209778 master-0 kubenswrapper[33142]: I1204 00:51:13.209719 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 00:51:13.627023 master-0 kubenswrapper[33142]: I1204 00:51:13.626961 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1","Type":"ContainerStarted","Data":"f54c179b6ea7bd833be415f903ddfd137392821b113ffbda501498a732b4e941"} Dec 04 00:51:14.641721 master-0 kubenswrapper[33142]: I1204 00:51:14.641597 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1","Type":"ContainerStarted","Data":"e94a6286aeda9c6bbca81295e34a44966baec72a012a2c200b44ba220bcb5755"} Dec 04 00:51:14.676605 master-0 kubenswrapper[33142]: I1204 00:51:14.676457 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-5-master-0" podStartSLOduration=2.676429916 podStartE2EDuration="2.676429916s" podCreationTimestamp="2025-12-04 00:51:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:51:14.670083167 +0000 UTC m=+247.072085017" watchObservedRunningTime="2025-12-04 00:51:14.676429916 +0000 UTC m=+247.078431786" Dec 04 00:51:19.791747 master-0 kubenswrapper[33142]: I1204 00:51:19.791636 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:51:19.791747 master-0 kubenswrapper[33142]: I1204 00:51:19.791757 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:51:21.416993 master-0 kubenswrapper[33142]: I1204 00:51:21.416745 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-77df56447c-khvgx"] Dec 04 00:51:21.419729 master-0 kubenswrapper[33142]: I1204 00:51:21.417964 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.422483 master-0 kubenswrapper[33142]: I1204 00:51:21.422399 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"serving-cert" Dec 04 00:51:21.423048 master-0 kubenswrapper[33142]: I1204 00:51:21.423009 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"console-operator-dockercfg-l9lk8" Dec 04 00:51:21.424028 master-0 kubenswrapper[33142]: I1204 00:51:21.423979 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"kube-root-ca.crt" Dec 04 00:51:21.424626 master-0 kubenswrapper[33142]: I1204 00:51:21.424539 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"console-operator-config" Dec 04 00:51:21.425138 master-0 kubenswrapper[33142]: I1204 00:51:21.425098 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"openshift-service-ca.crt" Dec 04 00:51:21.448998 master-0 kubenswrapper[33142]: I1204 00:51:21.448942 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"trusted-ca" Dec 04 00:51:21.449575 master-0 kubenswrapper[33142]: I1204 00:51:21.449522 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-77df56447c-khvgx"] Dec 04 00:51:21.532637 master-0 kubenswrapper[33142]: I1204 00:51:21.532582 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-trusted-ca\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.532879 master-0 kubenswrapper[33142]: I1204 00:51:21.532648 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc637782-0c5c-43ae-bc94-03aad6a509c3-serving-cert\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.532879 master-0 kubenswrapper[33142]: I1204 00:51:21.532679 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsjdh\" (UniqueName: \"kubernetes.io/projected/dc637782-0c5c-43ae-bc94-03aad6a509c3-kube-api-access-dsjdh\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.533056 master-0 kubenswrapper[33142]: I1204 00:51:21.533000 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-config\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.634813 master-0 kubenswrapper[33142]: I1204 00:51:21.634738 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-trusted-ca\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.635078 master-0 kubenswrapper[33142]: I1204 00:51:21.634837 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc637782-0c5c-43ae-bc94-03aad6a509c3-serving-cert\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.635078 master-0 kubenswrapper[33142]: I1204 00:51:21.634881 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dsjdh\" (UniqueName: \"kubernetes.io/projected/dc637782-0c5c-43ae-bc94-03aad6a509c3-kube-api-access-dsjdh\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.635078 master-0 kubenswrapper[33142]: I1204 00:51:21.634958 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-config\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.636417 master-0 kubenswrapper[33142]: I1204 00:51:21.636369 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-config\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.636664 master-0 kubenswrapper[33142]: I1204 00:51:21.636620 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc637782-0c5c-43ae-bc94-03aad6a509c3-trusted-ca\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.641819 master-0 kubenswrapper[33142]: I1204 00:51:21.641771 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc637782-0c5c-43ae-bc94-03aad6a509c3-serving-cert\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.664763 master-0 kubenswrapper[33142]: I1204 00:51:21.664690 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsjdh\" (UniqueName: \"kubernetes.io/projected/dc637782-0c5c-43ae-bc94-03aad6a509c3-kube-api-access-dsjdh\") pod \"console-operator-77df56447c-khvgx\" (UID: \"dc637782-0c5c-43ae-bc94-03aad6a509c3\") " pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:21.751542 master-0 kubenswrapper[33142]: I1204 00:51:21.751395 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:23.155600 master-0 kubenswrapper[33142]: I1204 00:51:23.155555 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-77df56447c-khvgx"] Dec 04 00:51:23.160092 master-0 kubenswrapper[33142]: W1204 00:51:23.160068 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc637782_0c5c_43ae_bc94_03aad6a509c3.slice/crio-101b953044a322b1faf3753a422ebe183ac4c20618b6946912fbc992cf80cd24 WatchSource:0}: Error finding container 101b953044a322b1faf3753a422ebe183ac4c20618b6946912fbc992cf80cd24: Status 404 returned error can't find the container with id 101b953044a322b1faf3753a422ebe183ac4c20618b6946912fbc992cf80cd24 Dec 04 00:51:23.726782 master-0 kubenswrapper[33142]: I1204 00:51:23.726641 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-77df56447c-khvgx" event={"ID":"dc637782-0c5c-43ae-bc94-03aad6a509c3","Type":"ContainerStarted","Data":"101b953044a322b1faf3753a422ebe183ac4c20618b6946912fbc992cf80cd24"} Dec 04 00:51:25.459078 master-0 kubenswrapper[33142]: I1204 00:51:25.456201 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw"] Dec 04 00:51:25.459078 master-0 kubenswrapper[33142]: I1204 00:51:25.457452 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:25.471951 master-0 kubenswrapper[33142]: I1204 00:51:25.463762 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw"] Dec 04 00:51:25.473985 master-0 kubenswrapper[33142]: I1204 00:51:25.472955 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"default-dockercfg-9f6gp" Dec 04 00:51:25.473985 master-0 kubenswrapper[33142]: I1204 00:51:25.473263 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"monitoring-plugin-cert" Dec 04 00:51:25.595004 master-0 kubenswrapper[33142]: I1204 00:51:25.594902 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a32a0665-3db5-4531-8d77-96742354cf06-monitoring-plugin-cert\") pod \"monitoring-plugin-66f56d49bd-gfnhw\" (UID: \"a32a0665-3db5-4531-8d77-96742354cf06\") " pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:25.697831 master-0 kubenswrapper[33142]: I1204 00:51:25.697765 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a32a0665-3db5-4531-8d77-96742354cf06-monitoring-plugin-cert\") pod \"monitoring-plugin-66f56d49bd-gfnhw\" (UID: \"a32a0665-3db5-4531-8d77-96742354cf06\") " pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:25.701512 master-0 kubenswrapper[33142]: I1204 00:51:25.701404 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a32a0665-3db5-4531-8d77-96742354cf06-monitoring-plugin-cert\") pod \"monitoring-plugin-66f56d49bd-gfnhw\" (UID: \"a32a0665-3db5-4531-8d77-96742354cf06\") " pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:25.794194 master-0 kubenswrapper[33142]: I1204 00:51:25.793737 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:26.368619 master-0 kubenswrapper[33142]: I1204 00:51:26.368556 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw"] Dec 04 00:51:26.370051 master-0 kubenswrapper[33142]: W1204 00:51:26.369986 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32a0665_3db5_4531_8d77_96742354cf06.slice/crio-d2898031575fc36e30d48ba37ff102b262d103adf005029a57c3dc669a583d5e WatchSource:0}: Error finding container d2898031575fc36e30d48ba37ff102b262d103adf005029a57c3dc669a583d5e: Status 404 returned error can't find the container with id d2898031575fc36e30d48ba37ff102b262d103adf005029a57c3dc669a583d5e Dec 04 00:51:26.751229 master-0 kubenswrapper[33142]: I1204 00:51:26.751049 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" event={"ID":"a32a0665-3db5-4531-8d77-96742354cf06","Type":"ContainerStarted","Data":"d2898031575fc36e30d48ba37ff102b262d103adf005029a57c3dc669a583d5e"} Dec 04 00:51:26.752855 master-0 kubenswrapper[33142]: I1204 00:51:26.752786 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-77df56447c-khvgx" event={"ID":"dc637782-0c5c-43ae-bc94-03aad6a509c3","Type":"ContainerStarted","Data":"08e8a713eceef756bdb21558e84a543d0721c75c3a6243bec5703a304cdcb92c"} Dec 04 00:51:26.753294 master-0 kubenswrapper[33142]: I1204 00:51:26.753255 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:26.782358 master-0 kubenswrapper[33142]: I1204 00:51:26.782239 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-77df56447c-khvgx" podStartSLOduration=2.925193908 podStartE2EDuration="5.78221615s" podCreationTimestamp="2025-12-04 00:51:21 +0000 UTC" firstStartedPulling="2025-12-04 00:51:23.162945951 +0000 UTC m=+255.564947801" lastFinishedPulling="2025-12-04 00:51:26.019968193 +0000 UTC m=+258.421970043" observedRunningTime="2025-12-04 00:51:26.778890236 +0000 UTC m=+259.180892086" watchObservedRunningTime="2025-12-04 00:51:26.78221615 +0000 UTC m=+259.184218010" Dec 04 00:51:26.978866 master-0 kubenswrapper[33142]: I1204 00:51:26.978795 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-77df56447c-khvgx" Dec 04 00:51:27.602342 master-0 kubenswrapper[33142]: I1204 00:51:27.602276 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6f5db8559b-fgz5r"] Dec 04 00:51:27.603713 master-0 kubenswrapper[33142]: I1204 00:51:27.603675 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:51:27.608095 master-0 kubenswrapper[33142]: I1204 00:51:27.608061 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Dec 04 00:51:27.608728 master-0 kubenswrapper[33142]: I1204 00:51:27.608688 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Dec 04 00:51:27.608978 master-0 kubenswrapper[33142]: I1204 00:51:27.608961 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"default-dockercfg-l9wg2" Dec 04 00:51:27.631252 master-0 kubenswrapper[33142]: I1204 00:51:27.631203 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6f5db8559b-fgz5r"] Dec 04 00:51:27.733749 master-0 kubenswrapper[33142]: I1204 00:51:27.733668 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr94n\" (UniqueName: \"kubernetes.io/projected/07652d83-b353-4e4f-b234-c60d7f704e62-kube-api-access-hr94n\") pod \"downloads-6f5db8559b-fgz5r\" (UID: \"07652d83-b353-4e4f-b234-c60d7f704e62\") " pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:51:27.835137 master-0 kubenswrapper[33142]: I1204 00:51:27.835052 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hr94n\" (UniqueName: \"kubernetes.io/projected/07652d83-b353-4e4f-b234-c60d7f704e62-kube-api-access-hr94n\") pod \"downloads-6f5db8559b-fgz5r\" (UID: \"07652d83-b353-4e4f-b234-c60d7f704e62\") " pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:51:27.860500 master-0 kubenswrapper[33142]: I1204 00:51:27.860393 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr94n\" (UniqueName: \"kubernetes.io/projected/07652d83-b353-4e4f-b234-c60d7f704e62-kube-api-access-hr94n\") pod \"downloads-6f5db8559b-fgz5r\" (UID: \"07652d83-b353-4e4f-b234-c60d7f704e62\") " pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:51:27.931003 master-0 kubenswrapper[33142]: I1204 00:51:27.930913 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:51:28.496461 master-0 kubenswrapper[33142]: I1204 00:51:28.496404 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6f5db8559b-fgz5r"] Dec 04 00:51:28.589029 master-0 kubenswrapper[33142]: W1204 00:51:28.586623 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07652d83_b353_4e4f_b234_c60d7f704e62.slice/crio-991df6a079aaa46fea512bf3e53a182e814ee9ed47fae6277adba93b37af166a WatchSource:0}: Error finding container 991df6a079aaa46fea512bf3e53a182e814ee9ed47fae6277adba93b37af166a: Status 404 returned error can't find the container with id 991df6a079aaa46fea512bf3e53a182e814ee9ed47fae6277adba93b37af166a Dec 04 00:51:28.772161 master-0 kubenswrapper[33142]: I1204 00:51:28.772098 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6f5db8559b-fgz5r" event={"ID":"07652d83-b353-4e4f-b234-c60d7f704e62","Type":"ContainerStarted","Data":"991df6a079aaa46fea512bf3e53a182e814ee9ed47fae6277adba93b37af166a"} Dec 04 00:51:29.780901 master-0 kubenswrapper[33142]: I1204 00:51:29.780848 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" event={"ID":"a32a0665-3db5-4531-8d77-96742354cf06","Type":"ContainerStarted","Data":"058e5ec1a3599b455d97a1d9d7fe36c24f3a9c9bdd0dc6f5d5544e6f4923ea54"} Dec 04 00:51:29.809732 master-0 kubenswrapper[33142]: I1204 00:51:29.809642 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" podStartSLOduration=2.5448420670000003 podStartE2EDuration="4.809613407s" podCreationTimestamp="2025-12-04 00:51:25 +0000 UTC" firstStartedPulling="2025-12-04 00:51:26.372830727 +0000 UTC m=+258.774832587" lastFinishedPulling="2025-12-04 00:51:28.637602067 +0000 UTC m=+261.039603927" observedRunningTime="2025-12-04 00:51:29.802376273 +0000 UTC m=+262.204378133" watchObservedRunningTime="2025-12-04 00:51:29.809613407 +0000 UTC m=+262.211615257" Dec 04 00:51:30.787903 master-0 kubenswrapper[33142]: I1204 00:51:30.787856 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:30.794393 master-0 kubenswrapper[33142]: I1204 00:51:30.794322 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-66f56d49bd-gfnhw" Dec 04 00:51:32.278596 master-0 kubenswrapper[33142]: I1204 00:51:32.278516 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-b6t29"] Dec 04 00:51:32.279575 master-0 kubenswrapper[33142]: I1204 00:51:32.279525 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.282397 master-0 kubenswrapper[33142]: I1204 00:51:32.282338 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Dec 04 00:51:32.283229 master-0 kubenswrapper[33142]: I1204 00:51:32.282947 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-9s98x" Dec 04 00:51:32.439484 master-0 kubenswrapper[33142]: I1204 00:51:32.439400 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ed02507-e1a5-4179-8011-c0bdfbb60d82-host\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.439718 master-0 kubenswrapper[33142]: I1204 00:51:32.439555 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vn7\" (UniqueName: \"kubernetes.io/projected/9ed02507-e1a5-4179-8011-c0bdfbb60d82-kube-api-access-r4vn7\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.439718 master-0 kubenswrapper[33142]: I1204 00:51:32.439612 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ed02507-e1a5-4179-8011-c0bdfbb60d82-serviceca\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.541143 master-0 kubenswrapper[33142]: I1204 00:51:32.540972 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vn7\" (UniqueName: \"kubernetes.io/projected/9ed02507-e1a5-4179-8011-c0bdfbb60d82-kube-api-access-r4vn7\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.541343 master-0 kubenswrapper[33142]: I1204 00:51:32.541170 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ed02507-e1a5-4179-8011-c0bdfbb60d82-serviceca\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.541343 master-0 kubenswrapper[33142]: I1204 00:51:32.541248 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ed02507-e1a5-4179-8011-c0bdfbb60d82-host\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.541696 master-0 kubenswrapper[33142]: I1204 00:51:32.541501 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ed02507-e1a5-4179-8011-c0bdfbb60d82-host\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.542383 master-0 kubenswrapper[33142]: I1204 00:51:32.542358 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ed02507-e1a5-4179-8011-c0bdfbb60d82-serviceca\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.564850 master-0 kubenswrapper[33142]: I1204 00:51:32.564799 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vn7\" (UniqueName: \"kubernetes.io/projected/9ed02507-e1a5-4179-8011-c0bdfbb60d82-kube-api-access-r4vn7\") pod \"node-ca-b6t29\" (UID: \"9ed02507-e1a5-4179-8011-c0bdfbb60d82\") " pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.600869 master-0 kubenswrapper[33142]: I1204 00:51:32.600779 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6t29" Dec 04 00:51:32.646696 master-0 kubenswrapper[33142]: W1204 00:51:32.646573 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed02507_e1a5_4179_8011_c0bdfbb60d82.slice/crio-b868b1cfd728b5345a1850e74b889543a3e8d89c1c5e0605a24bcf6b748e0458 WatchSource:0}: Error finding container b868b1cfd728b5345a1850e74b889543a3e8d89c1c5e0605a24bcf6b748e0458: Status 404 returned error can't find the container with id b868b1cfd728b5345a1850e74b889543a3e8d89c1c5e0605a24bcf6b748e0458 Dec 04 00:51:32.814614 master-0 kubenswrapper[33142]: I1204 00:51:32.807547 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6t29" event={"ID":"9ed02507-e1a5-4179-8011-c0bdfbb60d82","Type":"ContainerStarted","Data":"b868b1cfd728b5345a1850e74b889543a3e8d89c1c5e0605a24bcf6b748e0458"} Dec 04 00:51:34.540316 master-0 kubenswrapper[33142]: I1204 00:51:34.540248 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:51:34.542989 master-0 kubenswrapper[33142]: I1204 00:51:34.541435 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.544475 master-0 kubenswrapper[33142]: I1204 00:51:34.544441 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Dec 04 00:51:34.547954 master-0 kubenswrapper[33142]: I1204 00:51:34.544781 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Dec 04 00:51:34.547954 master-0 kubenswrapper[33142]: I1204 00:51:34.544949 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-zrkxd" Dec 04 00:51:34.547954 master-0 kubenswrapper[33142]: I1204 00:51:34.545078 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Dec 04 00:51:34.547954 master-0 kubenswrapper[33142]: I1204 00:51:34.545204 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Dec 04 00:51:34.559481 master-0 kubenswrapper[33142]: I1204 00:51:34.556689 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:51:34.559481 master-0 kubenswrapper[33142]: I1204 00:51:34.559452 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Dec 04 00:51:34.681506 master-0 kubenswrapper[33142]: I1204 00:51:34.681449 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.681602 master-0 kubenswrapper[33142]: I1204 00:51:34.681509 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22nd5\" (UniqueName: \"kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.681602 master-0 kubenswrapper[33142]: I1204 00:51:34.681548 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.681696 master-0 kubenswrapper[33142]: I1204 00:51:34.681675 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.681746 master-0 kubenswrapper[33142]: I1204 00:51:34.681713 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.681746 master-0 kubenswrapper[33142]: I1204 00:51:34.681734 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783752 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783832 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783862 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783890 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783910 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-22nd5\" (UniqueName: \"kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.784026 master-0 kubenswrapper[33142]: I1204 00:51:34.783976 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.786080 master-0 kubenswrapper[33142]: I1204 00:51:34.785400 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.786080 master-0 kubenswrapper[33142]: I1204 00:51:34.785400 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.786569 master-0 kubenswrapper[33142]: I1204 00:51:34.786499 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.788996 master-0 kubenswrapper[33142]: I1204 00:51:34.788963 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.793989 master-0 kubenswrapper[33142]: I1204 00:51:34.793839 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.806463 master-0 kubenswrapper[33142]: I1204 00:51:34.806392 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-22nd5\" (UniqueName: \"kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5\") pod \"console-5fb74f878d-dqq2p\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:34.879260 master-0 kubenswrapper[33142]: I1204 00:51:34.879129 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:35.463021 master-0 kubenswrapper[33142]: I1204 00:51:35.462969 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:51:35.469501 master-0 kubenswrapper[33142]: W1204 00:51:35.469460 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ab2496_d38e_4ec8_bea5_ea9f6bce8a86.slice/crio-d04b0b3db66462080f7ae4c4b26dc82cf86f293a81f1a5260b8c60ec324dc02a WatchSource:0}: Error finding container d04b0b3db66462080f7ae4c4b26dc82cf86f293a81f1a5260b8c60ec324dc02a: Status 404 returned error can't find the container with id d04b0b3db66462080f7ae4c4b26dc82cf86f293a81f1a5260b8c60ec324dc02a Dec 04 00:51:35.836122 master-0 kubenswrapper[33142]: I1204 00:51:35.835969 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6t29" event={"ID":"9ed02507-e1a5-4179-8011-c0bdfbb60d82","Type":"ContainerStarted","Data":"378d5b28466896d18d45d1541f4b7daf208f3bca9e9d641dec7413e0f72749cf"} Dec 04 00:51:35.837946 master-0 kubenswrapper[33142]: I1204 00:51:35.837893 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb74f878d-dqq2p" event={"ID":"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86","Type":"ContainerStarted","Data":"d04b0b3db66462080f7ae4c4b26dc82cf86f293a81f1a5260b8c60ec324dc02a"} Dec 04 00:51:35.861070 master-0 kubenswrapper[33142]: I1204 00:51:35.860187 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b6t29" podStartSLOduration=1.875297955 podStartE2EDuration="3.860159512s" podCreationTimestamp="2025-12-04 00:51:32 +0000 UTC" firstStartedPulling="2025-12-04 00:51:32.650140522 +0000 UTC m=+265.052142372" lastFinishedPulling="2025-12-04 00:51:34.635002079 +0000 UTC m=+267.037003929" observedRunningTime="2025-12-04 00:51:35.85760968 +0000 UTC m=+268.259611530" watchObservedRunningTime="2025-12-04 00:51:35.860159512 +0000 UTC m=+268.262161362" Dec 04 00:51:38.445509 master-0 kubenswrapper[33142]: I1204 00:51:38.445418 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:51:38.446670 master-0 kubenswrapper[33142]: I1204 00:51:38.446629 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.454940 master-0 kubenswrapper[33142]: I1204 00:51:38.454885 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Dec 04 00:51:38.520424 master-0 kubenswrapper[33142]: I1204 00:51:38.520332 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:51:38.555205 master-0 kubenswrapper[33142]: I1204 00:51:38.555142 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555422 master-0 kubenswrapper[33142]: I1204 00:51:38.555255 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555422 master-0 kubenswrapper[33142]: I1204 00:51:38.555288 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555422 master-0 kubenswrapper[33142]: I1204 00:51:38.555308 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555422 master-0 kubenswrapper[33142]: I1204 00:51:38.555335 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555422 master-0 kubenswrapper[33142]: I1204 00:51:38.555353 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtttn\" (UniqueName: \"kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.555582 master-0 kubenswrapper[33142]: I1204 00:51:38.555460 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658472 master-0 kubenswrapper[33142]: I1204 00:51:38.658392 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658472 master-0 kubenswrapper[33142]: I1204 00:51:38.658469 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658844 master-0 kubenswrapper[33142]: I1204 00:51:38.658513 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658844 master-0 kubenswrapper[33142]: I1204 00:51:38.658539 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtttn\" (UniqueName: \"kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658844 master-0 kubenswrapper[33142]: I1204 00:51:38.658578 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.658844 master-0 kubenswrapper[33142]: I1204 00:51:38.658615 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.659451 master-0 kubenswrapper[33142]: I1204 00:51:38.659285 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.660033 master-0 kubenswrapper[33142]: I1204 00:51:38.659794 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.660372 master-0 kubenswrapper[33142]: I1204 00:51:38.660335 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.660820 master-0 kubenswrapper[33142]: I1204 00:51:38.660778 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.661517 master-0 kubenswrapper[33142]: I1204 00:51:38.661454 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.667170 master-0 kubenswrapper[33142]: I1204 00:51:38.667117 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.681848 master-0 kubenswrapper[33142]: I1204 00:51:38.681798 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtttn\" (UniqueName: \"kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.688776 master-0 kubenswrapper[33142]: I1204 00:51:38.688720 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config\") pod \"console-584b5bc58b-k2thl\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:38.773841 master-0 kubenswrapper[33142]: I1204 00:51:38.773652 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:39.804019 master-0 kubenswrapper[33142]: I1204 00:51:39.803873 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:51:39.821140 master-0 kubenswrapper[33142]: I1204 00:51:39.821072 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dfc8cdd-mb55t" Dec 04 00:51:40.777848 master-0 kubenswrapper[33142]: I1204 00:51:40.775178 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:51:40.787270 master-0 kubenswrapper[33142]: I1204 00:51:40.787195 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-895d57dc4-nj2gh"] Dec 04 00:51:40.789635 master-0 kubenswrapper[33142]: W1204 00:51:40.788551 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad5a3ac_d69e_457d_b873_3c18d4fa0cf4.slice/crio-1c0247cf1936aa86ee593140285df4afd5f08dae136a9ba513c18bca36ad6cd5 WatchSource:0}: Error finding container 1c0247cf1936aa86ee593140285df4afd5f08dae136a9ba513c18bca36ad6cd5: Status 404 returned error can't find the container with id 1c0247cf1936aa86ee593140285df4afd5f08dae136a9ba513c18bca36ad6cd5 Dec 04 00:51:40.917033 master-0 kubenswrapper[33142]: I1204 00:51:40.916975 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584b5bc58b-k2thl" event={"ID":"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4","Type":"ContainerStarted","Data":"1c0247cf1936aa86ee593140285df4afd5f08dae136a9ba513c18bca36ad6cd5"} Dec 04 00:51:40.953131 master-0 kubenswrapper[33142]: I1204 00:51:40.953069 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb74f878d-dqq2p" event={"ID":"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86","Type":"ContainerStarted","Data":"9027d1ac1b02172fe1d037c3f0ec1cc0a7094de2c3f5906c4a6e487a604f306d"} Dec 04 00:51:41.967443 master-0 kubenswrapper[33142]: I1204 00:51:41.966090 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584b5bc58b-k2thl" event={"ID":"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4","Type":"ContainerStarted","Data":"c88fe8acc2de8cc22b6b5f4c39aacb25104105ea8fcf1c8b42732a501acc8b0a"} Dec 04 00:51:41.998538 master-0 kubenswrapper[33142]: I1204 00:51:41.998348 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5fb74f878d-dqq2p" podStartSLOduration=3.124627105 podStartE2EDuration="7.998320103s" podCreationTimestamp="2025-12-04 00:51:34 +0000 UTC" firstStartedPulling="2025-12-04 00:51:35.473148872 +0000 UTC m=+267.875150722" lastFinishedPulling="2025-12-04 00:51:40.34684187 +0000 UTC m=+272.748843720" observedRunningTime="2025-12-04 00:51:40.993740927 +0000 UTC m=+273.395742787" watchObservedRunningTime="2025-12-04 00:51:41.998320103 +0000 UTC m=+274.400321953" Dec 04 00:51:41.998538 master-0 kubenswrapper[33142]: I1204 00:51:41.998511 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-584b5bc58b-k2thl" podStartSLOduration=3.998505608 podStartE2EDuration="3.998505608s" podCreationTimestamp="2025-12-04 00:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:51:41.988744723 +0000 UTC m=+274.390746623" watchObservedRunningTime="2025-12-04 00:51:41.998505608 +0000 UTC m=+274.400507468" Dec 04 00:51:44.880337 master-0 kubenswrapper[33142]: I1204 00:51:44.880262 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:44.880337 master-0 kubenswrapper[33142]: I1204 00:51:44.880338 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:51:44.883073 master-0 kubenswrapper[33142]: I1204 00:51:44.883028 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:51:44.883143 master-0 kubenswrapper[33142]: I1204 00:51:44.883082 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:51:48.773974 master-0 kubenswrapper[33142]: I1204 00:51:48.773824 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:48.773974 master-0 kubenswrapper[33142]: I1204 00:51:48.773955 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:51:48.775850 master-0 kubenswrapper[33142]: I1204 00:51:48.775760 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:51:48.775997 master-0 kubenswrapper[33142]: I1204 00:51:48.775880 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:51:51.916462 master-0 kubenswrapper[33142]: I1204 00:51:51.916395 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:51:51.917866 master-0 kubenswrapper[33142]: I1204 00:51:51.917823 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:51:51.917866 master-0 kubenswrapper[33142]: I1204 00:51:51.917868 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:51:51.918181 master-0 kubenswrapper[33142]: E1204 00:51:51.918153 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:51:51.918181 master-0 kubenswrapper[33142]: I1204 00:51:51.918176 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: E1204 00:51:51.918202 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-check-endpoints" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: I1204 00:51:51.918213 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-check-endpoints" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: E1204 00:51:51.918234 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-insecure-readyz" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: I1204 00:51:51.918242 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-insecure-readyz" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: E1204 00:51:51.918258 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: I1204 00:51:51.918264 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" Dec 04 00:51:51.918322 master-0 kubenswrapper[33142]: I1204 00:51:51.918239 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: E1204 00:51:51.918283 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="setup" Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: I1204 00:51:51.918469 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="setup" Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: I1204 00:51:51.918467 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://d9e03a4b5ad6a117210534969ebf8562a889101df45cb5bd4a0436ae4789287d" gracePeriod=15 Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: I1204 00:51:51.918493 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-syncer" containerID="cri-o://073116e8ee3ba017c62e6fb773e751e54ee82fd30580131f16aab80e80c914dc" gracePeriod=15 Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: I1204 00:51:51.918520 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-check-endpoints" containerID="cri-o://fb0a574850f5bf577a94e1f9c68432c425c21763f02b58dffd16f6d55bbcb7c4" gracePeriod=15 Dec 04 00:51:51.918612 master-0 kubenswrapper[33142]: E1204 00:51:51.918570 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-syncer" Dec 04 00:51:51.918972 master-0 kubenswrapper[33142]: I1204 00:51:51.918466 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" containerID="cri-o://16ddf7a0f5fadc950f5280850f172d574c8621f3cdfd40608601f3ff4a72b647" gracePeriod=15 Dec 04 00:51:51.918972 master-0 kubenswrapper[33142]: I1204 00:51:51.918670 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-syncer" Dec 04 00:51:51.918972 master-0 kubenswrapper[33142]: I1204 00:51:51.918535 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://4df2cb29b82229d73ae3a9909b0f61c318f04f7cf315695a73503bb1f3f366e4" gracePeriod=15 Dec 04 00:51:51.920307 master-0 kubenswrapper[33142]: I1204 00:51:51.920269 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-insecure-readyz" Dec 04 00:51:51.920377 master-0 kubenswrapper[33142]: I1204 00:51:51.920314 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-check-endpoints" Dec 04 00:51:51.920377 master-0 kubenswrapper[33142]: I1204 00:51:51.920362 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" Dec 04 00:51:51.920442 master-0 kubenswrapper[33142]: I1204 00:51:51.920383 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 00:51:51.920442 master-0 kubenswrapper[33142]: I1204 00:51:51.920399 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver-cert-syncer" Dec 04 00:51:51.923728 master-0 kubenswrapper[33142]: I1204 00:51:51.923684 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="f5aa2d6b41f5e21a89224256dc48af14" podUID="8a00233b22d19df39b2e1c8ba133b3c2" Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: I1204 00:51:51.930020 33142 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]log ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]api-openshift-apiserver-available ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]api-openshift-oauth-apiserver-available ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]informer-sync ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-api-request-count-filter ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-startkubeinformers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-config-consumer ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-filter ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiextensions-informers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-apiextensions-controllers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/crd-informer-synced ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-system-namespaces-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-cluster-authentication-info-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-legacy-token-tracking-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-service-ip-repair-controllers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/rbac/bootstrap-roles ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/priority-and-fairness-config-producer ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/bootstrap-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/start-kube-aggregator-informers ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-status-local-available-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-status-remote-available-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-registration-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-wait-for-first-sync ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-discovery-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/kube-apiserver-autoregistration ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]autoregister-completion ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-openapi-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [+]poststarthook/apiservice-openapiv3-controller ok Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: [-]shutdown failed: reason withheld Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: readyz check failed Dec 04 00:51:51.932150 master-0 kubenswrapper[33142]: I1204 00:51:51.930303 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="f5aa2d6b41f5e21a89224256dc48af14" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 00:51:52.023507 master-0 kubenswrapper[33142]: E1204 00:51:52.023288 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.035693 master-0 kubenswrapper[33142]: I1204 00:51:52.035622 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035715 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035794 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035819 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035843 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035872 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.036084 master-0 kubenswrapper[33142]: I1204 00:51:52.035944 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.037462 master-0 kubenswrapper[33142]: I1204 00:51:52.037180 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.058329 master-0 kubenswrapper[33142]: I1204 00:51:52.058280 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_f5aa2d6b41f5e21a89224256dc48af14/kube-apiserver-cert-syncer/0.log" Dec 04 00:51:52.059287 master-0 kubenswrapper[33142]: I1204 00:51:52.059164 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="fb0a574850f5bf577a94e1f9c68432c425c21763f02b58dffd16f6d55bbcb7c4" exitCode=0 Dec 04 00:51:52.059287 master-0 kubenswrapper[33142]: I1204 00:51:52.059209 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="d9e03a4b5ad6a117210534969ebf8562a889101df45cb5bd4a0436ae4789287d" exitCode=0 Dec 04 00:51:52.059287 master-0 kubenswrapper[33142]: I1204 00:51:52.059222 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="4df2cb29b82229d73ae3a9909b0f61c318f04f7cf315695a73503bb1f3f366e4" exitCode=0 Dec 04 00:51:52.059287 master-0 kubenswrapper[33142]: I1204 00:51:52.059234 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="073116e8ee3ba017c62e6fb773e751e54ee82fd30580131f16aab80e80c914dc" exitCode=2 Dec 04 00:51:52.139370 master-0 kubenswrapper[33142]: I1204 00:51:52.139300 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139397 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139441 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139436 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139519 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139555 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.139630 master-0 kubenswrapper[33142]: I1204 00:51:52.139586 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139855 master-0 kubenswrapper[33142]: I1204 00:51:52.139591 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139855 master-0 kubenswrapper[33142]: I1204 00:51:52.139691 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139855 master-0 kubenswrapper[33142]: I1204 00:51:52.139622 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139855 master-0 kubenswrapper[33142]: I1204 00:51:52.139714 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.139855 master-0 kubenswrapper[33142]: I1204 00:51:52.139667 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.140074 master-0 kubenswrapper[33142]: I1204 00:51:52.139898 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.140074 master-0 kubenswrapper[33142]: I1204 00:51:52.139966 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.140074 master-0 kubenswrapper[33142]: I1204 00:51:52.139987 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/8a00233b22d19df39b2e1c8ba133b3c2-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"8a00233b22d19df39b2e1c8ba133b3c2\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:51:52.140220 master-0 kubenswrapper[33142]: I1204 00:51:52.140079 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:52.324392 master-0 kubenswrapper[33142]: I1204 00:51:52.324226 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:51:53.066692 master-0 kubenswrapper[33142]: I1204 00:51:53.066600 33142 generic.go:334] "Generic (PLEG): container finished" podID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" containerID="e94a6286aeda9c6bbca81295e34a44966baec72a012a2c200b44ba220bcb5755" exitCode=0 Dec 04 00:51:53.066692 master-0 kubenswrapper[33142]: I1204 00:51:53.066661 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1","Type":"ContainerDied","Data":"e94a6286aeda9c6bbca81295e34a44966baec72a012a2c200b44ba220bcb5755"} Dec 04 00:51:53.067813 master-0 kubenswrapper[33142]: I1204 00:51:53.067731 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:54.880587 master-0 kubenswrapper[33142]: I1204 00:51:54.880492 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:51:54.881382 master-0 kubenswrapper[33142]: I1204 00:51:54.880600 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:51:54.882042 master-0 kubenswrapper[33142]: E1204 00:51:54.881868 33142 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/events/console-5fb74f878d-dqq2p.187ddce4f2c9c8f9\": dial tcp 192.168.32.10:6443: connect: connection refused" event=< Dec 04 00:51:54.882042 master-0 kubenswrapper[33142]: &Event{ObjectMeta:{console-5fb74f878d-dqq2p.187ddce4f2c9c8f9 openshift-console 16367 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-console,Name:console-5fb74f878d-dqq2p,UID:b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86,APIVersion:v1,ResourceVersion:15533,FieldPath:spec.containers{console},},Reason:ProbeError,Message:Startup probe error: Get "https://10.128.0.103:8443/health": dial tcp 10.128.0.103:8443: connect: connection refused Dec 04 00:51:54.882042 master-0 kubenswrapper[33142]: body: Dec 04 00:51:54.882042 master-0 kubenswrapper[33142]: ,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:51:44 +0000 UTC,LastTimestamp:2025-12-04 00:51:54.880575036 +0000 UTC m=+287.282576896,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,} Dec 04 00:51:54.882042 master-0 kubenswrapper[33142]: > Dec 04 00:51:55.125594 master-0 kubenswrapper[33142]: I1204 00:51:55.125541 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_f5aa2d6b41f5e21a89224256dc48af14/kube-apiserver-cert-syncer/0.log" Dec 04 00:51:55.127193 master-0 kubenswrapper[33142]: I1204 00:51:55.127137 33142 generic.go:334] "Generic (PLEG): container finished" podID="f5aa2d6b41f5e21a89224256dc48af14" containerID="16ddf7a0f5fadc950f5280850f172d574c8621f3cdfd40608601f3ff4a72b647" exitCode=0 Dec 04 00:51:57.908973 master-0 kubenswrapper[33142]: I1204 00:51:57.908862 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:58.774905 master-0 kubenswrapper[33142]: I1204 00:51:58.774820 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:51:58.775268 master-0 kubenswrapper[33142]: I1204 00:51:58.774905 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:51:59.966212 master-0 kubenswrapper[33142]: E1204 00:51:59.965763 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:59.967063 master-0 kubenswrapper[33142]: E1204 00:51:59.966508 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:59.967163 master-0 kubenswrapper[33142]: E1204 00:51:59.967130 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:59.967846 master-0 kubenswrapper[33142]: E1204 00:51:59.967632 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:59.968354 master-0 kubenswrapper[33142]: E1204 00:51:59.968321 33142 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:51:59.968412 master-0 kubenswrapper[33142]: I1204 00:51:59.968356 33142 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 00:51:59.968912 master-0 kubenswrapper[33142]: E1204 00:51:59.968876 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 00:52:00.172126 master-0 kubenswrapper[33142]: E1204 00:52:00.171948 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 00:52:00.573320 master-0 kubenswrapper[33142]: E1204 00:52:00.573230 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 00:52:01.379244 master-0 kubenswrapper[33142]: E1204 00:52:01.379150 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 00:52:01.491015 master-0 kubenswrapper[33142]: I1204 00:52:01.490942 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:52:01.556104 master-0 kubenswrapper[33142]: I1204 00:52:01.556053 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:52:01.557368 master-0 kubenswrapper[33142]: I1204 00:52:01.557325 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:01.557913 master-0 kubenswrapper[33142]: I1204 00:52:01.557881 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.224634 master-0 kubenswrapper[33142]: I1204 00:52:02.224542 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:52:02.225595 master-0 kubenswrapper[33142]: I1204 00:52:02.225528 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.226661 master-0 kubenswrapper[33142]: I1204 00:52:02.226608 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.527033 master-0 kubenswrapper[33142]: E1204 00:52:02.524399 33142 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/events/console-5fb74f878d-dqq2p.187ddce4f2c9c8f9\": dial tcp 192.168.32.10:6443: connect: connection refused" event=< Dec 04 00:52:02.527033 master-0 kubenswrapper[33142]: &Event{ObjectMeta:{console-5fb74f878d-dqq2p.187ddce4f2c9c8f9 openshift-console 16367 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-console,Name:console-5fb74f878d-dqq2p,UID:b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86,APIVersion:v1,ResourceVersion:15533,FieldPath:spec.containers{console},},Reason:ProbeError,Message:Startup probe error: Get "https://10.128.0.103:8443/health": dial tcp 10.128.0.103:8443: connect: connection refused Dec 04 00:52:02.527033 master-0 kubenswrapper[33142]: body: Dec 04 00:52:02.527033 master-0 kubenswrapper[33142]: ,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 00:51:44 +0000 UTC,LastTimestamp:2025-12-04 00:51:54.880575036 +0000 UTC m=+287.282576896,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,} Dec 04 00:52:02.527033 master-0 kubenswrapper[33142]: > Dec 04 00:52:02.650162 master-0 kubenswrapper[33142]: W1204 00:52:02.650062 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08d11be0e2919664ff2ea4b2440d0e0.slice/crio-43e693f1323752a966de63c6a19b9a6b2f2bd6c3a6c0b1ef0502d91f1135d24c WatchSource:0}: Error finding container 43e693f1323752a966de63c6a19b9a6b2f2bd6c3a6c0b1ef0502d91f1135d24c: Status 404 returned error can't find the container with id 43e693f1323752a966de63c6a19b9a6b2f2bd6c3a6c0b1ef0502d91f1135d24c Dec 04 00:52:02.737245 master-0 kubenswrapper[33142]: I1204 00:52:02.737182 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:52:02.742407 master-0 kubenswrapper[33142]: I1204 00:52:02.742343 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.743213 master-0 kubenswrapper[33142]: I1204 00:52:02.743150 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.749484 master-0 kubenswrapper[33142]: I1204 00:52:02.749449 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_f5aa2d6b41f5e21a89224256dc48af14/kube-apiserver-cert-syncer/0.log" Dec 04 00:52:02.750045 master-0 kubenswrapper[33142]: I1204 00:52:02.750014 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:02.750684 master-0 kubenswrapper[33142]: I1204 00:52:02.750644 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.753028 master-0 kubenswrapper[33142]: I1204 00:52:02.752991 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.753405 master-0 kubenswrapper[33142]: I1204 00:52:02.753368 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:02.841209 master-0 kubenswrapper[33142]: I1204 00:52:02.841114 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock\") pod \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " Dec 04 00:52:02.841433 master-0 kubenswrapper[33142]: I1204 00:52:02.841228 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock" (OuterVolumeSpecName: "var-lock") pod "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" (UID: "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:02.841433 master-0 kubenswrapper[33142]: I1204 00:52:02.841253 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir\") pod \"f5aa2d6b41f5e21a89224256dc48af14\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " Dec 04 00:52:02.841433 master-0 kubenswrapper[33142]: I1204 00:52:02.841396 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir\") pod \"f5aa2d6b41f5e21a89224256dc48af14\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " Dec 04 00:52:02.841612 master-0 kubenswrapper[33142]: I1204 00:52:02.841408 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "f5aa2d6b41f5e21a89224256dc48af14" (UID: "f5aa2d6b41f5e21a89224256dc48af14"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:02.841612 master-0 kubenswrapper[33142]: I1204 00:52:02.841512 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "f5aa2d6b41f5e21a89224256dc48af14" (UID: "f5aa2d6b41f5e21a89224256dc48af14"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:02.841612 master-0 kubenswrapper[33142]: I1204 00:52:02.841560 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access\") pod \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " Dec 04 00:52:02.841785 master-0 kubenswrapper[33142]: I1204 00:52:02.841747 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir\") pod \"f5aa2d6b41f5e21a89224256dc48af14\" (UID: \"f5aa2d6b41f5e21a89224256dc48af14\") " Dec 04 00:52:02.841846 master-0 kubenswrapper[33142]: I1204 00:52:02.841801 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir\") pod \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\" (UID: \"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1\") " Dec 04 00:52:02.841903 master-0 kubenswrapper[33142]: I1204 00:52:02.841862 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "f5aa2d6b41f5e21a89224256dc48af14" (UID: "f5aa2d6b41f5e21a89224256dc48af14"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:02.841965 master-0 kubenswrapper[33142]: I1204 00:52:02.841917 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" (UID: "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:02.842396 master-0 kubenswrapper[33142]: I1204 00:52:02.842348 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.842396 master-0 kubenswrapper[33142]: I1204 00:52:02.842392 33142 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.842490 master-0 kubenswrapper[33142]: I1204 00:52:02.842410 33142 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f5aa2d6b41f5e21a89224256dc48af14-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.842490 master-0 kubenswrapper[33142]: I1204 00:52:02.842431 33142 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.842490 master-0 kubenswrapper[33142]: I1204 00:52:02.842448 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.844758 master-0 kubenswrapper[33142]: I1204 00:52:02.844702 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" (UID: "bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:52:02.944494 master-0 kubenswrapper[33142]: I1204 00:52:02.943900 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:02.984278 master-0 kubenswrapper[33142]: E1204 00:52:02.984189 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 00:52:03.204223 master-0 kubenswrapper[33142]: I1204 00:52:03.204161 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_f5aa2d6b41f5e21a89224256dc48af14/kube-apiserver-cert-syncer/0.log" Dec 04 00:52:03.204983 master-0 kubenswrapper[33142]: I1204 00:52:03.204957 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:03.205088 master-0 kubenswrapper[33142]: I1204 00:52:03.205012 33142 scope.go:117] "RemoveContainer" containerID="fb0a574850f5bf577a94e1f9c68432c425c21763f02b58dffd16f6d55bbcb7c4" Dec 04 00:52:03.207386 master-0 kubenswrapper[33142]: I1204 00:52:03.207179 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"f08d11be0e2919664ff2ea4b2440d0e0","Type":"ContainerStarted","Data":"1b02a20664ef892fb696694801ef5a6e6ebc1b12c2fc6c8ddaaebae4eebe537c"} Dec 04 00:52:03.207386 master-0 kubenswrapper[33142]: I1204 00:52:03.207257 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"f08d11be0e2919664ff2ea4b2440d0e0","Type":"ContainerStarted","Data":"43e693f1323752a966de63c6a19b9a6b2f2bd6c3a6c0b1ef0502d91f1135d24c"} Dec 04 00:52:03.209084 master-0 kubenswrapper[33142]: I1204 00:52:03.209023 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.209220 master-0 kubenswrapper[33142]: E1204 00:52:03.209163 33142 kubelet.go:1929] "Failed creating a mirror pod for" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:52:03.209983 master-0 kubenswrapper[33142]: I1204 00:52:03.209925 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.211038 master-0 kubenswrapper[33142]: I1204 00:52:03.211002 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.211664 master-0 kubenswrapper[33142]: I1204 00:52:03.211637 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1","Type":"ContainerDied","Data":"f54c179b6ea7bd833be415f903ddfd137392821b113ffbda501498a732b4e941"} Dec 04 00:52:03.211807 master-0 kubenswrapper[33142]: I1204 00:52:03.211744 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 00:52:03.211918 master-0 kubenswrapper[33142]: I1204 00:52:03.211756 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f54c179b6ea7bd833be415f903ddfd137392821b113ffbda501498a732b4e941" Dec 04 00:52:03.213749 master-0 kubenswrapper[33142]: I1204 00:52:03.213646 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6f5db8559b-fgz5r" event={"ID":"07652d83-b353-4e4f-b234-c60d7f704e62","Type":"ContainerStarted","Data":"c6b33f19064c4bd5e32d36c4bc3d138f88e8f43f40b665106f91108c20580cc0"} Dec 04 00:52:03.214506 master-0 kubenswrapper[33142]: I1204 00:52:03.214472 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:52:03.216149 master-0 kubenswrapper[33142]: I1204 00:52:03.216050 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.218404 master-0 kubenswrapper[33142]: I1204 00:52:03.218181 33142 patch_prober.go:28] interesting pod/downloads-6f5db8559b-fgz5r container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.128.0.102:8080/\": dial tcp 10.128.0.102:8080: connect: connection refused" start-of-body= Dec 04 00:52:03.218404 master-0 kubenswrapper[33142]: I1204 00:52:03.218316 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6f5db8559b-fgz5r" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" containerName="download-server" probeResult="failure" output="Get \"http://10.128.0.102:8080/\": dial tcp 10.128.0.102:8080: connect: connection refused" Dec 04 00:52:03.218502 master-0 kubenswrapper[33142]: I1204 00:52:03.218432 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.219066 master-0 kubenswrapper[33142]: I1204 00:52:03.219016 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.219453 master-0 kubenswrapper[33142]: I1204 00:52:03.219412 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.221609 master-0 kubenswrapper[33142]: I1204 00:52:03.221154 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.221609 master-0 kubenswrapper[33142]: I1204 00:52:03.221523 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.222356 master-0 kubenswrapper[33142]: I1204 00:52:03.222255 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.223234 master-0 kubenswrapper[33142]: I1204 00:52:03.223154 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.232042 master-0 kubenswrapper[33142]: I1204 00:52:03.231981 33142 scope.go:117] "RemoveContainer" containerID="d9e03a4b5ad6a117210534969ebf8562a889101df45cb5bd4a0436ae4789287d" Dec 04 00:52:03.245211 master-0 kubenswrapper[33142]: I1204 00:52:03.245138 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.245739 master-0 kubenswrapper[33142]: I1204 00:52:03.245701 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.246050 master-0 kubenswrapper[33142]: I1204 00:52:03.246009 33142 status_manager.go:851] "Failed to get status for pod" podUID="f5aa2d6b41f5e21a89224256dc48af14" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.246339 master-0 kubenswrapper[33142]: I1204 00:52:03.246303 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:03.269360 master-0 kubenswrapper[33142]: I1204 00:52:03.269295 33142 scope.go:117] "RemoveContainer" containerID="4df2cb29b82229d73ae3a9909b0f61c318f04f7cf315695a73503bb1f3f366e4" Dec 04 00:52:03.287896 master-0 kubenswrapper[33142]: I1204 00:52:03.287838 33142 scope.go:117] "RemoveContainer" containerID="073116e8ee3ba017c62e6fb773e751e54ee82fd30580131f16aab80e80c914dc" Dec 04 00:52:03.310433 master-0 kubenswrapper[33142]: I1204 00:52:03.309845 33142 scope.go:117] "RemoveContainer" containerID="16ddf7a0f5fadc950f5280850f172d574c8621f3cdfd40608601f3ff4a72b647" Dec 04 00:52:03.337960 master-0 kubenswrapper[33142]: I1204 00:52:03.331377 33142 scope.go:117] "RemoveContainer" containerID="98f621c6d0ddeb12c1cd2dab3190b39e4cd153bdc5002d8036945f6220084134" Dec 04 00:52:03.910399 master-0 kubenswrapper[33142]: I1204 00:52:03.910333 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5aa2d6b41f5e21a89224256dc48af14" path="/var/lib/kubelet/pods/f5aa2d6b41f5e21a89224256dc48af14/volumes" Dec 04 00:52:04.227412 master-0 kubenswrapper[33142]: I1204 00:52:04.227244 33142 patch_prober.go:28] interesting pod/downloads-6f5db8559b-fgz5r container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.128.0.102:8080/\": dial tcp 10.128.0.102:8080: connect: connection refused" start-of-body= Dec 04 00:52:04.227412 master-0 kubenswrapper[33142]: I1204 00:52:04.227370 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6f5db8559b-fgz5r" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" containerName="download-server" probeResult="failure" output="Get \"http://10.128.0.102:8080/\": dial tcp 10.128.0.102:8080: connect: connection refused" Dec 04 00:52:04.880590 master-0 kubenswrapper[33142]: I1204 00:52:04.880513 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:04.880590 master-0 kubenswrapper[33142]: I1204 00:52:04.880579 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:05.819204 master-0 kubenswrapper[33142]: I1204 00:52:05.819130 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" containerName="oauth-openshift" containerID="cri-o://7c3677d545a044ed1570e10df227f82a7498b7a18635e8394eccc48368d9d791" gracePeriod=15 Dec 04 00:52:05.898254 master-0 kubenswrapper[33142]: I1204 00:52:05.898188 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:05.899457 master-0 kubenswrapper[33142]: I1204 00:52:05.899400 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:05.900048 master-0 kubenswrapper[33142]: I1204 00:52:05.900011 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:05.900534 master-0 kubenswrapper[33142]: I1204 00:52:05.900498 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:05.989890 master-0 kubenswrapper[33142]: I1204 00:52:05.980103 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:05.989890 master-0 kubenswrapper[33142]: I1204 00:52:05.980188 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:05.989890 master-0 kubenswrapper[33142]: E1204 00:52:05.981743 33142 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:05.989890 master-0 kubenswrapper[33142]: I1204 00:52:05.982738 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:06.017880 master-0 kubenswrapper[33142]: W1204 00:52:06.017793 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a00233b22d19df39b2e1c8ba133b3c2.slice/crio-b08d7dbd7f5d35e1dd0739caf8c500730f62cf0078f317ccf5735df1d7c91c6a WatchSource:0}: Error finding container b08d7dbd7f5d35e1dd0739caf8c500730f62cf0078f317ccf5735df1d7c91c6a: Status 404 returned error can't find the container with id b08d7dbd7f5d35e1dd0739caf8c500730f62cf0078f317ccf5735df1d7c91c6a Dec 04 00:52:06.190991 master-0 kubenswrapper[33142]: E1204 00:52:06.190904 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 00:52:06.242199 master-0 kubenswrapper[33142]: I1204 00:52:06.242102 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"b08d7dbd7f5d35e1dd0739caf8c500730f62cf0078f317ccf5735df1d7c91c6a"} Dec 04 00:52:06.243934 master-0 kubenswrapper[33142]: I1204 00:52:06.243881 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/2.log" Dec 04 00:52:06.244535 master-0 kubenswrapper[33142]: I1204 00:52:06.244497 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/1.log" Dec 04 00:52:06.245660 master-0 kubenswrapper[33142]: I1204 00:52:06.245624 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" exitCode=1 Dec 04 00:52:06.245713 master-0 kubenswrapper[33142]: I1204 00:52:06.245693 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerDied","Data":"a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1"} Dec 04 00:52:06.245745 master-0 kubenswrapper[33142]: I1204 00:52:06.245737 33142 scope.go:117] "RemoveContainer" containerID="8a8b239f8e00da003ff40a0a6dd3ec2e3a7259428e42b701ae120681eadfdf32" Dec 04 00:52:06.246455 master-0 kubenswrapper[33142]: I1204 00:52:06.246415 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:52:06.246955 master-0 kubenswrapper[33142]: E1204 00:52:06.246889 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-master-0_openshift-kube-controller-manager(295a01fb7c14d9ac3c44b1615db211d7)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:52:06.248196 master-0 kubenswrapper[33142]: I1204 00:52:06.248114 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.249006 master-0 kubenswrapper[33142]: I1204 00:52:06.248922 33142 generic.go:334] "Generic (PLEG): container finished" podID="70d82c00-2cea-43f5-afec-fbac31edec74" containerID="7c3677d545a044ed1570e10df227f82a7498b7a18635e8394eccc48368d9d791" exitCode=0 Dec 04 00:52:06.249092 master-0 kubenswrapper[33142]: I1204 00:52:06.249023 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" event={"ID":"70d82c00-2cea-43f5-afec-fbac31edec74","Type":"ContainerDied","Data":"7c3677d545a044ed1570e10df227f82a7498b7a18635e8394eccc48368d9d791"} Dec 04 00:52:06.257818 master-0 kubenswrapper[33142]: I1204 00:52:06.257744 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.262513 master-0 kubenswrapper[33142]: I1204 00:52:06.262451 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.263057 master-0 kubenswrapper[33142]: I1204 00:52:06.263006 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.351141 master-0 kubenswrapper[33142]: I1204 00:52:06.351057 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:52:06.352325 master-0 kubenswrapper[33142]: I1204 00:52:06.352256 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.352976 master-0 kubenswrapper[33142]: I1204 00:52:06.352888 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.353528 master-0 kubenswrapper[33142]: I1204 00:52:06.353468 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.355088 master-0 kubenswrapper[33142]: I1204 00:52:06.355024 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.356085 master-0 kubenswrapper[33142]: I1204 00:52:06.355988 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:06.499949 master-0 kubenswrapper[33142]: I1204 00:52:06.499751 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.499949 master-0 kubenswrapper[33142]: I1204 00:52:06.499883 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.499949 master-0 kubenswrapper[33142]: I1204 00:52:06.499951 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500010 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500033 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500115 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500160 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500197 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500226 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500251 master-0 kubenswrapper[33142]: I1204 00:52:06.500243 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500520 master-0 kubenswrapper[33142]: I1204 00:52:06.500290 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500520 master-0 kubenswrapper[33142]: I1204 00:52:06.500332 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxxll\" (UniqueName: \"kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.500520 master-0 kubenswrapper[33142]: I1204 00:52:06.500397 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig\") pod \"70d82c00-2cea-43f5-afec-fbac31edec74\" (UID: \"70d82c00-2cea-43f5-afec-fbac31edec74\") " Dec 04 00:52:06.501355 master-0 kubenswrapper[33142]: I1204 00:52:06.501317 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:06.501986 master-0 kubenswrapper[33142]: I1204 00:52:06.501896 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:06.502734 master-0 kubenswrapper[33142]: I1204 00:52:06.502533 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:06.502734 master-0 kubenswrapper[33142]: I1204 00:52:06.502660 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:06.503631 master-0 kubenswrapper[33142]: I1204 00:52:06.503497 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.503976 master-0 kubenswrapper[33142]: I1204 00:52:06.503840 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:06.506109 master-0 kubenswrapper[33142]: I1204 00:52:06.505964 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.506664 master-0 kubenswrapper[33142]: I1204 00:52:06.506418 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.507042 master-0 kubenswrapper[33142]: I1204 00:52:06.506902 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.507042 master-0 kubenswrapper[33142]: I1204 00:52:06.506957 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll" (OuterVolumeSpecName: "kube-api-access-pxxll") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "kube-api-access-pxxll". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:52:06.507042 master-0 kubenswrapper[33142]: I1204 00:52:06.506917 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.507793 master-0 kubenswrapper[33142]: I1204 00:52:06.507681 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.507793 master-0 kubenswrapper[33142]: I1204 00:52:06.507740 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "70d82c00-2cea-43f5-afec-fbac31edec74" (UID: "70d82c00-2cea-43f5-afec-fbac31edec74"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:06.603031 master-0 kubenswrapper[33142]: I1204 00:52:06.602889 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-error\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603031 master-0 kubenswrapper[33142]: I1204 00:52:06.602999 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-login\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603031 master-0 kubenswrapper[33142]: I1204 00:52:06.603023 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603031 master-0 kubenswrapper[33142]: I1204 00:52:06.603045 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603066 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603088 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-session\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603374 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pxxll\" (UniqueName: \"kubernetes.io/projected/70d82c00-2cea-43f5-afec-fbac31edec74-kube-api-access-pxxll\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603497 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-cliconfig\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603529 33142 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/70d82c00-2cea-43f5-afec-fbac31edec74-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.603578 master-0 kubenswrapper[33142]: I1204 00:52:06.603575 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-router-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.604044 master-0 kubenswrapper[33142]: I1204 00:52:06.603602 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-user-template-provider-selection\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.604706 master-0 kubenswrapper[33142]: I1204 00:52:06.604631 33142 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/70d82c00-2cea-43f5-afec-fbac31edec74-v4-0-config-system-ocp-branding-template\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:06.604772 master-0 kubenswrapper[33142]: I1204 00:52:06.604708 33142 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/70d82c00-2cea-43f5-afec-fbac31edec74-audit-policies\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:07.258985 master-0 kubenswrapper[33142]: I1204 00:52:07.258903 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" event={"ID":"70d82c00-2cea-43f5-afec-fbac31edec74","Type":"ContainerDied","Data":"455c7abbebbee162c05f607623bc0266c71c721f80ad62a1caca5ae241d77f09"} Dec 04 00:52:07.259749 master-0 kubenswrapper[33142]: I1204 00:52:07.258970 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" Dec 04 00:52:07.259879 master-0 kubenswrapper[33142]: I1204 00:52:07.259841 33142 scope.go:117] "RemoveContainer" containerID="7c3677d545a044ed1570e10df227f82a7498b7a18635e8394eccc48368d9d791" Dec 04 00:52:07.261222 master-0 kubenswrapper[33142]: I1204 00:52:07.261176 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.261419 master-0 kubenswrapper[33142]: I1204 00:52:07.261293 33142 generic.go:334] "Generic (PLEG): container finished" podID="8a00233b22d19df39b2e1c8ba133b3c2" containerID="880c8492dad74c8e21701964db209e935c83cb593c9261818209716d308398a2" exitCode=0 Dec 04 00:52:07.261419 master-0 kubenswrapper[33142]: I1204 00:52:07.261361 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerDied","Data":"880c8492dad74c8e21701964db209e935c83cb593c9261818209716d308398a2"} Dec 04 00:52:07.262757 master-0 kubenswrapper[33142]: I1204 00:52:07.262679 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.263435 master-0 kubenswrapper[33142]: I1204 00:52:07.263388 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.263998 master-0 kubenswrapper[33142]: I1204 00:52:07.263949 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.266379 master-0 kubenswrapper[33142]: I1204 00:52:07.264636 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.266470 master-0 kubenswrapper[33142]: I1204 00:52:07.266389 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/2.log" Dec 04 00:52:07.317044 master-0 kubenswrapper[33142]: I1204 00:52:07.316985 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.318483 master-0 kubenswrapper[33142]: I1204 00:52:07.318398 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.319331 master-0 kubenswrapper[33142]: I1204 00:52:07.319283 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.320326 master-0 kubenswrapper[33142]: I1204 00:52:07.320264 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.320938 master-0 kubenswrapper[33142]: I1204 00:52:07.320883 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.910475 master-0 kubenswrapper[33142]: I1204 00:52:07.910365 33142 kubelet.go:1505] "Image garbage collection succeeded" Dec 04 00:52:07.915858 master-0 kubenswrapper[33142]: I1204 00:52:07.915765 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.917121 master-0 kubenswrapper[33142]: I1204 00:52:07.917023 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.918112 master-0 kubenswrapper[33142]: I1204 00:52:07.918048 33142 status_manager.go:851] "Failed to get status for pod" podUID="8a00233b22d19df39b2e1c8ba133b3c2" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.918936 master-0 kubenswrapper[33142]: I1204 00:52:07.918856 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.919859 master-0 kubenswrapper[33142]: I1204 00:52:07.919783 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.920756 master-0 kubenswrapper[33142]: I1204 00:52:07.920686 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.939721 master-0 kubenswrapper[33142]: I1204 00:52:07.939610 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6f5db8559b-fgz5r" Dec 04 00:52:07.940667 master-0 kubenswrapper[33142]: I1204 00:52:07.940584 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.941235 master-0 kubenswrapper[33142]: I1204 00:52:07.941174 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.941808 master-0 kubenswrapper[33142]: I1204 00:52:07.941751 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.942336 master-0 kubenswrapper[33142]: I1204 00:52:07.942285 33142 status_manager.go:851] "Failed to get status for pod" podUID="8a00233b22d19df39b2e1c8ba133b3c2" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.943370 master-0 kubenswrapper[33142]: I1204 00:52:07.943307 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:07.944036 master-0 kubenswrapper[33142]: I1204 00:52:07.943951 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.277642 master-0 kubenswrapper[33142]: I1204 00:52:08.277459 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:08.277642 master-0 kubenswrapper[33142]: I1204 00:52:08.277517 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:08.278677 master-0 kubenswrapper[33142]: I1204 00:52:08.278584 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.278677 master-0 kubenswrapper[33142]: E1204 00:52:08.278635 33142 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:08.279796 master-0 kubenswrapper[33142]: I1204 00:52:08.279710 33142 status_manager.go:851] "Failed to get status for pod" podUID="8a00233b22d19df39b2e1c8ba133b3c2" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.280920 master-0 kubenswrapper[33142]: I1204 00:52:08.280663 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.281776 master-0 kubenswrapper[33142]: I1204 00:52:08.281670 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.282751 master-0 kubenswrapper[33142]: I1204 00:52:08.282675 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.283670 master-0 kubenswrapper[33142]: I1204 00:52:08.283601 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.774960 master-0 kubenswrapper[33142]: I1204 00:52:08.774833 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:08.775312 master-0 kubenswrapper[33142]: I1204 00:52:08.774962 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:08.956241 master-0 kubenswrapper[33142]: I1204 00:52:08.956137 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:08.956241 master-0 kubenswrapper[33142]: I1204 00:52:08.956238 33142 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:08.956758 master-0 kubenswrapper[33142]: I1204 00:52:08.956274 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:08.957580 master-0 kubenswrapper[33142]: I1204 00:52:08.957483 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:52:08.958245 master-0 kubenswrapper[33142]: E1204 00:52:08.958179 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-master-0_openshift-kube-controller-manager(295a01fb7c14d9ac3c44b1615db211d7)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:52:08.958419 master-0 kubenswrapper[33142]: I1204 00:52:08.958246 33142 status_manager.go:851] "Failed to get status for pod" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" pod="openshift-kube-apiserver/installer-5-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-5-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.959591 master-0 kubenswrapper[33142]: I1204 00:52:08.959482 33142 status_manager.go:851] "Failed to get status for pod" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" pod="openshift-authentication/oauth-openshift-895d57dc4-nj2gh" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-authentication/pods/oauth-openshift-895d57dc4-nj2gh\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.960743 master-0 kubenswrapper[33142]: I1204 00:52:08.960655 33142 status_manager.go:851] "Failed to get status for pod" podUID="8a00233b22d19df39b2e1c8ba133b3c2" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.961813 master-0 kubenswrapper[33142]: I1204 00:52:08.961737 33142 status_manager.go:851] "Failed to get status for pod" podUID="d6228387-579c-4398-adb0-1057429d2d5a" pod="openshift-monitoring/prometheus-k8s-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-monitoring/pods/prometheus-k8s-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.962640 master-0 kubenswrapper[33142]: I1204 00:52:08.962548 33142 status_manager.go:851] "Failed to get status for pod" podUID="295a01fb7c14d9ac3c44b1615db211d7" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:08.963593 master-0 kubenswrapper[33142]: I1204 00:52:08.963501 33142 status_manager.go:851] "Failed to get status for pod" podUID="07652d83-b353-4e4f-b234-c60d7f704e62" pod="openshift-console/downloads-6f5db8559b-fgz5r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/downloads-6f5db8559b-fgz5r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 00:52:09.285425 master-0 kubenswrapper[33142]: I1204 00:52:09.285232 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:52:09.286088 master-0 kubenswrapper[33142]: E1204 00:52:09.285895 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-master-0_openshift-kube-controller-manager(295a01fb7c14d9ac3c44b1615db211d7)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:52:10.296681 master-0 kubenswrapper[33142]: I1204 00:52:10.296612 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"9f6c9d439e54784e5bb6121cf8c16bda042ed63f3fafc9d1e9cf45f91c98005c"} Dec 04 00:52:10.296681 master-0 kubenswrapper[33142]: I1204 00:52:10.296662 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"a57968010d06f2210173e2e492a4517053bd8291734c8dfbe2221e9bd6c88e9c"} Dec 04 00:52:10.296681 master-0 kubenswrapper[33142]: I1204 00:52:10.296672 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"63b4399c1d9a17a10fca1589583715428c2d9063fcc0f7886983319c1f732505"} Dec 04 00:52:11.311076 master-0 kubenswrapper[33142]: I1204 00:52:11.311007 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"ef49d03a272c7e1244bbbba5fd424e4ee2610f54681a3687273ac215d5fc1b2c"} Dec 04 00:52:11.311076 master-0 kubenswrapper[33142]: I1204 00:52:11.311068 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"536517b0726665cfa92708c2298448aedb5a4d6cc6d561109193cd3736043a75"} Dec 04 00:52:11.311710 master-0 kubenswrapper[33142]: I1204 00:52:11.311331 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:11.311710 master-0 kubenswrapper[33142]: I1204 00:52:11.311347 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:11.311710 master-0 kubenswrapper[33142]: I1204 00:52:11.311573 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:14.880715 master-0 kubenswrapper[33142]: I1204 00:52:14.880644 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:14.881800 master-0 kubenswrapper[33142]: I1204 00:52:14.881475 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:15.983194 master-0 kubenswrapper[33142]: I1204 00:52:15.983118 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:15.983194 master-0 kubenswrapper[33142]: I1204 00:52:15.983199 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:18.774911 master-0 kubenswrapper[33142]: I1204 00:52:18.774827 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:18.774911 master-0 kubenswrapper[33142]: I1204 00:52:18.774907 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:20.554990 master-0 kubenswrapper[33142]: E1204 00:52:20.554693 33142 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:52:10Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:52:10Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:52:10Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T00:52:10Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d886210d2faa9ace5750adfc70c0c3c5512cdf492f19d1c536a446db659aabb\\\"],\\\"sizeBytes\\\":2890256335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a17e9d83aeb6de5f0851aaacd1a9ebddbc8a4ac3ece2e4af8670aa0c33b8fc9c\\\"],\\\"sizeBytes\\\":1631769045},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:98ce2d349f8bc693d76d9a68097b758b987cf17ea3beb66bbd09d12fa78b4d0c\\\"],\\\"sizeBytes\\\":1232076476},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:4281dc4ce2dd0685040e3d669b44cc2fc945c529f1e03e9a1e3948bc04801e98\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:fd045934f63cfcd06ea917296b90880c5b44256817e606d698b5afe226829128\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201545551},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a31af646ce5587c051459a88df413dc30be81e7f15399aa909e19effa7de772a\\\"],\\\"sizeBytes\\\":983731853},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0bb91faa6e9f82b589a6535665e51517abe4a1b2eb5d0b3a36b36df6a5330a0\\\"],\\\"sizeBytes\\\":938321573},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3c0962dbbad51633a7d97ef253d0249269bfe3bbef3bfe99a99457470e7a682\\\"],\\\"sizeBytes\\\":912736453},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfc0403f71f7c926db1084c7fb5fb4f19007271213ee34f6f3d3eecdbe817d6b\\\"],\\\"sizeBytes\\\":874839630},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f313372fe49afad871cc56225dcd4d31bed249abeab55fb288e1f854138fbf\\\"],\\\"sizeBytes\\\":870581225},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc72da7f7930eb09abf6f8dbe577bb537e3a2a59dc0e14a4319b42c0212218d1\\\"],\\\"sizeBytes\\\":857083855},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a38d71a75c4fa803249cc709d60039d14878e218afd88a86083526ee8f78ad\\\"],\\\"sizeBytes\\\":856674149},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0e5c0acdd03dc840d7345ae397feaf6147a32a8fef89a0ac2ddc8d14b068c9ff\\\"],\\\"sizeBytes\\\":767313881},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:184239929f74bb7c56c1cf5b94b5f91dd4013a87034fe04b9fa1027d2bb6c5a4\\\"],\\\"sizeBytes\\\":682385666},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d866f93bed16cfebd8019ad6b89a4dd4abedfc20ee5d28d7edad045e7df0fda\\\"],\\\"sizeBytes\\\":677540255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b99ce0f31213291444482af4af36345dc93acdbe965868073e8232797b8a2f14\\\"],\\\"sizeBytes\\\":672854011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da806db797ef2b291ff0ce5f302e88a0cb74e57f253b8fe76296f969512cd79e\\\"],\\\"sizeBytes\\\":628318378},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff94e909d3b037c815e8ae67989a7616936e67195b758abac6b5d3f0d59562c8\\\"],\\\"sizeBytes\\\":616123373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:78f6aebe76fa9da71b631ceced1ed159d8b60a6fa8e0325fd098c7b029039e89\\\"],\\\"sizeBytes\\\":600181603},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da6f62afd2795d1b0af69532a5534c099bbb81d4e7abd2616b374db191552c51\\\"],\\\"sizeBytes\\\":583850203},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51a4c20765f54b6a6b5513f97cf54bb99631c2abe860949293456886a74f87fe\\\"],\\\"sizeBytes\\\":576621883},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dc9758be9f0f0a480fb5e119ecb1e1101ef807bdc765a155212a8188d79b9e60\\\"],\\\"sizeBytes\\\":552687886},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32236659da74056138c839429f304a96ba36dd304d7eefb6b2618ecfdf6308e3\\\"],\\\"sizeBytes\\\":551903461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e8903affdf29401b9a86b9f58795c9f445f34194960c7b2734f30601c48cbdf\\\"],\\\"sizeBytes\\\":543241813},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c921698d30c8175da0c124f72748e93551d6903b0f34d26743b60cb12d25cb1\\\"],\\\"sizeBytes\\\":532668041},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ceaa4102b35e54be54e23c8ea73bb0dac4978cffb54105ad00b51393f47595da\\\"],\\\"sizeBytes\\\":532338751},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca4933b9ba55069205ea53970128c4e8c4b46560ef721c8aaee00aaf736664b5\\\"],\\\"sizeBytes\\\":512852463},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:98c80d92a2ef8d44ee625b229b77b7bfdb1b06cbfe0d4df9e2ca2cba904467f7\\\"],\\\"sizeBytes\\\":512468025},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91cbda9693e888881e7c45cd6e504b91ba8a203fe0596237a4a17b3ca4e18eef\\\"],\\\"sizeBytes\\\":509451797},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae8c6193ace2c439dd93d8129f68f3704727650851a628c906bff9290940ef03\\\"],\\\"sizeBytes\\\":508056015},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a2ef63f356c11ba629d8038474ab287797340de1219b4fee97c386975689110\\\"],\\\"sizeBytes\\\":507701628},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:84a52132860e74998981b76c08d38543561197c3da77836c670fa8e394c5ec17\\\"],\\\"sizeBytes\\\":506755373},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89b279931fe13f3b33c9dd6cdf0f5e7fc3e5384b944f998034d35af7242a47fa\\\"],\\\"sizeBytes\\\":506716062},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:492103a8365ef9a1d5f237b4ba90aff87369167ec91db29ff0251ba5aab2b419\\\"],\\\"sizeBytes\\\":505663073},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c2b518cb834a0b6ca50d73eceb5f8e64aefb09094d39e4ba0d8e4632f6cdf908\\\"],\\\"sizeBytes\\\":505642108},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:58ed827ee19ac91b6f860d307797b24b8aec02e671605388c4afe4fa19ddfc36\\\"],\\\"sizeBytes\\\":503354646},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefdc67602b8bc3941001b030ab95d82e10432f814634b80eb8ce45bc9ebd3de\\\"],\\\"sizeBytes\\\":503025552},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3051af3343018fecbf3a6edacea69de841fc5211c09e7fb6a2499188dc979395\\\"],\\\"sizeBytes\\\":502450335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cb6ecfb89e53653b69ae494ebc940b9fcf7b7db317b156e186435cc541589d9\\\"],\\\"sizeBytes\\\":500957387},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d835ce07d1bec4a4b13f0bca5ea20ea5c781ea7853d7b42310f4ad8aeba6d7c\\\"],\\\"sizeBytes\\\":500863090},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49a6a3308d885301c7718a465f1af2d08a617abbdff23352d5422d1ae4af33cf\\\"],\\\"sizeBytes\\\":499812475},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e254a7fb8a2643817718cfdb54bc819e86eb84232f6e2456548c55c5efb09d2\\\"],\\\"sizeBytes\\\":499719811},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44e82a51fce7b5996b183c10c44bd79b0e1ae2257fd5809345fbca1c50aaa08f\\\"],\\\"sizeBytes\\\":499138950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:93145fd0c004dc4fca21435a32c7e55e962f321aff260d702f387cfdebee92a5\\\"],\\\"sizeBytes\\\":499096673},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e955ac7de27deecd1a88d06c08a1b7a43e867cadf4289f20a6ab982fa647e6b7\\\"],\\\"sizeBytes\\\":497188567},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0c6de747539dd00ede882fb4f73cead462bf0a7efda7173fd5d443ef7a00251\\\"],\\\"sizeBytes\\\":490470354},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6199be91b821875ba2609cf7fa886b74b9a8b573622fe33cc1bc39cd55acac08\\\"],\\\"sizeBytes\\\":489542560},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ebd79294a663cb38370ae81f9cda91cef7fb1370ec5b495b4bdb95e77272e6a8\\\"],\\\"sizeBytes\\\":481573011}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": context deadline exceeded" Dec 04 00:52:22.592020 master-0 kubenswrapper[33142]: E1204 00:52:22.591889 33142 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": context deadline exceeded" interval="7s" Dec 04 00:52:22.979028 master-0 kubenswrapper[33142]: I1204 00:52:22.978947 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:23.900745 master-0 kubenswrapper[33142]: I1204 00:52:23.900620 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:52:23.901880 master-0 kubenswrapper[33142]: E1204 00:52:23.901706 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-master-0_openshift-kube-controller-manager(295a01fb7c14d9ac3c44b1615db211d7)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" Dec 04 00:52:24.883158 master-0 kubenswrapper[33142]: I1204 00:52:24.883063 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:24.883519 master-0 kubenswrapper[33142]: I1204 00:52:24.883188 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:25.961867 master-0 kubenswrapper[33142]: I1204 00:52:25.961784 33142 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:25.983849 master-0 kubenswrapper[33142]: I1204 00:52:25.983764 33142 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Liveness probe status=failure output="Get \"https://192.168.32.10:17697/healthz\": dial tcp 192.168.32.10:17697: connect: connection refused" start-of-body= Dec 04 00:52:25.984100 master-0 kubenswrapper[33142]: I1204 00:52:25.983879 33142 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="8a00233b22d19df39b2e1c8ba133b3c2" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.32.10:17697/healthz\": dial tcp 192.168.32.10:17697: connect: connection refused" Dec 04 00:52:25.984531 master-0 kubenswrapper[33142]: I1204 00:52:25.984476 33142 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.32.10:17697/healthz\": dial tcp 192.168.32.10:17697: connect: connection refused" start-of-body= Dec 04 00:52:25.984587 master-0 kubenswrapper[33142]: I1204 00:52:25.984549 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="8a00233b22d19df39b2e1c8ba133b3c2" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.32.10:17697/healthz\": dial tcp 192.168.32.10:17697: connect: connection refused" Dec 04 00:52:25.992882 master-0 kubenswrapper[33142]: I1204 00:52:25.992830 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:26.709774 master-0 kubenswrapper[33142]: I1204 00:52:26.709686 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 00:52:27.053669 master-0 kubenswrapper[33142]: I1204 00:52:27.053442 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 00:52:27.160823 master-0 kubenswrapper[33142]: I1204 00:52:27.160706 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:52:27.481773 master-0 kubenswrapper[33142]: I1204 00:52:27.481699 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-check-endpoints/0.log" Dec 04 00:52:27.484512 master-0 kubenswrapper[33142]: I1204 00:52:27.484467 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 00:52:27.484691 master-0 kubenswrapper[33142]: I1204 00:52:27.484637 33142 generic.go:334] "Generic (PLEG): container finished" podID="8a00233b22d19df39b2e1c8ba133b3c2" containerID="ef49d03a272c7e1244bbbba5fd424e4ee2610f54681a3687273ac215d5fc1b2c" exitCode=255 Dec 04 00:52:27.484735 master-0 kubenswrapper[33142]: I1204 00:52:27.484700 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerDied","Data":"ef49d03a272c7e1244bbbba5fd424e4ee2610f54681a3687273ac215d5fc1b2c"} Dec 04 00:52:27.684278 master-0 kubenswrapper[33142]: I1204 00:52:27.684186 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 00:52:27.741339 master-0 kubenswrapper[33142]: I1204 00:52:27.741218 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 00:52:27.840955 master-0 kubenswrapper[33142]: I1204 00:52:27.840843 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 00:52:27.858975 master-0 kubenswrapper[33142]: I1204 00:52:27.858854 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 00:52:28.201230 master-0 kubenswrapper[33142]: I1204 00:52:28.201169 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 00:52:28.290192 master-0 kubenswrapper[33142]: I1204 00:52:28.290119 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 00:52:28.394055 master-0 kubenswrapper[33142]: I1204 00:52:28.394008 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-tls" Dec 04 00:52:28.427150 master-0 kubenswrapper[33142]: I1204 00:52:28.427082 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 00:52:28.493660 master-0 kubenswrapper[33142]: I1204 00:52:28.493544 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 00:52:28.572433 master-0 kubenswrapper[33142]: I1204 00:52:28.572344 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"federate-client-certs" Dec 04 00:52:28.575895 master-0 kubenswrapper[33142]: I1204 00:52:28.575848 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 00:52:28.714316 master-0 kubenswrapper[33142]: I1204 00:52:28.714263 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"trusted-ca" Dec 04 00:52:28.776805 master-0 kubenswrapper[33142]: I1204 00:52:28.776636 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:28.776805 master-0 kubenswrapper[33142]: I1204 00:52:28.776721 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:28.893230 master-0 kubenswrapper[33142]: I1204 00:52:28.893178 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 00:52:29.051444 master-0 kubenswrapper[33142]: I1204 00:52:29.051323 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 00:52:29.102737 master-0 kubenswrapper[33142]: I1204 00:52:29.102662 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 00:52:29.150072 master-0 kubenswrapper[33142]: I1204 00:52:29.149980 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-8qsb6" Dec 04 00:52:29.174520 master-0 kubenswrapper[33142]: I1204 00:52:29.174441 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 00:52:29.221321 master-0 kubenswrapper[33142]: I1204 00:52:29.221219 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Dec 04 00:52:29.458530 master-0 kubenswrapper[33142]: I1204 00:52:29.458432 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 00:52:29.522473 master-0 kubenswrapper[33142]: I1204 00:52:29.522343 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 00:52:29.533533 master-0 kubenswrapper[33142]: I1204 00:52:29.533467 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 00:52:29.572965 master-0 kubenswrapper[33142]: I1204 00:52:29.572824 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 00:52:29.610604 master-0 kubenswrapper[33142]: I1204 00:52:29.610519 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 00:52:29.650208 master-0 kubenswrapper[33142]: I1204 00:52:29.650114 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 00:52:29.663613 master-0 kubenswrapper[33142]: I1204 00:52:29.663535 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 00:52:29.735866 master-0 kubenswrapper[33142]: I1204 00:52:29.735685 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 00:52:29.746236 master-0 kubenswrapper[33142]: I1204 00:52:29.746148 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 00:52:29.774351 master-0 kubenswrapper[33142]: I1204 00:52:29.774303 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 00:52:29.802802 master-0 kubenswrapper[33142]: I1204 00:52:29.802712 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:52:29.860662 master-0 kubenswrapper[33142]: I1204 00:52:29.860584 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-dockercfg-868vg" Dec 04 00:52:29.978197 master-0 kubenswrapper[33142]: I1204 00:52:29.978093 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:52:29.981197 master-0 kubenswrapper[33142]: I1204 00:52:29.981139 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 00:52:30.068406 master-0 kubenswrapper[33142]: I1204 00:52:30.068251 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:52:30.084551 master-0 kubenswrapper[33142]: I1204 00:52:30.084468 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:52:30.270789 master-0 kubenswrapper[33142]: I1204 00:52:30.270688 33142 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 00:52:30.281791 master-0 kubenswrapper[33142]: I1204 00:52:30.281718 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 00:52:30.331774 master-0 kubenswrapper[33142]: I1204 00:52:30.331603 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-grlj9" Dec 04 00:52:30.505864 master-0 kubenswrapper[33142]: I1204 00:52:30.505764 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 00:52:30.507954 master-0 kubenswrapper[33142]: I1204 00:52:30.507889 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 00:52:30.583771 master-0 kubenswrapper[33142]: I1204 00:52:30.583631 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 00:52:30.701142 master-0 kubenswrapper[33142]: I1204 00:52:30.701058 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 00:52:30.727462 master-0 kubenswrapper[33142]: I1204 00:52:30.727384 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 00:52:30.943773 master-0 kubenswrapper[33142]: I1204 00:52:30.943696 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 00:52:30.982692 master-0 kubenswrapper[33142]: I1204 00:52:30.982644 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 00:52:31.058806 master-0 kubenswrapper[33142]: I1204 00:52:31.058754 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 00:52:31.083561 master-0 kubenswrapper[33142]: I1204 00:52:31.083507 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-lmpqm" Dec 04 00:52:31.115007 master-0 kubenswrapper[33142]: I1204 00:52:31.114952 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-f6xzw" Dec 04 00:52:31.227752 master-0 kubenswrapper[33142]: I1204 00:52:31.227472 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 00:52:31.244272 master-0 kubenswrapper[33142]: I1204 00:52:31.243919 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 00:52:31.294048 master-0 kubenswrapper[33142]: I1204 00:52:31.290694 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 00:52:31.350893 master-0 kubenswrapper[33142]: I1204 00:52:31.350835 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-kube-rbac-proxy-config" Dec 04 00:52:31.367033 master-0 kubenswrapper[33142]: I1204 00:52:31.366949 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 00:52:31.371059 master-0 kubenswrapper[33142]: I1204 00:52:31.368733 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"monitoring-plugin-cert" Dec 04 00:52:31.372059 master-0 kubenswrapper[33142]: I1204 00:52:31.371997 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 00:52:31.389153 master-0 kubenswrapper[33142]: I1204 00:52:31.389082 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 00:52:31.443616 master-0 kubenswrapper[33142]: I1204 00:52:31.443540 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 00:52:31.471206 master-0 kubenswrapper[33142]: I1204 00:52:31.470461 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-94kgq" Dec 04 00:52:31.565592 master-0 kubenswrapper[33142]: I1204 00:52:31.565470 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 00:52:31.601389 master-0 kubenswrapper[33142]: I1204 00:52:31.601305 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client" Dec 04 00:52:31.606230 master-0 kubenswrapper[33142]: I1204 00:52:31.606146 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 00:52:31.643362 master-0 kubenswrapper[33142]: I1204 00:52:31.643287 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 00:52:31.651202 master-0 kubenswrapper[33142]: I1204 00:52:31.651142 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 00:52:31.710054 master-0 kubenswrapper[33142]: I1204 00:52:31.709965 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 00:52:31.713945 master-0 kubenswrapper[33142]: I1204 00:52:31.713867 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 00:52:31.772162 master-0 kubenswrapper[33142]: I1204 00:52:31.772065 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 00:52:31.781951 master-0 kubenswrapper[33142]: I1204 00:52:31.781881 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 00:52:31.811713 master-0 kubenswrapper[33142]: I1204 00:52:31.811636 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 00:52:31.873152 master-0 kubenswrapper[33142]: I1204 00:52:31.873095 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 00:52:31.881414 master-0 kubenswrapper[33142]: I1204 00:52:31.881345 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 00:52:31.913305 master-0 kubenswrapper[33142]: I1204 00:52:31.913203 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 00:52:31.945156 master-0 kubenswrapper[33142]: I1204 00:52:31.945049 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 00:52:31.959720 master-0 kubenswrapper[33142]: I1204 00:52:31.959641 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 00:52:31.995007 master-0 kubenswrapper[33142]: I1204 00:52:31.994909 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 00:52:32.046540 master-0 kubenswrapper[33142]: I1204 00:52:32.046413 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 00:52:32.102467 master-0 kubenswrapper[33142]: I1204 00:52:32.102294 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 00:52:32.212523 master-0 kubenswrapper[33142]: I1204 00:52:32.212397 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"cluster-samples-operator-dockercfg-rmj52" Dec 04 00:52:32.224579 master-0 kubenswrapper[33142]: I1204 00:52:32.224492 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-hkhgp" Dec 04 00:52:32.277026 master-0 kubenswrapper[33142]: I1204 00:52:32.276963 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-client-serving-certs-ca-bundle" Dec 04 00:52:32.293471 master-0 kubenswrapper[33142]: I1204 00:52:32.293392 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 00:52:32.474127 master-0 kubenswrapper[33142]: I1204 00:52:32.473948 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-gvp2m" Dec 04 00:52:32.474913 master-0 kubenswrapper[33142]: I1204 00:52:32.474165 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 00:52:32.533841 master-0 kubenswrapper[33142]: I1204 00:52:32.533726 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:32.533841 master-0 kubenswrapper[33142]: I1204 00:52:32.533789 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="36fdd0be-7863-4892-a770-79a6daec75cc" Dec 04 00:52:32.618279 master-0 kubenswrapper[33142]: I1204 00:52:32.618151 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-rjr9s" Dec 04 00:52:32.705114 master-0 kubenswrapper[33142]: I1204 00:52:32.705027 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 00:52:32.705114 master-0 kubenswrapper[33142]: I1204 00:52:32.705027 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 00:52:32.707650 master-0 kubenswrapper[33142]: I1204 00:52:32.707585 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 00:52:32.709444 master-0 kubenswrapper[33142]: I1204 00:52:32.709404 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Dec 04 00:52:32.732862 master-0 kubenswrapper[33142]: I1204 00:52:32.732696 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 00:52:32.802297 master-0 kubenswrapper[33142]: I1204 00:52:32.802221 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 00:52:32.845249 master-0 kubenswrapper[33142]: I1204 00:52:32.845153 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 00:52:32.885335 master-0 kubenswrapper[33142]: I1204 00:52:32.885254 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 00:52:32.886901 master-0 kubenswrapper[33142]: I1204 00:52:32.886868 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 00:52:32.912150 master-0 kubenswrapper[33142]: I1204 00:52:32.912047 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-zrkxd" Dec 04 00:52:32.937667 master-0 kubenswrapper[33142]: I1204 00:52:32.937567 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 00:52:32.973845 master-0 kubenswrapper[33142]: I1204 00:52:32.973733 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 00:52:32.983495 master-0 kubenswrapper[33142]: I1204 00:52:32.983347 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 00:52:33.005189 master-0 kubenswrapper[33142]: I1204 00:52:33.005115 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"console-operator-dockercfg-l9lk8" Dec 04 00:52:33.014086 master-0 kubenswrapper[33142]: I1204 00:52:33.014017 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 00:52:33.121017 master-0 kubenswrapper[33142]: I1204 00:52:33.120900 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:52:33.217275 master-0 kubenswrapper[33142]: I1204 00:52:33.217209 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 00:52:33.368515 master-0 kubenswrapper[33142]: I1204 00:52:33.368424 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4xsx2" Dec 04 00:52:33.395793 master-0 kubenswrapper[33142]: I1204 00:52:33.395738 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 00:52:33.459570 master-0 kubenswrapper[33142]: I1204 00:52:33.459496 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 00:52:33.488104 master-0 kubenswrapper[33142]: I1204 00:52:33.488023 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 00:52:33.533474 master-0 kubenswrapper[33142]: I1204 00:52:33.533408 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 00:52:33.556421 master-0 kubenswrapper[33142]: I1204 00:52:33.556354 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 00:52:33.634025 master-0 kubenswrapper[33142]: I1204 00:52:33.633779 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 00:52:33.648875 master-0 kubenswrapper[33142]: I1204 00:52:33.648791 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"serving-cert" Dec 04 00:52:33.651789 master-0 kubenswrapper[33142]: I1204 00:52:33.651711 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 00:52:33.672305 master-0 kubenswrapper[33142]: I1204 00:52:33.672244 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 00:52:33.689497 master-0 kubenswrapper[33142]: I1204 00:52:33.689392 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 00:52:33.733245 master-0 kubenswrapper[33142]: I1204 00:52:33.733151 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-d7vtk" Dec 04 00:52:33.841991 master-0 kubenswrapper[33142]: I1204 00:52:33.841879 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 00:52:33.842587 master-0 kubenswrapper[33142]: I1204 00:52:33.842553 33142 scope.go:117] "RemoveContainer" containerID="ef49d03a272c7e1244bbbba5fd424e4ee2610f54681a3687273ac215d5fc1b2c" Dec 04 00:52:33.847139 master-0 kubenswrapper[33142]: I1204 00:52:33.843353 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="8a00233b22d19df39b2e1c8ba133b3c2" podUID="fb620739-98ed-4d72-99e4-9ac719e3c7fc" Dec 04 00:52:33.859900 master-0 kubenswrapper[33142]: I1204 00:52:33.857154 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 00:52:33.893083 master-0 kubenswrapper[33142]: I1204 00:52:33.889797 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-web" Dec 04 00:52:33.947803 master-0 kubenswrapper[33142]: I1204 00:52:33.947741 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 00:52:34.021371 master-0 kubenswrapper[33142]: I1204 00:52:34.021260 33142 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 00:52:34.025837 master-0 kubenswrapper[33142]: I1204 00:52:34.025482 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-6f5db8559b-fgz5r" podStartSLOduration=32.799929803 podStartE2EDuration="1m7.025465721s" podCreationTimestamp="2025-12-04 00:51:27 +0000 UTC" firstStartedPulling="2025-12-04 00:51:28.589676662 +0000 UTC m=+260.991678512" lastFinishedPulling="2025-12-04 00:52:02.81521257 +0000 UTC m=+295.217214430" observedRunningTime="2025-12-04 00:52:33.986076137 +0000 UTC m=+326.388078017" watchObservedRunningTime="2025-12-04 00:52:34.025465721 +0000 UTC m=+326.427467581" Dec 04 00:52:34.031833 master-0 kubenswrapper[33142]: I1204 00:52:34.031761 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-895d57dc4-nj2gh","openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:52:34.032093 master-0 kubenswrapper[33142]: I1204 00:52:34.031877 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-6dd96bc56-2k2q7","openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 00:52:34.032530 master-0 kubenswrapper[33142]: E1204 00:52:34.032467 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" containerName="oauth-openshift" Dec 04 00:52:34.032530 master-0 kubenswrapper[33142]: I1204 00:52:34.032527 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" containerName="oauth-openshift" Dec 04 00:52:34.032629 master-0 kubenswrapper[33142]: E1204 00:52:34.032552 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" containerName="installer" Dec 04 00:52:34.032629 master-0 kubenswrapper[33142]: I1204 00:52:34.032563 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" containerName="installer" Dec 04 00:52:34.032782 master-0 kubenswrapper[33142]: I1204 00:52:34.032746 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" containerName="oauth-openshift" Dec 04 00:52:34.032839 master-0 kubenswrapper[33142]: I1204 00:52:34.032816 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1" containerName="installer" Dec 04 00:52:34.033784 master-0 kubenswrapper[33142]: I1204 00:52:34.033737 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.039095 master-0 kubenswrapper[33142]: I1204 00:52:34.039042 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Dec 04 00:52:34.039205 master-0 kubenswrapper[33142]: I1204 00:52:34.039104 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Dec 04 00:52:34.039468 master-0 kubenswrapper[33142]: I1204 00:52:34.039436 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-k98bs" Dec 04 00:52:34.039729 master-0 kubenswrapper[33142]: I1204 00:52:34.039682 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Dec 04 00:52:34.039729 master-0 kubenswrapper[33142]: I1204 00:52:34.039715 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Dec 04 00:52:34.039858 master-0 kubenswrapper[33142]: I1204 00:52:34.039838 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Dec 04 00:52:34.039913 master-0 kubenswrapper[33142]: I1204 00:52:34.039685 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Dec 04 00:52:34.040285 master-0 kubenswrapper[33142]: I1204 00:52:34.040051 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Dec 04 00:52:34.040285 master-0 kubenswrapper[33142]: I1204 00:52:34.040111 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Dec 04 00:52:34.043683 master-0 kubenswrapper[33142]: I1204 00:52:34.041696 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Dec 04 00:52:34.043683 master-0 kubenswrapper[33142]: I1204 00:52:34.042380 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Dec 04 00:52:34.043683 master-0 kubenswrapper[33142]: I1204 00:52:34.042838 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Dec 04 00:52:34.053517 master-0 kubenswrapper[33142]: I1204 00:52:34.053407 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Dec 04 00:52:34.055020 master-0 kubenswrapper[33142]: I1204 00:52:34.054959 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 00:52:34.062651 master-0 kubenswrapper[33142]: I1204 00:52:34.062566 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Dec 04 00:52:34.106679 master-0 kubenswrapper[33142]: I1204 00:52:34.106293 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 00:52:34.116058 master-0 kubenswrapper[33142]: I1204 00:52:34.116017 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Dec 04 00:52:34.117377 master-0 kubenswrapper[33142]: I1204 00:52:34.117341 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-kfhzx" Dec 04 00:52:34.127763 master-0 kubenswrapper[33142]: I1204 00:52:34.127717 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127874 master-0 kubenswrapper[33142]: I1204 00:52:34.127774 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-session\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127874 master-0 kubenswrapper[33142]: I1204 00:52:34.127832 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-service-ca\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127874 master-0 kubenswrapper[33142]: I1204 00:52:34.127864 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-dir\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127981 master-0 kubenswrapper[33142]: I1204 00:52:34.127892 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-error\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127981 master-0 kubenswrapper[33142]: I1204 00:52:34.127916 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftnfh\" (UniqueName: \"kubernetes.io/projected/3d1f393a-2463-4144-a276-3673bdeae8a2-kube-api-access-ftnfh\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.127981 master-0 kubenswrapper[33142]: I1204 00:52:34.127956 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128071 master-0 kubenswrapper[33142]: I1204 00:52:34.127990 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-router-certs\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128071 master-0 kubenswrapper[33142]: I1204 00:52:34.128019 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128071 master-0 kubenswrapper[33142]: I1204 00:52:34.128060 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-policies\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128160 master-0 kubenswrapper[33142]: I1204 00:52:34.128094 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128160 master-0 kubenswrapper[33142]: I1204 00:52:34.128117 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-login\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.128160 master-0 kubenswrapper[33142]: I1204 00:52:34.128134 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.178805 master-0 kubenswrapper[33142]: I1204 00:52:34.177677 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 00:52:34.186626 master-0 kubenswrapper[33142]: I1204 00:52:34.186569 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 00:52:34.207111 master-0 kubenswrapper[33142]: I1204 00:52:34.207020 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 00:52:34.230163 master-0 kubenswrapper[33142]: I1204 00:52:34.230028 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-session\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230206 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-service-ca\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230258 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-dir\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230288 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-error\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230316 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ftnfh\" (UniqueName: \"kubernetes.io/projected/3d1f393a-2463-4144-a276-3673bdeae8a2-kube-api-access-ftnfh\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230369 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.230468 master-0 kubenswrapper[33142]: I1204 00:52:34.230413 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-router-certs\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231514 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231602 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-policies\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231737 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231761 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-login\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231785 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233129 master-0 kubenswrapper[33142]: I1204 00:52:34.231869 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233686 master-0 kubenswrapper[33142]: I1204 00:52:34.233634 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-error\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233872 master-0 kubenswrapper[33142]: I1204 00:52:34.230436 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-dir\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233953 master-0 kubenswrapper[33142]: I1204 00:52:34.231359 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.233953 master-0 kubenswrapper[33142]: I1204 00:52:34.233887 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-router-certs\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.234058 master-0 kubenswrapper[33142]: I1204 00:52:34.233948 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-session\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.234058 master-0 kubenswrapper[33142]: I1204 00:52:34.231518 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-service-ca\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.234447 master-0 kubenswrapper[33142]: I1204 00:52:34.234408 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-audit-policies\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.234777 master-0 kubenswrapper[33142]: I1204 00:52:34.234737 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.235168 master-0 kubenswrapper[33142]: I1204 00:52:34.235129 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.236057 master-0 kubenswrapper[33142]: I1204 00:52:34.236018 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.236515 master-0 kubenswrapper[33142]: I1204 00:52:34.236478 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-user-template-login\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.242501 master-0 kubenswrapper[33142]: I1204 00:52:34.242214 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d1f393a-2463-4144-a276-3673bdeae8a2-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.255100 master-0 kubenswrapper[33142]: I1204 00:52:34.255009 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftnfh\" (UniqueName: \"kubernetes.io/projected/3d1f393a-2463-4144-a276-3673bdeae8a2-kube-api-access-ftnfh\") pod \"oauth-openshift-6dd96bc56-2k2q7\" (UID: \"3d1f393a-2463-4144-a276-3673bdeae8a2\") " pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.323303 master-0 kubenswrapper[33142]: I1204 00:52:34.323239 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 00:52:34.360572 master-0 kubenswrapper[33142]: I1204 00:52:34.360503 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:34.383833 master-0 kubenswrapper[33142]: I1204 00:52:34.383767 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 00:52:34.401894 master-0 kubenswrapper[33142]: I1204 00:52:34.401816 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 00:52:34.405312 master-0 kubenswrapper[33142]: I1204 00:52:34.405247 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 00:52:34.407786 master-0 kubenswrapper[33142]: I1204 00:52:34.407711 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 00:52:34.409440 master-0 kubenswrapper[33142]: I1204 00:52:34.409401 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 00:52:34.432546 master-0 kubenswrapper[33142]: I1204 00:52:34.432323 33142 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 00:52:34.552615 master-0 kubenswrapper[33142]: I1204 00:52:34.552564 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-check-endpoints/0.log" Dec 04 00:52:34.555236 master-0 kubenswrapper[33142]: I1204 00:52:34.555204 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"8a00233b22d19df39b2e1c8ba133b3c2","Type":"ContainerStarted","Data":"332bab77d3bd8026e1c2724451dcc8426ba2bbabf1acae0fb26380e4912b87b4"} Dec 04 00:52:34.555963 master-0 kubenswrapper[33142]: I1204 00:52:34.555872 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:34.583029 master-0 kubenswrapper[33142]: I1204 00:52:34.582959 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=4.5829211789999995 podStartE2EDuration="4.582921179s" podCreationTimestamp="2025-12-04 00:52:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:52:34.581457848 +0000 UTC m=+326.983459718" watchObservedRunningTime="2025-12-04 00:52:34.582921179 +0000 UTC m=+326.984923049" Dec 04 00:52:34.629956 master-0 kubenswrapper[33142]: I1204 00:52:34.627272 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 00:52:34.706486 master-0 kubenswrapper[33142]: I1204 00:52:34.706362 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:52:34.707848 master-0 kubenswrapper[33142]: I1204 00:52:34.707813 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 00:52:34.797681 master-0 kubenswrapper[33142]: I1204 00:52:34.797608 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"openshift-service-ca.crt" Dec 04 00:52:34.850460 master-0 kubenswrapper[33142]: I1204 00:52:34.850399 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 00:52:34.880266 master-0 kubenswrapper[33142]: I1204 00:52:34.880192 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 00:52:34.881354 master-0 kubenswrapper[33142]: I1204 00:52:34.881303 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:34.881445 master-0 kubenswrapper[33142]: I1204 00:52:34.881386 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:34.886454 master-0 kubenswrapper[33142]: I1204 00:52:34.886392 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 00:52:34.994125 master-0 kubenswrapper[33142]: I1204 00:52:34.993969 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 00:52:34.994519 master-0 kubenswrapper[33142]: I1204 00:52:34.994474 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 00:52:35.011330 master-0 kubenswrapper[33142]: I1204 00:52:35.011258 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"default-dockercfg-l9wg2" Dec 04 00:52:35.026498 master-0 kubenswrapper[33142]: I1204 00:52:35.026450 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 00:52:35.035311 master-0 kubenswrapper[33142]: I1204 00:52:35.035248 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 00:52:35.299247 master-0 kubenswrapper[33142]: I1204 00:52:35.299030 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:52:35.365404 master-0 kubenswrapper[33142]: I1204 00:52:35.365250 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 00:52:35.371374 master-0 kubenswrapper[33142]: I1204 00:52:35.371302 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 00:52:35.379288 master-0 kubenswrapper[33142]: I1204 00:52:35.379227 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 00:52:35.398532 master-0 kubenswrapper[33142]: I1204 00:52:35.398480 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-metrics" Dec 04 00:52:35.402064 master-0 kubenswrapper[33142]: I1204 00:52:35.402010 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 00:52:35.481103 master-0 kubenswrapper[33142]: I1204 00:52:35.481016 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 00:52:35.503518 master-0 kubenswrapper[33142]: I1204 00:52:35.503425 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 00:52:35.513697 master-0 kubenswrapper[33142]: I1204 00:52:35.513607 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:52:35.533961 master-0 kubenswrapper[33142]: I1204 00:52:35.533880 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 00:52:35.546041 master-0 kubenswrapper[33142]: I1204 00:52:35.545923 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 00:52:35.609684 master-0 kubenswrapper[33142]: I1204 00:52:35.609597 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 00:52:35.684470 master-0 kubenswrapper[33142]: I1204 00:52:35.684381 33142 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 00:52:35.722893 master-0 kubenswrapper[33142]: I1204 00:52:35.722835 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"kube-root-ca.crt" Dec 04 00:52:35.726261 master-0 kubenswrapper[33142]: I1204 00:52:35.726208 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 00:52:35.745502 master-0 kubenswrapper[33142]: I1204 00:52:35.745453 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 00:52:35.777583 master-0 kubenswrapper[33142]: I1204 00:52:35.777492 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 00:52:35.849742 master-0 kubenswrapper[33142]: I1204 00:52:35.849673 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 00:52:35.909452 master-0 kubenswrapper[33142]: I1204 00:52:35.909238 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d82c00-2cea-43f5-afec-fbac31edec74" path="/var/lib/kubelet/pods/70d82c00-2cea-43f5-afec-fbac31edec74/volumes" Dec 04 00:52:36.052788 master-0 kubenswrapper[33142]: I1204 00:52:36.052687 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 00:52:36.078986 master-0 kubenswrapper[33142]: I1204 00:52:36.078906 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 00:52:36.209871 master-0 kubenswrapper[33142]: I1204 00:52:36.209674 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 00:52:36.304538 master-0 kubenswrapper[33142]: I1204 00:52:36.304428 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 00:52:36.348019 master-0 kubenswrapper[33142]: I1204 00:52:36.347901 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 00:52:36.459254 master-0 kubenswrapper[33142]: I1204 00:52:36.459163 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Dec 04 00:52:36.506605 master-0 kubenswrapper[33142]: I1204 00:52:36.506452 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 00:52:36.530043 master-0 kubenswrapper[33142]: I1204 00:52:36.529979 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"console-operator-config" Dec 04 00:52:36.551192 master-0 kubenswrapper[33142]: I1204 00:52:36.551122 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 00:52:36.568594 master-0 kubenswrapper[33142]: I1204 00:52:36.568526 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-dockercfg-87ldl" Dec 04 00:52:36.591560 master-0 kubenswrapper[33142]: I1204 00:52:36.591484 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-68bvv" Dec 04 00:52:36.611623 master-0 kubenswrapper[33142]: I1204 00:52:36.611539 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 00:52:36.645813 master-0 kubenswrapper[33142]: I1204 00:52:36.645702 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-wmf68" Dec 04 00:52:36.649278 master-0 kubenswrapper[33142]: I1204 00:52:36.649219 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-pvgwv" Dec 04 00:52:36.675255 master-0 kubenswrapper[33142]: I1204 00:52:36.675165 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-x6jwn" Dec 04 00:52:36.739803 master-0 kubenswrapper[33142]: I1204 00:52:36.739717 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 00:52:36.790161 master-0 kubenswrapper[33142]: I1204 00:52:36.789954 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 00:52:36.863429 master-0 kubenswrapper[33142]: I1204 00:52:36.863340 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 00:52:36.865553 master-0 kubenswrapper[33142]: I1204 00:52:36.865521 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 00:52:36.892890 master-0 kubenswrapper[33142]: I1204 00:52:36.892792 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 00:52:36.976733 master-0 kubenswrapper[33142]: I1204 00:52:36.976672 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 00:52:37.000393 master-0 kubenswrapper[33142]: I1204 00:52:37.000289 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 00:52:37.005601 master-0 kubenswrapper[33142]: I1204 00:52:37.005546 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 00:52:37.026999 master-0 kubenswrapper[33142]: I1204 00:52:37.026913 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-sk926" Dec 04 00:52:37.064893 master-0 kubenswrapper[33142]: I1204 00:52:37.064768 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-dockercfg-lcjtq" Dec 04 00:52:37.092395 master-0 kubenswrapper[33142]: I1204 00:52:37.092169 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 00:52:37.133509 master-0 kubenswrapper[33142]: I1204 00:52:37.133442 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 00:52:37.240584 master-0 kubenswrapper[33142]: I1204 00:52:37.240529 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-xscpn" Dec 04 00:52:37.343420 master-0 kubenswrapper[33142]: I1204 00:52:37.343280 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:52:37.364034 master-0 kubenswrapper[33142]: I1204 00:52:37.363892 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 00:52:37.385264 master-0 kubenswrapper[33142]: I1204 00:52:37.385175 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 00:52:37.451059 master-0 kubenswrapper[33142]: I1204 00:52:37.451002 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-mfl95" Dec 04 00:52:37.455762 master-0 kubenswrapper[33142]: I1204 00:52:37.455709 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:52:37.478091 master-0 kubenswrapper[33142]: I1204 00:52:37.477950 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-p78gv" Dec 04 00:52:37.501642 master-0 kubenswrapper[33142]: I1204 00:52:37.501542 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-9s98x" Dec 04 00:52:37.511519 master-0 kubenswrapper[33142]: I1204 00:52:37.511441 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 00:52:37.657071 master-0 kubenswrapper[33142]: I1204 00:52:37.657019 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 00:52:37.815110 master-0 kubenswrapper[33142]: I1204 00:52:37.814975 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 00:52:37.893539 master-0 kubenswrapper[33142]: I1204 00:52:37.893448 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:52:37.927540 master-0 kubenswrapper[33142]: I1204 00:52:37.927392 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 00:52:37.953270 master-0 kubenswrapper[33142]: I1204 00:52:37.953180 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 00:52:37.960944 master-0 kubenswrapper[33142]: I1204 00:52:37.960859 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 00:52:37.998080 master-0 kubenswrapper[33142]: I1204 00:52:37.997982 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 00:52:38.085049 master-0 kubenswrapper[33142]: I1204 00:52:38.084958 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 00:52:38.115229 master-0 kubenswrapper[33142]: I1204 00:52:38.115156 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 00:52:38.209228 master-0 kubenswrapper[33142]: I1204 00:52:38.209090 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-dnxpd" Dec 04 00:52:38.245554 master-0 kubenswrapper[33142]: I1204 00:52:38.245461 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 00:52:38.247616 master-0 kubenswrapper[33142]: I1204 00:52:38.247574 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Dec 04 00:52:38.260363 master-0 kubenswrapper[33142]: I1204 00:52:38.260312 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-zg65n" Dec 04 00:52:38.275988 master-0 kubenswrapper[33142]: I1204 00:52:38.275892 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 00:52:38.399053 master-0 kubenswrapper[33142]: I1204 00:52:38.398959 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 00:52:38.443642 master-0 kubenswrapper[33142]: I1204 00:52:38.443530 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 00:52:38.508099 master-0 kubenswrapper[33142]: I1204 00:52:38.507911 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 00:52:38.559972 master-0 kubenswrapper[33142]: I1204 00:52:38.559839 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 00:52:38.577396 master-0 kubenswrapper[33142]: I1204 00:52:38.577307 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 00:52:38.582856 master-0 kubenswrapper[33142]: I1204 00:52:38.582780 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 00:52:38.582856 master-0 kubenswrapper[33142]: I1204 00:52:38.582839 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:52:38.620645 master-0 kubenswrapper[33142]: I1204 00:52:38.620563 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 00:52:38.691208 master-0 kubenswrapper[33142]: I1204 00:52:38.691090 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 00:52:38.699470 master-0 kubenswrapper[33142]: I1204 00:52:38.699411 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 00:52:38.704548 master-0 kubenswrapper[33142]: I1204 00:52:38.704484 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-dockercfg-pzz8t" Dec 04 00:52:38.774869 master-0 kubenswrapper[33142]: I1204 00:52:38.774639 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 00:52:38.776056 master-0 kubenswrapper[33142]: I1204 00:52:38.775982 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:38.776237 master-0 kubenswrapper[33142]: I1204 00:52:38.776079 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:38.777214 master-0 kubenswrapper[33142]: I1204 00:52:38.777167 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 00:52:38.807571 master-0 kubenswrapper[33142]: I1204 00:52:38.807477 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 00:52:38.839655 master-0 kubenswrapper[33142]: I1204 00:52:38.839576 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 00:52:38.854584 master-0 kubenswrapper[33142]: I1204 00:52:38.854484 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 00:52:38.885513 master-0 kubenswrapper[33142]: I1204 00:52:38.885434 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 00:52:38.899318 master-0 kubenswrapper[33142]: I1204 00:52:38.899250 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:52:38.915519 master-0 kubenswrapper[33142]: I1204 00:52:38.915460 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-1rpv9olfurpru" Dec 04 00:52:38.989155 master-0 kubenswrapper[33142]: I1204 00:52:38.989040 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 00:52:39.115495 master-0 kubenswrapper[33142]: I1204 00:52:39.115425 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-6dd96bc56-2k2q7"] Dec 04 00:52:39.157666 master-0 kubenswrapper[33142]: I1204 00:52:39.157596 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 00:52:39.213018 master-0 kubenswrapper[33142]: I1204 00:52:39.212909 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 00:52:39.247109 master-0 kubenswrapper[33142]: I1204 00:52:39.247036 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 00:52:39.286665 master-0 kubenswrapper[33142]: I1204 00:52:39.286603 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 00:52:39.389965 master-0 kubenswrapper[33142]: I1204 00:52:39.389311 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 00:52:39.529129 master-0 kubenswrapper[33142]: I1204 00:52:39.524368 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 00:52:39.560216 master-0 kubenswrapper[33142]: I1204 00:52:39.560150 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 00:52:39.567032 master-0 kubenswrapper[33142]: I1204 00:52:39.566947 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 00:52:39.615961 master-0 kubenswrapper[33142]: I1204 00:52:39.614898 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/2.log" Dec 04 00:52:39.615961 master-0 kubenswrapper[33142]: I1204 00:52:39.615816 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"295a01fb7c14d9ac3c44b1615db211d7","Type":"ContainerStarted","Data":"dafec2eef03d87ac491eeba79aebadb73a2644b0bfc16f504f9227d6a66b8866"} Dec 04 00:52:39.670482 master-0 kubenswrapper[33142]: I1204 00:52:39.670346 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:52:39.679597 master-0 kubenswrapper[33142]: I1204 00:52:39.679553 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 00:52:39.698062 master-0 kubenswrapper[33142]: I1204 00:52:39.694469 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 00:52:39.826099 master-0 kubenswrapper[33142]: I1204 00:52:39.824141 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-br9vs" Dec 04 00:52:39.876676 master-0 kubenswrapper[33142]: I1204 00:52:39.876610 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 00:52:39.877593 master-0 kubenswrapper[33142]: E1204 00:52:39.877511 33142 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:52:39.877593 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91" Netns:"/var/run/netns/2cd54992-886c-46ca-b2cc-97833d43f416" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:39.877593 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:39.877593 master-0 kubenswrapper[33142]: > Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: E1204 00:52:39.877639 33142 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91" Netns:"/var/run/netns/2cd54992-886c-46ca-b2cc-97833d43f416" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: E1204 00:52:39.877666 33142 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91" Netns:"/var/run/netns/2cd54992-886c-46ca-b2cc-97833d43f416" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:39.877774 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:39.878161 master-0 kubenswrapper[33142]: E1204 00:52:39.877777 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91\\\" Netns:\\\"/var/run/netns/2cd54992-886c-46ca-b2cc-97833d43f416\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=70a44668b88c9f06b478e5c10d1049ce6dc30b67a5ddedbcb5c13193b3b4af91;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod \\\"oauth-openshift-6dd96bc56-2k2q7\\\" not found\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" podUID="3d1f393a-2463-4144-a276-3673bdeae8a2" Dec 04 00:52:39.883358 master-0 kubenswrapper[33142]: I1204 00:52:39.883308 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 00:52:40.137344 master-0 kubenswrapper[33142]: I1204 00:52:40.137232 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 00:52:40.146133 master-0 kubenswrapper[33142]: I1204 00:52:40.146081 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 00:52:40.150040 master-0 kubenswrapper[33142]: I1204 00:52:40.149971 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-b7gnv" Dec 04 00:52:40.239057 master-0 kubenswrapper[33142]: I1204 00:52:40.238262 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 00:52:40.281266 master-0 kubenswrapper[33142]: I1204 00:52:40.281189 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-trusted-ca-bundle-56c9b9fa8d9gs" Dec 04 00:52:40.286097 master-0 kubenswrapper[33142]: I1204 00:52:40.286052 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Dec 04 00:52:40.366237 master-0 kubenswrapper[33142]: I1204 00:52:40.366114 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-33dcm3qc457cs" Dec 04 00:52:40.366237 master-0 kubenswrapper[33142]: I1204 00:52:40.366129 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 00:52:40.605732 master-0 kubenswrapper[33142]: I1204 00:52:40.605347 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:52:40.625720 master-0 kubenswrapper[33142]: I1204 00:52:40.625643 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:40.626552 master-0 kubenswrapper[33142]: I1204 00:52:40.626495 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:40.875592 master-0 kubenswrapper[33142]: I1204 00:52:40.875398 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 00:52:40.882348 master-0 kubenswrapper[33142]: I1204 00:52:40.880494 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 00:52:40.895216 master-0 kubenswrapper[33142]: I1204 00:52:40.895122 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 00:52:40.901339 master-0 kubenswrapper[33142]: I1204 00:52:40.901276 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"default-dockercfg-9f6gp" Dec 04 00:52:40.979533 master-0 kubenswrapper[33142]: I1204 00:52:40.979462 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 00:52:41.061517 master-0 kubenswrapper[33142]: I1204 00:52:41.061406 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-7kmmpv795dabm" Dec 04 00:52:41.173728 master-0 kubenswrapper[33142]: I1204 00:52:41.173570 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 00:52:41.199812 master-0 kubenswrapper[33142]: I1204 00:52:41.199746 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 00:52:41.202311 master-0 kubenswrapper[33142]: I1204 00:52:41.202252 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 00:52:41.268708 master-0 kubenswrapper[33142]: I1204 00:52:41.268629 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 00:52:41.374596 master-0 kubenswrapper[33142]: I1204 00:52:41.374524 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 00:52:41.430132 master-0 kubenswrapper[33142]: I1204 00:52:41.429918 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 00:52:41.607118 master-0 kubenswrapper[33142]: I1204 00:52:41.607048 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-wdzq5" Dec 04 00:52:41.683715 master-0 kubenswrapper[33142]: I1204 00:52:41.683542 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 00:52:41.698060 master-0 kubenswrapper[33142]: I1204 00:52:41.698013 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 00:52:41.791251 master-0 kubenswrapper[33142]: I1204 00:52:41.791171 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-tls" Dec 04 00:52:41.903319 master-0 kubenswrapper[33142]: I1204 00:52:41.903241 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 00:52:41.904269 master-0 kubenswrapper[33142]: I1204 00:52:41.903416 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-cmtsx" Dec 04 00:52:41.935508 master-0 kubenswrapper[33142]: I1204 00:52:41.935354 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Dec 04 00:52:44.008487 master-0 kubenswrapper[33142]: E1204 00:52:44.008404 33142 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:52:44.008487 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696" Netns:"/var/run/netns/6664f18a-36da-4533-99d5-28333cb5bb44" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:44.008487 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:44.008487 master-0 kubenswrapper[33142]: > Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: E1204 00:52:44.008518 33142 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696" Netns:"/var/run/netns/6664f18a-36da-4533-99d5-28333cb5bb44" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: E1204 00:52:44.008585 33142 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696" Netns:"/var/run/netns/6664f18a-36da-4533-99d5-28333cb5bb44" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:44.008915 master-0 kubenswrapper[33142]: E1204 00:52:44.008679 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696\\\" Netns:\\\"/var/run/netns/6664f18a-36da-4533-99d5-28333cb5bb44\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=99a9fde3d80b41193652ae947cc46c2a1810d760c0d7a2f30b6975f20f449696;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod \\\"oauth-openshift-6dd96bc56-2k2q7\\\" not found\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" podUID="3d1f393a-2463-4144-a276-3673bdeae8a2" Dec 04 00:52:44.880778 master-0 kubenswrapper[33142]: I1204 00:52:44.880662 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:44.880778 master-0 kubenswrapper[33142]: I1204 00:52:44.880754 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:45.991001 master-0 kubenswrapper[33142]: I1204 00:52:45.990868 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 00:52:48.707651 master-0 kubenswrapper[33142]: I1204 00:52:48.707538 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 00:52:48.775507 master-0 kubenswrapper[33142]: I1204 00:52:48.775348 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:48.775895 master-0 kubenswrapper[33142]: I1204 00:52:48.775519 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:48.956635 master-0 kubenswrapper[33142]: I1204 00:52:48.956544 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:48.956635 master-0 kubenswrapper[33142]: I1204 00:52:48.956644 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:48.963282 master-0 kubenswrapper[33142]: I1204 00:52:48.962872 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:49.730731 master-0 kubenswrapper[33142]: I1204 00:52:49.730634 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:52:52.264974 master-0 kubenswrapper[33142]: I1204 00:52:52.264871 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 00:52:52.265852 master-0 kubenswrapper[33142]: I1204 00:52:52.265282 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="f08d11be0e2919664ff2ea4b2440d0e0" containerName="startup-monitor" containerID="cri-o://1b02a20664ef892fb696694801ef5a6e6ebc1b12c2fc6c8ddaaebae4eebe537c" gracePeriod=5 Dec 04 00:52:52.908359 master-0 kubenswrapper[33142]: I1204 00:52:52.908289 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy" Dec 04 00:52:53.238400 master-0 kubenswrapper[33142]: I1204 00:52:53.238193 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 00:52:53.925069 master-0 kubenswrapper[33142]: I1204 00:52:53.925020 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 00:52:53.977480 master-0 kubenswrapper[33142]: I1204 00:52:53.977418 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 00:52:54.880875 master-0 kubenswrapper[33142]: I1204 00:52:54.880729 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:52:54.881399 master-0 kubenswrapper[33142]: I1204 00:52:54.881336 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:52:57.178039 master-0 kubenswrapper[33142]: I1204 00:52:57.160785 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 00:52:57.415682 master-0 kubenswrapper[33142]: I1204 00:52:57.415615 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 00:52:57.674740 master-0 kubenswrapper[33142]: I1204 00:52:57.673974 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:52:57.674740 master-0 kubenswrapper[33142]: I1204 00:52:57.674471 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerName="route-controller-manager" containerID="cri-o://5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d" gracePeriod=30 Dec 04 00:52:57.713331 master-0 kubenswrapper[33142]: I1204 00:52:57.713243 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:52:57.713737 master-0 kubenswrapper[33142]: I1204 00:52:57.713668 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" podUID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" containerName="controller-manager" containerID="cri-o://c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042" gracePeriod=30 Dec 04 00:52:57.826370 master-0 kubenswrapper[33142]: I1204 00:52:57.825043 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_f08d11be0e2919664ff2ea4b2440d0e0/startup-monitor/0.log" Dec 04 00:52:57.826370 master-0 kubenswrapper[33142]: I1204 00:52:57.825113 33142 generic.go:334] "Generic (PLEG): container finished" podID="f08d11be0e2919664ff2ea4b2440d0e0" containerID="1b02a20664ef892fb696694801ef5a6e6ebc1b12c2fc6c8ddaaebae4eebe537c" exitCode=137 Dec 04 00:52:57.878410 master-0 kubenswrapper[33142]: I1204 00:52:57.878354 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_f08d11be0e2919664ff2ea4b2440d0e0/startup-monitor/0.log" Dec 04 00:52:57.878657 master-0 kubenswrapper[33142]: I1204 00:52:57.878455 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:52:57.898108 master-0 kubenswrapper[33142]: I1204 00:52:57.898012 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:57.907790 master-0 kubenswrapper[33142]: I1204 00:52:57.905112 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.027978 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir\") pod \"f08d11be0e2919664ff2ea4b2440d0e0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.028038 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock\") pod \"f08d11be0e2919664ff2ea4b2440d0e0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.028089 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log\") pod \"f08d11be0e2919664ff2ea4b2440d0e0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.028241 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests\") pod \"f08d11be0e2919664ff2ea4b2440d0e0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.028326 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir\") pod \"f08d11be0e2919664ff2ea4b2440d0e0\" (UID: \"f08d11be0e2919664ff2ea4b2440d0e0\") " Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.029464 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "f08d11be0e2919664ff2ea4b2440d0e0" (UID: "f08d11be0e2919664ff2ea4b2440d0e0"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.029499 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock" (OuterVolumeSpecName: "var-lock") pod "f08d11be0e2919664ff2ea4b2440d0e0" (UID: "f08d11be0e2919664ff2ea4b2440d0e0"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.029524 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log" (OuterVolumeSpecName: "var-log") pod "f08d11be0e2919664ff2ea4b2440d0e0" (UID: "f08d11be0e2919664ff2ea4b2440d0e0"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:58.070879 master-0 kubenswrapper[33142]: I1204 00:52:58.029546 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests" (OuterVolumeSpecName: "manifests") pod "f08d11be0e2919664ff2ea4b2440d0e0" (UID: "f08d11be0e2919664ff2ea4b2440d0e0"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:58.100543 master-0 kubenswrapper[33142]: I1204 00:52:58.099605 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "f08d11be0e2919664ff2ea4b2440d0e0" (UID: "f08d11be0e2919664ff2ea4b2440d0e0"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:52:58.135619 master-0 kubenswrapper[33142]: I1204 00:52:58.135547 33142 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.135619 master-0 kubenswrapper[33142]: I1204 00:52:58.135594 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.135619 master-0 kubenswrapper[33142]: I1204 00:52:58.135605 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.135619 master-0 kubenswrapper[33142]: I1204 00:52:58.135613 33142 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.135619 master-0 kubenswrapper[33142]: I1204 00:52:58.135623 33142 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f08d11be0e2919664ff2ea4b2440d0e0-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.142741 master-0 kubenswrapper[33142]: I1204 00:52:58.142695 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:52:58.236845 master-0 kubenswrapper[33142]: I1204 00:52:58.236718 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") pod \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " Dec 04 00:52:58.236845 master-0 kubenswrapper[33142]: I1204 00:52:58.236807 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") pod \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " Dec 04 00:52:58.237387 master-0 kubenswrapper[33142]: I1204 00:52:58.236875 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") pod \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " Dec 04 00:52:58.237387 master-0 kubenswrapper[33142]: I1204 00:52:58.237064 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") pod \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\" (UID: \"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5\") " Dec 04 00:52:58.237535 master-0 kubenswrapper[33142]: I1204 00:52:58.237478 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca" (OuterVolumeSpecName: "client-ca") pod "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:58.239743 master-0 kubenswrapper[33142]: I1204 00:52:58.239695 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:58.242223 master-0 kubenswrapper[33142]: I1204 00:52:58.241936 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf" (OuterVolumeSpecName: "kube-api-access-wmjvf") pod "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5"). InnerVolumeSpecName "kube-api-access-wmjvf". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:52:58.244188 master-0 kubenswrapper[33142]: I1204 00:52:58.244112 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config" (OuterVolumeSpecName: "config") pod "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" (UID: "2cfd1a75-01c6-488b-aed9-646f1c4ce0f5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:58.255203 master-0 kubenswrapper[33142]: I1204 00:52:58.255156 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:52:58.338289 master-0 kubenswrapper[33142]: I1204 00:52:58.338238 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") pod \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " Dec 04 00:52:58.339071 master-0 kubenswrapper[33142]: I1204 00:52:58.338311 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") pod \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " Dec 04 00:52:58.339071 master-0 kubenswrapper[33142]: I1204 00:52:58.338346 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") pod \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " Dec 04 00:52:58.339071 master-0 kubenswrapper[33142]: I1204 00:52:58.338484 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") pod \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " Dec 04 00:52:58.339071 master-0 kubenswrapper[33142]: I1204 00:52:58.338544 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") pod \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\" (UID: \"e3545341-90a7-42fe-9ba4-bf6e71ef776e\") " Dec 04 00:52:58.339071 master-0 kubenswrapper[33142]: I1204 00:52:58.338794 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca" (OuterVolumeSpecName: "client-ca") pod "e3545341-90a7-42fe-9ba4-bf6e71ef776e" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.339439 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config" (OuterVolumeSpecName: "config") pod "e3545341-90a7-42fe-9ba4-bf6e71ef776e" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340093 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340116 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340126 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340135 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340147 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wmjvf\" (UniqueName: \"kubernetes.io/projected/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5-kube-api-access-wmjvf\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340178 master-0 kubenswrapper[33142]: I1204 00:52:58.340158 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.340406 master-0 kubenswrapper[33142]: I1204 00:52:58.340292 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "e3545341-90a7-42fe-9ba4-bf6e71ef776e" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:52:58.341223 master-0 kubenswrapper[33142]: I1204 00:52:58.341191 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "e3545341-90a7-42fe-9ba4-bf6e71ef776e" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:52:58.343573 master-0 kubenswrapper[33142]: I1204 00:52:58.343534 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7" (OuterVolumeSpecName: "kube-api-access-xtxx7") pod "e3545341-90a7-42fe-9ba4-bf6e71ef776e" (UID: "e3545341-90a7-42fe-9ba4-bf6e71ef776e"). InnerVolumeSpecName "kube-api-access-xtxx7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:52:58.442302 master-0 kubenswrapper[33142]: I1204 00:52:58.442221 33142 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/e3545341-90a7-42fe-9ba4-bf6e71ef776e-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.442302 master-0 kubenswrapper[33142]: I1204 00:52:58.442278 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3545341-90a7-42fe-9ba4-bf6e71ef776e-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.442302 master-0 kubenswrapper[33142]: I1204 00:52:58.442293 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xtxx7\" (UniqueName: \"kubernetes.io/projected/e3545341-90a7-42fe-9ba4-bf6e71ef776e-kube-api-access-xtxx7\") on node \"master-0\" DevicePath \"\"" Dec 04 00:52:58.775542 master-0 kubenswrapper[33142]: I1204 00:52:58.775397 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:52:58.775542 master-0 kubenswrapper[33142]: I1204 00:52:58.775470 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:52:58.793160 master-0 kubenswrapper[33142]: I1204 00:52:58.793086 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:52:58.838615 master-0 kubenswrapper[33142]: I1204 00:52:58.838518 33142 generic.go:334] "Generic (PLEG): container finished" podID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" containerID="c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042" exitCode=0 Dec 04 00:52:58.838894 master-0 kubenswrapper[33142]: I1204 00:52:58.838639 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" event={"ID":"e3545341-90a7-42fe-9ba4-bf6e71ef776e","Type":"ContainerDied","Data":"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042"} Dec 04 00:52:58.838894 master-0 kubenswrapper[33142]: I1204 00:52:58.838750 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" event={"ID":"e3545341-90a7-42fe-9ba4-bf6e71ef776e","Type":"ContainerDied","Data":"9e74c8aa0085da61623f0bf3fefb268a885afd2a58f3a60c89709f198dbd2046"} Dec 04 00:52:58.838894 master-0 kubenswrapper[33142]: I1204 00:52:58.838780 33142 scope.go:117] "RemoveContainer" containerID="c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042" Dec 04 00:52:58.838894 master-0 kubenswrapper[33142]: I1204 00:52:58.838784 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6555cd6548-djfrg" Dec 04 00:52:58.842917 master-0 kubenswrapper[33142]: I1204 00:52:58.842873 33142 generic.go:334] "Generic (PLEG): container finished" podID="aa2eaba9-479e-4420-a24f-63530e4da783" containerID="92792118dd0a5a1a1c921b14d629d4d25ef671bee8053d80a341b1994ffec4a3" exitCode=0 Dec 04 00:52:58.842917 master-0 kubenswrapper[33142]: I1204 00:52:58.842961 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerDied","Data":"92792118dd0a5a1a1c921b14d629d4d25ef671bee8053d80a341b1994ffec4a3"} Dec 04 00:52:58.844337 master-0 kubenswrapper[33142]: I1204 00:52:58.844310 33142 scope.go:117] "RemoveContainer" containerID="92792118dd0a5a1a1c921b14d629d4d25ef671bee8053d80a341b1994ffec4a3" Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.845739 33142 generic.go:334] "Generic (PLEG): container finished" podID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerID="5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d" exitCode=0 Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.845880 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" event={"ID":"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5","Type":"ContainerDied","Data":"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d"} Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.845941 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" event={"ID":"2cfd1a75-01c6-488b-aed9-646f1c4ce0f5","Type":"ContainerDied","Data":"bb9177a080ed1b106bdaeb1a2367b61577b324c4b6f26682b71fd1f7b51c2dc2"} Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.846048 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.848014 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_f08d11be0e2919664ff2ea4b2440d0e0/startup-monitor/0.log" Dec 04 00:52:58.849186 master-0 kubenswrapper[33142]: I1204 00:52:58.848183 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 00:52:58.867687 master-0 kubenswrapper[33142]: I1204 00:52:58.863280 33142 scope.go:117] "RemoveContainer" containerID="c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042" Dec 04 00:52:58.867687 master-0 kubenswrapper[33142]: E1204 00:52:58.863801 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042\": container with ID starting with c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042 not found: ID does not exist" containerID="c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042" Dec 04 00:52:58.867687 master-0 kubenswrapper[33142]: I1204 00:52:58.863829 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042"} err="failed to get container status \"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042\": rpc error: code = NotFound desc = could not find container \"c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042\": container with ID starting with c036341024e9ef18afc3e21a9bca557c323307f4d1b0a5957b3f1a51b4afb042 not found: ID does not exist" Dec 04 00:52:58.867687 master-0 kubenswrapper[33142]: I1204 00:52:58.863850 33142 scope.go:117] "RemoveContainer" containerID="3e564eaa133ad97cd8257db05ea8ede6eb35352ddf102da22803b6a64c6af076" Dec 04 00:52:58.913826 master-0 kubenswrapper[33142]: I1204 00:52:58.913757 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:52:58.921443 master-0 kubenswrapper[33142]: I1204 00:52:58.921387 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-6555cd6548-djfrg"] Dec 04 00:52:58.947336 master-0 kubenswrapper[33142]: I1204 00:52:58.947267 33142 scope.go:117] "RemoveContainer" containerID="5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d" Dec 04 00:52:58.993613 master-0 kubenswrapper[33142]: I1204 00:52:58.993565 33142 scope.go:117] "RemoveContainer" containerID="5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d" Dec 04 00:52:58.994346 master-0 kubenswrapper[33142]: E1204 00:52:58.994298 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d\": container with ID starting with 5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d not found: ID does not exist" containerID="5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d" Dec 04 00:52:58.994423 master-0 kubenswrapper[33142]: I1204 00:52:58.994348 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d"} err="failed to get container status \"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d\": rpc error: code = NotFound desc = could not find container \"5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d\": container with ID starting with 5378d8d4586cd23a91489ef0b58691f77f7bef1e7660a6d9e2d3248889b6034d not found: ID does not exist" Dec 04 00:52:58.994423 master-0 kubenswrapper[33142]: I1204 00:52:58.994379 33142 scope.go:117] "RemoveContainer" containerID="1b02a20664ef892fb696694801ef5a6e6ebc1b12c2fc6c8ddaaebae4eebe537c" Dec 04 00:52:59.003535 master-0 kubenswrapper[33142]: I1204 00:52:59.003493 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:52:59.012832 master-0 kubenswrapper[33142]: I1204 00:52:59.012757 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb"] Dec 04 00:52:59.081917 master-0 kubenswrapper[33142]: I1204 00:52:59.081812 33142 patch_prober.go:28] interesting pod/route-controller-manager-64497d959b-vghsb container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.81:8443/healthz\": dial tcp 10.128.0.81:8443: i/o timeout" start-of-body= Dec 04 00:52:59.082233 master-0 kubenswrapper[33142]: I1204 00:52:59.081962 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-64497d959b-vghsb" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.81:8443/healthz\": dial tcp 10.128.0.81:8443: i/o timeout" Dec 04 00:52:59.391849 master-0 kubenswrapper[33142]: I1204 00:52:59.391767 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: E1204 00:52:59.392222 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerName="route-controller-manager" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: I1204 00:52:59.392248 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerName="route-controller-manager" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: E1204 00:52:59.392305 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" containerName="controller-manager" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: I1204 00:52:59.392324 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" containerName="controller-manager" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: E1204 00:52:59.392354 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f08d11be0e2919664ff2ea4b2440d0e0" containerName="startup-monitor" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: I1204 00:52:59.392368 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08d11be0e2919664ff2ea4b2440d0e0" containerName="startup-monitor" Dec 04 00:52:59.392769 master-0 kubenswrapper[33142]: I1204 00:52:59.392768 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" containerName="route-controller-manager" Dec 04 00:52:59.393039 master-0 kubenswrapper[33142]: I1204 00:52:59.392839 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" containerName="controller-manager" Dec 04 00:52:59.393039 master-0 kubenswrapper[33142]: I1204 00:52:59.392858 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f08d11be0e2919664ff2ea4b2440d0e0" containerName="startup-monitor" Dec 04 00:52:59.393539 master-0 kubenswrapper[33142]: I1204 00:52:59.393494 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.397193 master-0 kubenswrapper[33142]: I1204 00:52:59.397152 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:52:59.397443 master-0 kubenswrapper[33142]: I1204 00:52:59.397412 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:52:59.397731 master-0 kubenswrapper[33142]: I1204 00:52:59.397699 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:52:59.397864 master-0 kubenswrapper[33142]: I1204 00:52:59.397821 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:52:59.398100 master-0 kubenswrapper[33142]: I1204 00:52:59.398069 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:52:59.398326 master-0 kubenswrapper[33142]: I1204 00:52:59.398298 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:52:59.399915 master-0 kubenswrapper[33142]: I1204 00:52:59.399518 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:52:59.400869 master-0 kubenswrapper[33142]: I1204 00:52:59.400818 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.403186 master-0 kubenswrapper[33142]: I1204 00:52:59.403122 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 00:52:59.405918 master-0 kubenswrapper[33142]: I1204 00:52:59.404172 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 00:52:59.405918 master-0 kubenswrapper[33142]: I1204 00:52:59.405147 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-b7gnv" Dec 04 00:52:59.405918 master-0 kubenswrapper[33142]: I1204 00:52:59.405464 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 00:52:59.405918 master-0 kubenswrapper[33142]: I1204 00:52:59.405619 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 00:52:59.406825 master-0 kubenswrapper[33142]: I1204 00:52:59.406786 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 00:52:59.407631 master-0 kubenswrapper[33142]: I1204 00:52:59.407592 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:52:59.413274 master-0 kubenswrapper[33142]: I1204 00:52:59.413229 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:52:59.424009 master-0 kubenswrapper[33142]: I1204 00:52:59.421461 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:52:59.459109 master-0 kubenswrapper[33142]: I1204 00:52:59.458982 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 00:52:59.459775 master-0 kubenswrapper[33142]: I1204 00:52:59.459556 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.459775 master-0 kubenswrapper[33142]: I1204 00:52:59.459654 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.459775 master-0 kubenswrapper[33142]: I1204 00:52:59.459724 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459789 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459820 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459852 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459881 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9d8\" (UniqueName: \"kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459918 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvmt\" (UniqueName: \"kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.460003 master-0 kubenswrapper[33142]: I1204 00:52:59.459959 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.561507 master-0 kubenswrapper[33142]: I1204 00:52:59.561426 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561533 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561588 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561640 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561663 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561687 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561711 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9d8\" (UniqueName: \"kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561739 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-npvmt\" (UniqueName: \"kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.562308 master-0 kubenswrapper[33142]: I1204 00:52:59.561755 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.562992 master-0 kubenswrapper[33142]: I1204 00:52:59.562961 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.563632 master-0 kubenswrapper[33142]: I1204 00:52:59.563549 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.565128 master-0 kubenswrapper[33142]: I1204 00:52:59.564633 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.565128 master-0 kubenswrapper[33142]: I1204 00:52:59.564967 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.566747 master-0 kubenswrapper[33142]: I1204 00:52:59.566698 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.567082 master-0 kubenswrapper[33142]: I1204 00:52:59.567025 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.567380 master-0 kubenswrapper[33142]: I1204 00:52:59.567309 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.580087 master-0 kubenswrapper[33142]: I1204 00:52:59.580025 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvmt\" (UniqueName: \"kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt\") pod \"route-controller-manager-6795888bd7-bngnt\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.583028 master-0 kubenswrapper[33142]: I1204 00:52:59.582963 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9d8\" (UniqueName: \"kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8\") pod \"controller-manager-549b9b4c6-pkcfp\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.719334 master-0 kubenswrapper[33142]: I1204 00:52:59.719177 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:52:59.738831 master-0 kubenswrapper[33142]: I1204 00:52:59.738742 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:52:59.825334 master-0 kubenswrapper[33142]: I1204 00:52:59.825273 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 00:52:59.859607 master-0 kubenswrapper[33142]: I1204 00:52:59.859446 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" event={"ID":"aa2eaba9-479e-4420-a24f-63530e4da783","Type":"ContainerStarted","Data":"b8d7badc864110e8dd8b5e07da97bf92b46c93840f0b0e0d5e29c3688e3034f9"} Dec 04 00:52:59.860109 master-0 kubenswrapper[33142]: I1204 00:52:59.860039 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:52:59.863102 master-0 kubenswrapper[33142]: I1204 00:52:59.863055 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-7d67745bb7-2qnbf" Dec 04 00:52:59.913031 master-0 kubenswrapper[33142]: I1204 00:52:59.912908 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cfd1a75-01c6-488b-aed9-646f1c4ce0f5" path="/var/lib/kubelet/pods/2cfd1a75-01c6-488b-aed9-646f1c4ce0f5/volumes" Dec 04 00:52:59.914177 master-0 kubenswrapper[33142]: I1204 00:52:59.914156 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3545341-90a7-42fe-9ba4-bf6e71ef776e" path="/var/lib/kubelet/pods/e3545341-90a7-42fe-9ba4-bf6e71ef776e/volumes" Dec 04 00:52:59.914738 master-0 kubenswrapper[33142]: I1204 00:52:59.914721 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f08d11be0e2919664ff2ea4b2440d0e0" path="/var/lib/kubelet/pods/f08d11be0e2919664ff2ea4b2440d0e0/volumes" Dec 04 00:53:00.249316 master-0 kubenswrapper[33142]: I1204 00:53:00.249248 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-v4pfc" Dec 04 00:53:01.149945 master-0 kubenswrapper[33142]: E1204 00:53:01.149861 33142 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:53:01.149945 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383" Netns:"/var/run/netns/ed51193e-9e0c-47bb-a45b-e4550638e656" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:53:01.149945 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:01.149945 master-0 kubenswrapper[33142]: > Dec 04 00:53:01.150588 master-0 kubenswrapper[33142]: E1204 00:53:01.150568 33142 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:53:01.150588 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383" Netns:"/var/run/netns/ed51193e-9e0c-47bb-a45b-e4550638e656" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:53:01.150588 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:01.150588 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:01.150775 master-0 kubenswrapper[33142]: E1204 00:53:01.150734 33142 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:53:01.150775 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383" Netns:"/var/run/netns/ed51193e-9e0c-47bb-a45b-e4550638e656" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2" Path:"" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod "oauth-openshift-6dd96bc56-2k2q7" not found Dec 04 00:53:01.150775 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:01.150775 master-0 kubenswrapper[33142]: > pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:01.151020 master-0 kubenswrapper[33142]: E1204 00:53:01.150972 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"oauth-openshift-6dd96bc56-2k2q7_openshift-authentication(3d1f393a-2463-4144-a276-3673bdeae8a2)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_oauth-openshift-6dd96bc56-2k2q7_openshift-authentication_3d1f393a-2463-4144-a276-3673bdeae8a2_0(80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383): error adding pod openshift-authentication_oauth-openshift-6dd96bc56-2k2q7 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383\\\" Netns:\\\"/var/run/netns/ed51193e-9e0c-47bb-a45b-e4550638e656\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-authentication;K8S_POD_NAME=oauth-openshift-6dd96bc56-2k2q7;K8S_POD_INFRA_CONTAINER_ID=80e69902a5711e36e2e48d6117437017b7f08b75808d7d11c7cbb3d6c2acc383;K8S_POD_UID=3d1f393a-2463-4144-a276-3673bdeae8a2\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7] networking: Multus: [openshift-authentication/oauth-openshift-6dd96bc56-2k2q7/3d1f393a-2463-4144-a276-3673bdeae8a2]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod oauth-openshift-6dd96bc56-2k2q7 in out of cluster comm: pod \\\"oauth-openshift-6dd96bc56-2k2q7\\\" not found\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" podUID="3d1f393a-2463-4144-a276-3673bdeae8a2" Dec 04 00:53:02.632713 master-0 kubenswrapper[33142]: I1204 00:53:02.632658 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 00:53:02.736921 master-0 kubenswrapper[33142]: I1204 00:53:02.736257 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: E1204 00:53:02.961014 33142 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-549b9b4c6-pkcfp_openshift-controller-manager_0b5345d0-ac0f-4182-b9b6-1daff9184ba5_0(94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb): error adding pod openshift-controller-manager_controller-manager-549b9b4c6-pkcfp to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb" Netns:"/var/run/netns/f7b5206a-c958-4163-b080-de2a29cb9dd8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-549b9b4c6-pkcfp;K8S_POD_INFRA_CONTAINER_ID=94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb;K8S_POD_UID=0b5345d0-ac0f-4182-b9b6-1daff9184ba5" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp] networking: Multus: [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp/0b5345d0-ac0f-4182-b9b6-1daff9184ba5]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod controller-manager-549b9b4c6-pkcfp in out of cluster comm: pod "controller-manager-549b9b4c6-pkcfp" not found Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: > Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: E1204 00:53:02.961137 33142 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-549b9b4c6-pkcfp_openshift-controller-manager_0b5345d0-ac0f-4182-b9b6-1daff9184ba5_0(94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb): error adding pod openshift-controller-manager_controller-manager-549b9b4c6-pkcfp to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb" Netns:"/var/run/netns/f7b5206a-c958-4163-b080-de2a29cb9dd8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-549b9b4c6-pkcfp;K8S_POD_INFRA_CONTAINER_ID=94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb;K8S_POD_UID=0b5345d0-ac0f-4182-b9b6-1daff9184ba5" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp] networking: Multus: [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp/0b5345d0-ac0f-4182-b9b6-1daff9184ba5]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod controller-manager-549b9b4c6-pkcfp in out of cluster comm: pod "controller-manager-549b9b4c6-pkcfp" not found Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:02.961159 master-0 kubenswrapper[33142]: > pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:02.961627 master-0 kubenswrapper[33142]: E1204 00:53:02.961191 33142 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:53:02.961627 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-549b9b4c6-pkcfp_openshift-controller-manager_0b5345d0-ac0f-4182-b9b6-1daff9184ba5_0(94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb): error adding pod openshift-controller-manager_controller-manager-549b9b4c6-pkcfp to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb" Netns:"/var/run/netns/f7b5206a-c958-4163-b080-de2a29cb9dd8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-549b9b4c6-pkcfp;K8S_POD_INFRA_CONTAINER_ID=94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb;K8S_POD_UID=0b5345d0-ac0f-4182-b9b6-1daff9184ba5" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp] networking: Multus: [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp/0b5345d0-ac0f-4182-b9b6-1daff9184ba5]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod controller-manager-549b9b4c6-pkcfp in out of cluster comm: pod "controller-manager-549b9b4c6-pkcfp" not found Dec 04 00:53:02.961627 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:02.961627 master-0 kubenswrapper[33142]: > pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:02.961627 master-0 kubenswrapper[33142]: E1204 00:53:02.961286 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"controller-manager-549b9b4c6-pkcfp_openshift-controller-manager(0b5345d0-ac0f-4182-b9b6-1daff9184ba5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"controller-manager-549b9b4c6-pkcfp_openshift-controller-manager(0b5345d0-ac0f-4182-b9b6-1daff9184ba5)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-549b9b4c6-pkcfp_openshift-controller-manager_0b5345d0-ac0f-4182-b9b6-1daff9184ba5_0(94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb): error adding pod openshift-controller-manager_controller-manager-549b9b4c6-pkcfp to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb\\\" Netns:\\\"/var/run/netns/f7b5206a-c958-4163-b080-de2a29cb9dd8\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-549b9b4c6-pkcfp;K8S_POD_INFRA_CONTAINER_ID=94a098e625440e40ee3462dfd6dad13feed5acbab16e3285c518f09c0d39d7eb;K8S_POD_UID=0b5345d0-ac0f-4182-b9b6-1daff9184ba5\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp] networking: Multus: [openshift-controller-manager/controller-manager-549b9b4c6-pkcfp/0b5345d0-ac0f-4182-b9b6-1daff9184ba5]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod controller-manager-549b9b4c6-pkcfp in out of cluster comm: pod \\\"controller-manager-549b9b4c6-pkcfp\\\" not found\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" Dec 04 00:53:03.050569 master-0 kubenswrapper[33142]: E1204 00:53:03.050485 33142 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 00:53:03.050569 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager_fb338954-211a-4636-8ecc-bc9b508d1cb4_0(ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57): error adding pod openshift-route-controller-manager_route-controller-manager-6795888bd7-bngnt to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57" Netns:"/var/run/netns/f4c87db4-f7c8-4707-bf46-8eadee453bd5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-6795888bd7-bngnt;K8S_POD_INFRA_CONTAINER_ID=ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57;K8S_POD_UID=fb338954-211a-4636-8ecc-bc9b508d1cb4" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt] networking: Multus: [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt/fb338954-211a-4636-8ecc-bc9b508d1cb4]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod route-controller-manager-6795888bd7-bngnt in out of cluster comm: pod "route-controller-manager-6795888bd7-bngnt" not found Dec 04 00:53:03.050569 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:03.050569 master-0 kubenswrapper[33142]: > Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: E1204 00:53:03.050596 33142 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager_fb338954-211a-4636-8ecc-bc9b508d1cb4_0(ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57): error adding pod openshift-route-controller-manager_route-controller-manager-6795888bd7-bngnt to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57" Netns:"/var/run/netns/f4c87db4-f7c8-4707-bf46-8eadee453bd5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-6795888bd7-bngnt;K8S_POD_INFRA_CONTAINER_ID=ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57;K8S_POD_UID=fb338954-211a-4636-8ecc-bc9b508d1cb4" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt] networking: Multus: [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt/fb338954-211a-4636-8ecc-bc9b508d1cb4]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod route-controller-manager-6795888bd7-bngnt in out of cluster comm: pod "route-controller-manager-6795888bd7-bngnt" not found Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: > pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: E1204 00:53:03.050627 33142 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager_fb338954-211a-4636-8ecc-bc9b508d1cb4_0(ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57): error adding pod openshift-route-controller-manager_route-controller-manager-6795888bd7-bngnt to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57" Netns:"/var/run/netns/f4c87db4-f7c8-4707-bf46-8eadee453bd5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-6795888bd7-bngnt;K8S_POD_INFRA_CONTAINER_ID=ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57;K8S_POD_UID=fb338954-211a-4636-8ecc-bc9b508d1cb4" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt] networking: Multus: [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt/fb338954-211a-4636-8ecc-bc9b508d1cb4]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod route-controller-manager-6795888bd7-bngnt in out of cluster comm: pod "route-controller-manager-6795888bd7-bngnt" not found Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: > pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:03.050764 master-0 kubenswrapper[33142]: E1204 00:53:03.050717 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager(fb338954-211a-4636-8ecc-bc9b508d1cb4)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager(fb338954-211a-4636-8ecc-bc9b508d1cb4)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-6795888bd7-bngnt_openshift-route-controller-manager_fb338954-211a-4636-8ecc-bc9b508d1cb4_0(ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57): error adding pod openshift-route-controller-manager_route-controller-manager-6795888bd7-bngnt to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57\\\" Netns:\\\"/var/run/netns/f4c87db4-f7c8-4707-bf46-8eadee453bd5\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-6795888bd7-bngnt;K8S_POD_INFRA_CONTAINER_ID=ccb3d72625023cdf2bca3e428e18160215a125c0bb29314c776dda6b40406d57;K8S_POD_UID=fb338954-211a-4636-8ecc-bc9b508d1cb4\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt] networking: Multus: [openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt/fb338954-211a-4636-8ecc-bc9b508d1cb4]: error setting the networks status, pod was already deleted: SetPodNetworkStatusAnnotation: failed to query the pod route-controller-manager-6795888bd7-bngnt in out of cluster comm: pod \\\"route-controller-manager-6795888bd7-bngnt\\\" not found\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" Dec 04 00:53:03.522073 master-0 kubenswrapper[33142]: I1204 00:53:03.521980 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 00:53:03.911053 master-0 kubenswrapper[33142]: I1204 00:53:03.903764 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:03.911053 master-0 kubenswrapper[33142]: I1204 00:53:03.904570 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:03.911053 master-0 kubenswrapper[33142]: I1204 00:53:03.906623 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:03.918895 master-0 kubenswrapper[33142]: I1204 00:53:03.918772 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:04.365719 master-0 kubenswrapper[33142]: I1204 00:53:04.365613 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 00:53:04.374403 master-0 kubenswrapper[33142]: I1204 00:53:04.374313 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 00:53:04.880103 master-0 kubenswrapper[33142]: I1204 00:53:04.880013 33142 patch_prober.go:28] interesting pod/console-5fb74f878d-dqq2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" start-of-body= Dec 04 00:53:04.880103 master-0 kubenswrapper[33142]: I1204 00:53:04.880092 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" probeResult="failure" output="Get \"https://10.128.0.103:8443/health\": dial tcp 10.128.0.103:8443: connect: connection refused" Dec 04 00:53:05.318636 master-0 kubenswrapper[33142]: I1204 00:53:05.318451 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:53:05.342662 master-0 kubenswrapper[33142]: I1204 00:53:05.342590 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:53:06.352802 master-0 kubenswrapper[33142]: I1204 00:53:06.352662 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 00:53:06.377498 master-0 kubenswrapper[33142]: I1204 00:53:06.377454 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-rules" Dec 04 00:53:06.975628 master-0 kubenswrapper[33142]: I1204 00:53:06.975560 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:53:06.979787 master-0 kubenswrapper[33142]: W1204 00:53:06.979731 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb338954_211a_4636_8ecc_bc9b508d1cb4.slice/crio-33a9979dd37a951e49ddf4d0bbefa6ea098b2710995fe62b6c990a910eb39849 WatchSource:0}: Error finding container 33a9979dd37a951e49ddf4d0bbefa6ea098b2710995fe62b6c990a910eb39849: Status 404 returned error can't find the container with id 33a9979dd37a951e49ddf4d0bbefa6ea098b2710995fe62b6c990a910eb39849 Dec 04 00:53:07.018031 master-0 kubenswrapper[33142]: I1204 00:53:07.017971 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:53:07.190127 master-0 kubenswrapper[33142]: I1204 00:53:07.189997 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-grpc-tls-1l53g1qbkrl8c" Dec 04 00:53:07.193654 master-0 kubenswrapper[33142]: I1204 00:53:07.193431 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:53:07.231728 master-0 kubenswrapper[33142]: I1204 00:53:07.231652 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:07.233292 master-0 kubenswrapper[33142]: I1204 00:53:07.233249 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.258777 master-0 kubenswrapper[33142]: I1204 00:53:07.258734 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.295725 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.295819 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.295875 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.295975 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.296006 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.296291 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv56g\" (UniqueName: \"kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.296494 master-0 kubenswrapper[33142]: I1204 00:53:07.296416 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398167 master-0 kubenswrapper[33142]: I1204 00:53:07.398068 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398204 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398234 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398266 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rv56g\" (UniqueName: \"kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398291 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398333 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.398987 master-0 kubenswrapper[33142]: I1204 00:53:07.398353 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.399486 master-0 kubenswrapper[33142]: I1204 00:53:07.399422 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.399568 master-0 kubenswrapper[33142]: I1204 00:53:07.399422 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.399568 master-0 kubenswrapper[33142]: I1204 00:53:07.399449 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.399849 master-0 kubenswrapper[33142]: I1204 00:53:07.399810 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.403176 master-0 kubenswrapper[33142]: I1204 00:53:07.403116 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.408470 master-0 kubenswrapper[33142]: I1204 00:53:07.407945 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.433218 master-0 kubenswrapper[33142]: I1204 00:53:07.433150 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv56g\" (UniqueName: \"kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g\") pod \"console-7b76b9bf5c-pdhg4\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.561195 master-0 kubenswrapper[33142]: I1204 00:53:07.561030 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:07.942971 master-0 kubenswrapper[33142]: I1204 00:53:07.942840 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" event={"ID":"0b5345d0-ac0f-4182-b9b6-1daff9184ba5","Type":"ContainerStarted","Data":"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6"} Dec 04 00:53:07.942971 master-0 kubenswrapper[33142]: I1204 00:53:07.942912 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" event={"ID":"0b5345d0-ac0f-4182-b9b6-1daff9184ba5","Type":"ContainerStarted","Data":"e472d9d82144089e618a87e33bf1af2e3679eaba1dccfa58fd4785f11c90f8fb"} Dec 04 00:53:07.943316 master-0 kubenswrapper[33142]: I1204 00:53:07.943088 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" containerName="controller-manager" containerID="cri-o://a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6" gracePeriod=30 Dec 04 00:53:07.944869 master-0 kubenswrapper[33142]: I1204 00:53:07.944834 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:07.949150 master-0 kubenswrapper[33142]: I1204 00:53:07.948975 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" containerName="route-controller-manager" containerID="cri-o://9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b" gracePeriod=30 Dec 04 00:53:07.949220 master-0 kubenswrapper[33142]: I1204 00:53:07.949169 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" event={"ID":"fb338954-211a-4636-8ecc-bc9b508d1cb4","Type":"ContainerStarted","Data":"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b"} Dec 04 00:53:07.949220 master-0 kubenswrapper[33142]: I1204 00:53:07.949209 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:07.949288 master-0 kubenswrapper[33142]: I1204 00:53:07.949222 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" event={"ID":"fb338954-211a-4636-8ecc-bc9b508d1cb4","Type":"ContainerStarted","Data":"33a9979dd37a951e49ddf4d0bbefa6ea098b2710995fe62b6c990a910eb39849"} Dec 04 00:53:07.952756 master-0 kubenswrapper[33142]: I1204 00:53:07.952712 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:07.955650 master-0 kubenswrapper[33142]: I1204 00:53:07.955593 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:07.984755 master-0 kubenswrapper[33142]: I1204 00:53:07.984646 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" podStartSLOduration=10.984589297 podStartE2EDuration="10.984589297s" podCreationTimestamp="2025-12-04 00:52:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:07.979719309 +0000 UTC m=+360.381721169" watchObservedRunningTime="2025-12-04 00:53:07.984589297 +0000 UTC m=+360.386591157" Dec 04 00:53:08.036187 master-0 kubenswrapper[33142]: I1204 00:53:08.035857 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" podStartSLOduration=11.035659921 podStartE2EDuration="11.035659921s" podCreationTimestamp="2025-12-04 00:52:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:08.02822123 +0000 UTC m=+360.430223120" watchObservedRunningTime="2025-12-04 00:53:08.035659921 +0000 UTC m=+360.437661791" Dec 04 00:53:08.064967 master-0 kubenswrapper[33142]: I1204 00:53:08.064889 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:08.085888 master-0 kubenswrapper[33142]: W1204 00:53:08.085829 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6827961_175c_463a_8fd5_d3bd923a67f5.slice/crio-1e50844ff949a27eef6a967254aa8c99881f876e8341760c9cd13d33e32a0167 WatchSource:0}: Error finding container 1e50844ff949a27eef6a967254aa8c99881f876e8341760c9cd13d33e32a0167: Status 404 returned error can't find the container with id 1e50844ff949a27eef6a967254aa8c99881f876e8341760c9cd13d33e32a0167 Dec 04 00:53:08.145121 master-0 kubenswrapper[33142]: I1204 00:53:08.145054 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Dec 04 00:53:08.446788 master-0 kubenswrapper[33142]: I1204 00:53:08.446735 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:08.508303 master-0 kubenswrapper[33142]: I1204 00:53:08.508243 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:08.511044 master-0 kubenswrapper[33142]: I1204 00:53:08.511008 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:53:08.511714 master-0 kubenswrapper[33142]: E1204 00:53:08.511560 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" containerName="route-controller-manager" Dec 04 00:53:08.511819 master-0 kubenswrapper[33142]: I1204 00:53:08.511804 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" containerName="route-controller-manager" Dec 04 00:53:08.511917 master-0 kubenswrapper[33142]: E1204 00:53:08.511905 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" containerName="controller-manager" Dec 04 00:53:08.512007 master-0 kubenswrapper[33142]: I1204 00:53:08.511997 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" containerName="controller-manager" Dec 04 00:53:08.512193 master-0 kubenswrapper[33142]: I1204 00:53:08.512181 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" containerName="controller-manager" Dec 04 00:53:08.512275 master-0 kubenswrapper[33142]: I1204 00:53:08.512264 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" containerName="route-controller-manager" Dec 04 00:53:08.512856 master-0 kubenswrapper[33142]: I1204 00:53:08.512839 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.525249 master-0 kubenswrapper[33142]: I1204 00:53:08.524728 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert\") pod \"fb338954-211a-4636-8ecc-bc9b508d1cb4\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " Dec 04 00:53:08.525249 master-0 kubenswrapper[33142]: I1204 00:53:08.524975 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npvmt\" (UniqueName: \"kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt\") pod \"fb338954-211a-4636-8ecc-bc9b508d1cb4\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " Dec 04 00:53:08.525249 master-0 kubenswrapper[33142]: I1204 00:53:08.525025 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca\") pod \"fb338954-211a-4636-8ecc-bc9b508d1cb4\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " Dec 04 00:53:08.525249 master-0 kubenswrapper[33142]: I1204 00:53:08.525043 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config\") pod \"fb338954-211a-4636-8ecc-bc9b508d1cb4\" (UID: \"fb338954-211a-4636-8ecc-bc9b508d1cb4\") " Dec 04 00:53:08.526021 master-0 kubenswrapper[33142]: I1204 00:53:08.525975 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca" (OuterVolumeSpecName: "client-ca") pod "fb338954-211a-4636-8ecc-bc9b508d1cb4" (UID: "fb338954-211a-4636-8ecc-bc9b508d1cb4"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:08.526243 master-0 kubenswrapper[33142]: I1204 00:53:08.525989 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config" (OuterVolumeSpecName: "config") pod "fb338954-211a-4636-8ecc-bc9b508d1cb4" (UID: "fb338954-211a-4636-8ecc-bc9b508d1cb4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:08.531970 master-0 kubenswrapper[33142]: I1204 00:53:08.531901 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt" (OuterVolumeSpecName: "kube-api-access-npvmt") pod "fb338954-211a-4636-8ecc-bc9b508d1cb4" (UID: "fb338954-211a-4636-8ecc-bc9b508d1cb4"). InnerVolumeSpecName "kube-api-access-npvmt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:08.532276 master-0 kubenswrapper[33142]: I1204 00:53:08.532228 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "fb338954-211a-4636-8ecc-bc9b508d1cb4" (UID: "fb338954-211a-4636-8ecc-bc9b508d1cb4"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:08.538078 master-0 kubenswrapper[33142]: I1204 00:53:08.538022 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:53:08.626088 master-0 kubenswrapper[33142]: I1204 00:53:08.626012 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert\") pod \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " Dec 04 00:53:08.626088 master-0 kubenswrapper[33142]: I1204 00:53:08.626068 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n9d8\" (UniqueName: \"kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8\") pod \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " Dec 04 00:53:08.626088 master-0 kubenswrapper[33142]: I1204 00:53:08.626097 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca\") pod \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " Dec 04 00:53:08.626359 master-0 kubenswrapper[33142]: I1204 00:53:08.626194 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles\") pod \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " Dec 04 00:53:08.626359 master-0 kubenswrapper[33142]: I1204 00:53:08.626238 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config\") pod \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\" (UID: \"0b5345d0-ac0f-4182-b9b6-1daff9184ba5\") " Dec 04 00:53:08.626472 master-0 kubenswrapper[33142]: I1204 00:53:08.626446 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.627011 master-0 kubenswrapper[33142]: I1204 00:53:08.626965 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca" (OuterVolumeSpecName: "client-ca") pod "0b5345d0-ac0f-4182-b9b6-1daff9184ba5" (UID: "0b5345d0-ac0f-4182-b9b6-1daff9184ba5"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:08.627069 master-0 kubenswrapper[33142]: I1204 00:53:08.626975 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "0b5345d0-ac0f-4182-b9b6-1daff9184ba5" (UID: "0b5345d0-ac0f-4182-b9b6-1daff9184ba5"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:08.627141 master-0 kubenswrapper[33142]: I1204 00:53:08.627113 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config" (OuterVolumeSpecName: "config") pod "0b5345d0-ac0f-4182-b9b6-1daff9184ba5" (UID: "0b5345d0-ac0f-4182-b9b6-1daff9184ba5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:08.627227 master-0 kubenswrapper[33142]: I1204 00:53:08.627187 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lthc6\" (UniqueName: \"kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.627283 master-0 kubenswrapper[33142]: I1204 00:53:08.627267 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.627337 master-0 kubenswrapper[33142]: I1204 00:53:08.627316 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.627426 master-0 kubenswrapper[33142]: I1204 00:53:08.627403 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-npvmt\" (UniqueName: \"kubernetes.io/projected/fb338954-211a-4636-8ecc-bc9b508d1cb4-kube-api-access-npvmt\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627426 master-0 kubenswrapper[33142]: I1204 00:53:08.627422 33142 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627507 master-0 kubenswrapper[33142]: I1204 00:53:08.627434 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627507 master-0 kubenswrapper[33142]: I1204 00:53:08.627447 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb338954-211a-4636-8ecc-bc9b508d1cb4-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627507 master-0 kubenswrapper[33142]: I1204 00:53:08.627455 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627507 master-0 kubenswrapper[33142]: I1204 00:53:08.627464 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb338954-211a-4636-8ecc-bc9b508d1cb4-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.627507 master-0 kubenswrapper[33142]: I1204 00:53:08.627472 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.628767 master-0 kubenswrapper[33142]: I1204 00:53:08.628718 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "0b5345d0-ac0f-4182-b9b6-1daff9184ba5" (UID: "0b5345d0-ac0f-4182-b9b6-1daff9184ba5"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:08.629022 master-0 kubenswrapper[33142]: I1204 00:53:08.628865 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8" (OuterVolumeSpecName: "kube-api-access-8n9d8") pod "0b5345d0-ac0f-4182-b9b6-1daff9184ba5" (UID: "0b5345d0-ac0f-4182-b9b6-1daff9184ba5"). InnerVolumeSpecName "kube-api-access-8n9d8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:08.684366 master-0 kubenswrapper[33142]: I1204 00:53:08.684164 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.730982 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.731108 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lthc6\" (UniqueName: \"kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.731181 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.731271 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.731365 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.731986 master-0 kubenswrapper[33142]: I1204 00:53:08.731388 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8n9d8\" (UniqueName: \"kubernetes.io/projected/0b5345d0-ac0f-4182-b9b6-1daff9184ba5-kube-api-access-8n9d8\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:08.732634 master-0 kubenswrapper[33142]: I1204 00:53:08.732595 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.736143 master-0 kubenswrapper[33142]: I1204 00:53:08.736095 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.736385 master-0 kubenswrapper[33142]: I1204 00:53:08.736351 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.752006 master-0 kubenswrapper[33142]: I1204 00:53:08.751692 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lthc6\" (UniqueName: \"kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6\") pod \"route-controller-manager-68bc8d8fcb-gmfm5\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.782440 master-0 kubenswrapper[33142]: I1204 00:53:08.782376 33142 patch_prober.go:28] interesting pod/console-584b5bc58b-k2thl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" start-of-body= Dec 04 00:53:08.782813 master-0 kubenswrapper[33142]: I1204 00:53:08.782778 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" probeResult="failure" output="Get \"https://10.128.0.104:8443/health\": dial tcp 10.128.0.104:8443: connect: connection refused" Dec 04 00:53:08.857066 master-0 kubenswrapper[33142]: I1204 00:53:08.856994 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:08.964401 master-0 kubenswrapper[33142]: I1204 00:53:08.964209 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b76b9bf5c-pdhg4" event={"ID":"d6827961-175c-463a-8fd5-d3bd923a67f5","Type":"ContainerStarted","Data":"907bfb75caf20de81fc13e88a6a794f8f7552c16230f2035d597ff056d47dea8"} Dec 04 00:53:08.964401 master-0 kubenswrapper[33142]: I1204 00:53:08.964318 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b76b9bf5c-pdhg4" event={"ID":"d6827961-175c-463a-8fd5-d3bd923a67f5","Type":"ContainerStarted","Data":"1e50844ff949a27eef6a967254aa8c99881f876e8341760c9cd13d33e32a0167"} Dec 04 00:53:08.967772 master-0 kubenswrapper[33142]: I1204 00:53:08.967686 33142 generic.go:334] "Generic (PLEG): container finished" podID="fb338954-211a-4636-8ecc-bc9b508d1cb4" containerID="9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b" exitCode=0 Dec 04 00:53:08.968196 master-0 kubenswrapper[33142]: I1204 00:53:08.967719 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" event={"ID":"fb338954-211a-4636-8ecc-bc9b508d1cb4","Type":"ContainerDied","Data":"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b"} Dec 04 00:53:08.968567 master-0 kubenswrapper[33142]: I1204 00:53:08.968498 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" event={"ID":"fb338954-211a-4636-8ecc-bc9b508d1cb4","Type":"ContainerDied","Data":"33a9979dd37a951e49ddf4d0bbefa6ea098b2710995fe62b6c990a910eb39849"} Dec 04 00:53:08.968897 master-0 kubenswrapper[33142]: I1204 00:53:08.968868 33142 scope.go:117] "RemoveContainer" containerID="9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b" Dec 04 00:53:08.970175 master-0 kubenswrapper[33142]: I1204 00:53:08.967785 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt" Dec 04 00:53:08.975976 master-0 kubenswrapper[33142]: I1204 00:53:08.975907 33142 generic.go:334] "Generic (PLEG): container finished" podID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" containerID="a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6" exitCode=0 Dec 04 00:53:08.976104 master-0 kubenswrapper[33142]: I1204 00:53:08.975980 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" event={"ID":"0b5345d0-ac0f-4182-b9b6-1daff9184ba5","Type":"ContainerDied","Data":"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6"} Dec 04 00:53:08.976104 master-0 kubenswrapper[33142]: I1204 00:53:08.976017 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" event={"ID":"0b5345d0-ac0f-4182-b9b6-1daff9184ba5","Type":"ContainerDied","Data":"e472d9d82144089e618a87e33bf1af2e3679eaba1dccfa58fd4785f11c90f8fb"} Dec 04 00:53:08.976320 master-0 kubenswrapper[33142]: I1204 00:53:08.976110 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-pkcfp" Dec 04 00:53:09.018392 master-0 kubenswrapper[33142]: I1204 00:53:09.018212 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b76b9bf5c-pdhg4" podStartSLOduration=2.018186885 podStartE2EDuration="2.018186885s" podCreationTimestamp="2025-12-04 00:53:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:09.007515813 +0000 UTC m=+361.409517693" watchObservedRunningTime="2025-12-04 00:53:09.018186885 +0000 UTC m=+361.420188765" Dec 04 00:53:09.053221 master-0 kubenswrapper[33142]: I1204 00:53:09.053159 33142 scope.go:117] "RemoveContainer" containerID="9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b" Dec 04 00:53:09.053794 master-0 kubenswrapper[33142]: E1204 00:53:09.053751 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b\": container with ID starting with 9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b not found: ID does not exist" containerID="9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b" Dec 04 00:53:09.053958 master-0 kubenswrapper[33142]: I1204 00:53:09.053795 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b"} err="failed to get container status \"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b\": rpc error: code = NotFound desc = could not find container \"9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b\": container with ID starting with 9b483fcdc7ec4840266cf3fb76203c64cbe47ef348874d0354619f166d549e5b not found: ID does not exist" Dec 04 00:53:09.053958 master-0 kubenswrapper[33142]: I1204 00:53:09.053824 33142 scope.go:117] "RemoveContainer" containerID="a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6" Dec 04 00:53:09.085989 master-0 kubenswrapper[33142]: I1204 00:53:09.085901 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:53:09.089528 master-0 kubenswrapper[33142]: I1204 00:53:09.089486 33142 scope.go:117] "RemoveContainer" containerID="a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6" Dec 04 00:53:09.090297 master-0 kubenswrapper[33142]: E1204 00:53:09.090238 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6\": container with ID starting with a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6 not found: ID does not exist" containerID="a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6" Dec 04 00:53:09.090402 master-0 kubenswrapper[33142]: I1204 00:53:09.090294 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6"} err="failed to get container status \"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6\": rpc error: code = NotFound desc = could not find container \"a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6\": container with ID starting with a7237778e71af165ca6dd0e335e204d4fd7ed8f3ecc53109a48bba12392adfd6 not found: ID does not exist" Dec 04 00:53:09.098665 master-0 kubenswrapper[33142]: I1204 00:53:09.098582 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-pkcfp"] Dec 04 00:53:09.107138 master-0 kubenswrapper[33142]: I1204 00:53:09.107071 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:53:09.112354 master-0 kubenswrapper[33142]: I1204 00:53:09.112275 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-bngnt"] Dec 04 00:53:09.360237 master-0 kubenswrapper[33142]: I1204 00:53:09.360167 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:53:09.538743 master-0 kubenswrapper[33142]: I1204 00:53:09.538680 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:09.539362 master-0 kubenswrapper[33142]: I1204 00:53:09.539128 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="prometheus" containerID="cri-o://32d3b141ebb22426932cebc2f95078b41d845016ed113358108f954bffd6cd1f" gracePeriod=600 Dec 04 00:53:09.539571 master-0 kubenswrapper[33142]: I1204 00:53:09.539499 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://daabdb748e1c714450ef9d83eb79cc3c8cd31889f1d74c72b2a2d3d806ef3ab4" gracePeriod=600 Dec 04 00:53:09.539688 master-0 kubenswrapper[33142]: I1204 00:53:09.539662 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy" containerID="cri-o://6ed23a0a1eb12986104e22dab79d67db3d7c9755e77165272221f4b1c0afdb3f" gracePeriod=600 Dec 04 00:53:09.539751 master-0 kubenswrapper[33142]: I1204 00:53:09.539727 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-web" containerID="cri-o://94d90e74c22ad5d515c17a9ae4738cd5f749fc5f3f91002bbcb36643b3d4c951" gracePeriod=600 Dec 04 00:53:09.539807 master-0 kubenswrapper[33142]: I1204 00:53:09.539770 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="thanos-sidecar" containerID="cri-o://cfceebb485f61f7b0cda284796e2a6846cc0b7d447206490f77feda543d10e7e" gracePeriod=600 Dec 04 00:53:09.541115 master-0 kubenswrapper[33142]: I1204 00:53:09.539812 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="config-reloader" containerID="cri-o://d0a9c8f979f554245cb3bfe5adf3d3f015694c65f7ac9ea8bfd41dc45a001a01" gracePeriod=600 Dec 04 00:53:09.851127 master-0 kubenswrapper[33142]: I1204 00:53:09.851074 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 00:53:09.915203 master-0 kubenswrapper[33142]: I1204 00:53:09.915091 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5345d0-ac0f-4182-b9b6-1daff9184ba5" path="/var/lib/kubelet/pods/0b5345d0-ac0f-4182-b9b6-1daff9184ba5/volumes" Dec 04 00:53:09.916694 master-0 kubenswrapper[33142]: I1204 00:53:09.916631 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb338954-211a-4636-8ecc-bc9b508d1cb4" path="/var/lib/kubelet/pods/fb338954-211a-4636-8ecc-bc9b508d1cb4/volumes" Dec 04 00:53:09.993441 master-0 kubenswrapper[33142]: I1204 00:53:09.993308 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 00:53:09.996413 master-0 kubenswrapper[33142]: I1204 00:53:09.996373 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="94d90e74c22ad5d515c17a9ae4738cd5f749fc5f3f91002bbcb36643b3d4c951" exitCode=0 Dec 04 00:53:09.996413 master-0 kubenswrapper[33142]: I1204 00:53:09.996405 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="cfceebb485f61f7b0cda284796e2a6846cc0b7d447206490f77feda543d10e7e" exitCode=0 Dec 04 00:53:09.996413 master-0 kubenswrapper[33142]: I1204 00:53:09.996414 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="d0a9c8f979f554245cb3bfe5adf3d3f015694c65f7ac9ea8bfd41dc45a001a01" exitCode=0 Dec 04 00:53:09.996684 master-0 kubenswrapper[33142]: I1204 00:53:09.996459 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"94d90e74c22ad5d515c17a9ae4738cd5f749fc5f3f91002bbcb36643b3d4c951"} Dec 04 00:53:09.996684 master-0 kubenswrapper[33142]: I1204 00:53:09.996489 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"cfceebb485f61f7b0cda284796e2a6846cc0b7d447206490f77feda543d10e7e"} Dec 04 00:53:09.996684 master-0 kubenswrapper[33142]: I1204 00:53:09.996498 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"d0a9c8f979f554245cb3bfe5adf3d3f015694c65f7ac9ea8bfd41dc45a001a01"} Dec 04 00:53:10.009776 master-0 kubenswrapper[33142]: I1204 00:53:10.009695 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" event={"ID":"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042","Type":"ContainerStarted","Data":"0320058e12801c93c0632c1992f396e4be7e368baf4bc8c077854cc324eacefa"} Dec 04 00:53:10.010089 master-0 kubenswrapper[33142]: I1204 00:53:10.009780 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" event={"ID":"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042","Type":"ContainerStarted","Data":"0ab6489dc4658e3f43399c404f9314624b7908472538b6e47b22f398663759a1"} Dec 04 00:53:10.010089 master-0 kubenswrapper[33142]: I1204 00:53:10.010011 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:10.025993 master-0 kubenswrapper[33142]: I1204 00:53:10.025290 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:53:10.045692 master-0 kubenswrapper[33142]: I1204 00:53:10.044530 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" podStartSLOduration=5.044500497 podStartE2EDuration="5.044500497s" podCreationTimestamp="2025-12-04 00:53:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:10.041600235 +0000 UTC m=+362.443602105" watchObservedRunningTime="2025-12-04 00:53:10.044500497 +0000 UTC m=+362.446502377" Dec 04 00:53:10.427647 master-0 kubenswrapper[33142]: I1204 00:53:10.427575 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 00:53:10.750106 master-0 kubenswrapper[33142]: I1204 00:53:10.747956 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:53:10.783563 master-0 kubenswrapper[33142]: I1204 00:53:10.782823 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:53:10.783795 master-0 kubenswrapper[33142]: I1204 00:53:10.783775 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.802953 master-0 kubenswrapper[33142]: I1204 00:53:10.801346 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:53:10.869632 master-0 kubenswrapper[33142]: I1204 00:53:10.869521 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.869632 master-0 kubenswrapper[33142]: I1204 00:53:10.869629 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mg79\" (UniqueName: \"kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.870093 master-0 kubenswrapper[33142]: I1204 00:53:10.869653 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.870093 master-0 kubenswrapper[33142]: I1204 00:53:10.869683 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.870093 master-0 kubenswrapper[33142]: I1204 00:53:10.869735 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.870093 master-0 kubenswrapper[33142]: I1204 00:53:10.869789 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.870093 master-0 kubenswrapper[33142]: I1204 00:53:10.869832 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971273 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971366 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971441 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971471 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6mg79\" (UniqueName: \"kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971492 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971535 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.971536 master-0 kubenswrapper[33142]: I1204 00:53:10.971552 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.973868 master-0 kubenswrapper[33142]: I1204 00:53:10.973684 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.974647 master-0 kubenswrapper[33142]: I1204 00:53:10.974560 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.975556 master-0 kubenswrapper[33142]: I1204 00:53:10.975090 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.977072 master-0 kubenswrapper[33142]: I1204 00:53:10.976113 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.982155 master-0 kubenswrapper[33142]: I1204 00:53:10.981915 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.992432 master-0 kubenswrapper[33142]: I1204 00:53:10.992346 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:10.993177 master-0 kubenswrapper[33142]: I1204 00:53:10.993120 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mg79\" (UniqueName: \"kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79\") pod \"console-7bccf97b47-glshl\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:11.024727 master-0 kubenswrapper[33142]: I1204 00:53:11.024656 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="daabdb748e1c714450ef9d83eb79cc3c8cd31889f1d74c72b2a2d3d806ef3ab4" exitCode=0 Dec 04 00:53:11.024727 master-0 kubenswrapper[33142]: I1204 00:53:11.024711 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="6ed23a0a1eb12986104e22dab79d67db3d7c9755e77165272221f4b1c0afdb3f" exitCode=0 Dec 04 00:53:11.024727 master-0 kubenswrapper[33142]: I1204 00:53:11.024722 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6228387-579c-4398-adb0-1057429d2d5a" containerID="32d3b141ebb22426932cebc2f95078b41d845016ed113358108f954bffd6cd1f" exitCode=0 Dec 04 00:53:11.025102 master-0 kubenswrapper[33142]: I1204 00:53:11.025060 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"daabdb748e1c714450ef9d83eb79cc3c8cd31889f1d74c72b2a2d3d806ef3ab4"} Dec 04 00:53:11.025189 master-0 kubenswrapper[33142]: I1204 00:53:11.025177 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"6ed23a0a1eb12986104e22dab79d67db3d7c9755e77165272221f4b1c0afdb3f"} Dec 04 00:53:11.025255 master-0 kubenswrapper[33142]: I1204 00:53:11.025244 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"32d3b141ebb22426932cebc2f95078b41d845016ed113358108f954bffd6cd1f"} Dec 04 00:53:11.061914 master-0 kubenswrapper[33142]: I1204 00:53:11.061851 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:11.128001 master-0 kubenswrapper[33142]: I1204 00:53:11.127936 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:11.175888 master-0 kubenswrapper[33142]: I1204 00:53:11.175839 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vx4b\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.175900 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.175949 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.175979 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176016 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176040 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176065 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176096 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176131 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176166 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176196 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176247 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176317 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176347 master-0 kubenswrapper[33142]: I1204 00:53:11.176356 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176956 master-0 kubenswrapper[33142]: I1204 00:53:11.176404 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176956 master-0 kubenswrapper[33142]: I1204 00:53:11.176433 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176956 master-0 kubenswrapper[33142]: I1204 00:53:11.176461 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.176956 master-0 kubenswrapper[33142]: I1204 00:53:11.176484 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle\") pod \"d6228387-579c-4398-adb0-1057429d2d5a\" (UID: \"d6228387-579c-4398-adb0-1057429d2d5a\") " Dec 04 00:53:11.177894 master-0 kubenswrapper[33142]: I1204 00:53:11.177011 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:11.177894 master-0 kubenswrapper[33142]: I1204 00:53:11.177747 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:11.178691 master-0 kubenswrapper[33142]: I1204 00:53:11.178644 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:11.180358 master-0 kubenswrapper[33142]: I1204 00:53:11.180314 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:11.180519 master-0 kubenswrapper[33142]: I1204 00:53:11.180489 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.180968 master-0 kubenswrapper[33142]: I1204 00:53:11.180866 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:53:11.181469 master-0 kubenswrapper[33142]: I1204 00:53:11.181420 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.181676 master-0 kubenswrapper[33142]: I1204 00:53:11.181624 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out" (OuterVolumeSpecName: "config-out") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:53:11.182383 master-0 kubenswrapper[33142]: I1204 00:53:11.182002 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.183119 master-0 kubenswrapper[33142]: I1204 00:53:11.182996 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.183302 master-0 kubenswrapper[33142]: I1204 00:53:11.183265 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:11.183751 master-0 kubenswrapper[33142]: I1204 00:53:11.183563 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:11.184223 master-0 kubenswrapper[33142]: I1204 00:53:11.184179 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config" (OuterVolumeSpecName: "config") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.185035 master-0 kubenswrapper[33142]: I1204 00:53:11.184921 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.185662 master-0 kubenswrapper[33142]: I1204 00:53:11.185594 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b" (OuterVolumeSpecName: "kube-api-access-7vx4b") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "kube-api-access-7vx4b". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:11.185730 master-0 kubenswrapper[33142]: I1204 00:53:11.185651 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.189090 master-0 kubenswrapper[33142]: I1204 00:53:11.189045 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.254309 master-0 kubenswrapper[33142]: I1204 00:53:11.253645 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config" (OuterVolumeSpecName: "web-config") pod "d6228387-579c-4398-adb0-1057429d2d5a" (UID: "d6228387-579c-4398-adb0-1057429d2d5a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:11.279128 master-0 kubenswrapper[33142]: I1204 00:53:11.279067 33142 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279128 master-0 kubenswrapper[33142]: I1204 00:53:11.279131 33142 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279152 33142 reconciler_common.go:293] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-metrics-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279172 33142 reconciler_common.go:293] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-thanos-prometheus-http-client-file\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279191 33142 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-config-out\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279209 33142 reconciler_common.go:293] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279289 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279316 33142 reconciler_common.go:293] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-metrics-client-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279357 master-0 kubenswrapper[33142]: I1204 00:53:11.279334 33142 reconciler_common.go:293] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-kube-rbac-proxy\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279367 33142 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-tls-assets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279384 33142 reconciler_common.go:293] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-serving-certs-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279400 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7vx4b\" (UniqueName: \"kubernetes.io/projected/d6228387-579c-4398-adb0-1057429d2d5a-kube-api-access-7vx4b\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279420 33142 reconciler_common.go:293] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-rulefiles-0\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279436 33142 reconciler_common.go:293] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6228387-579c-4398-adb0-1057429d2d5a-prometheus-k8s-db\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279455 33142 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279472 33142 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-web-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279488 33142 reconciler_common.go:293] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6228387-579c-4398-adb0-1057429d2d5a-secret-grpc-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.279544 master-0 kubenswrapper[33142]: I1204 00:53:11.279503 33142 reconciler_common.go:293] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6228387-579c-4398-adb0-1057429d2d5a-configmap-kubelet-serving-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:11.405702 master-0 kubenswrapper[33142]: I1204 00:53:11.405619 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:53:11.406100 master-0 kubenswrapper[33142]: E1204 00:53:11.406076 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="thanos-sidecar" Dec 04 00:53:11.406159 master-0 kubenswrapper[33142]: I1204 00:53:11.406103 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="thanos-sidecar" Dec 04 00:53:11.406159 master-0 kubenswrapper[33142]: E1204 00:53:11.406130 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-thanos" Dec 04 00:53:11.406159 master-0 kubenswrapper[33142]: I1204 00:53:11.406139 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-thanos" Dec 04 00:53:11.406159 master-0 kubenswrapper[33142]: E1204 00:53:11.406159 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="prometheus" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: I1204 00:53:11.406170 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="prometheus" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: E1204 00:53:11.406180 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-web" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: I1204 00:53:11.406188 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-web" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: E1204 00:53:11.406204 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="init-config-reloader" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: I1204 00:53:11.406211 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="init-config-reloader" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: E1204 00:53:11.406226 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: I1204 00:53:11.406235 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: E1204 00:53:11.406253 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="config-reloader" Dec 04 00:53:11.406356 master-0 kubenswrapper[33142]: I1204 00:53:11.406261 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="config-reloader" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406415 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="thanos-sidecar" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406438 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406456 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-thanos" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406469 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="kube-rbac-proxy-web" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406488 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="prometheus" Dec 04 00:53:11.406611 master-0 kubenswrapper[33142]: I1204 00:53:11.406500 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6228387-579c-4398-adb0-1057429d2d5a" containerName="config-reloader" Dec 04 00:53:11.407091 master-0 kubenswrapper[33142]: I1204 00:53:11.407066 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.409209 master-0 kubenswrapper[33142]: I1204 00:53:11.409151 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-lf4jk" Dec 04 00:53:11.409416 master-0 kubenswrapper[33142]: I1204 00:53:11.409377 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 00:53:11.409585 master-0 kubenswrapper[33142]: I1204 00:53:11.409554 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 00:53:11.410009 master-0 kubenswrapper[33142]: I1204 00:53:11.409978 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 00:53:11.410430 master-0 kubenswrapper[33142]: I1204 00:53:11.410368 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 00:53:11.410482 master-0 kubenswrapper[33142]: I1204 00:53:11.410431 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 00:53:11.418059 master-0 kubenswrapper[33142]: I1204 00:53:11.417990 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:53:11.420062 master-0 kubenswrapper[33142]: I1204 00:53:11.419792 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 00:53:11.484008 master-0 kubenswrapper[33142]: I1204 00:53:11.483846 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.484008 master-0 kubenswrapper[33142]: I1204 00:53:11.483955 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2rs\" (UniqueName: \"kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.484245 master-0 kubenswrapper[33142]: I1204 00:53:11.484021 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.484245 master-0 kubenswrapper[33142]: I1204 00:53:11.484055 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.484245 master-0 kubenswrapper[33142]: I1204 00:53:11.484092 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.573010 master-0 kubenswrapper[33142]: I1204 00:53:11.572861 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:53:11.584394 master-0 kubenswrapper[33142]: W1204 00:53:11.584266 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22002da_75d9_4121_9201_d3d2b591e53a.slice/crio-2841d39a27bf28b9a5c1322984624bcf4cb6f2e5001928f9bd0726ab37b757a4 WatchSource:0}: Error finding container 2841d39a27bf28b9a5c1322984624bcf4cb6f2e5001928f9bd0726ab37b757a4: Status 404 returned error can't find the container with id 2841d39a27bf28b9a5c1322984624bcf4cb6f2e5001928f9bd0726ab37b757a4 Dec 04 00:53:11.585406 master-0 kubenswrapper[33142]: I1204 00:53:11.585316 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.585406 master-0 kubenswrapper[33142]: I1204 00:53:11.585401 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.585648 master-0 kubenswrapper[33142]: I1204 00:53:11.585461 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.585648 master-0 kubenswrapper[33142]: I1204 00:53:11.585586 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.585914 master-0 kubenswrapper[33142]: I1204 00:53:11.585651 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2rs\" (UniqueName: \"kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.587329 master-0 kubenswrapper[33142]: I1204 00:53:11.587099 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.591657 master-0 kubenswrapper[33142]: I1204 00:53:11.591576 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.592026 master-0 kubenswrapper[33142]: I1204 00:53:11.591869 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.596876 master-0 kubenswrapper[33142]: I1204 00:53:11.596802 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.613308 master-0 kubenswrapper[33142]: I1204 00:53:11.613233 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2rs\" (UniqueName: \"kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs\") pod \"controller-manager-645ffb9d5f-xqp4n\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:11.740905 master-0 kubenswrapper[33142]: I1204 00:53:11.740744 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:12.077685 master-0 kubenswrapper[33142]: I1204 00:53:12.077419 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6228387-579c-4398-adb0-1057429d2d5a","Type":"ContainerDied","Data":"13e58be298789b162735677d4cc481e45f0a3c502aae0af262cb714cccd12e36"} Dec 04 00:53:12.077685 master-0 kubenswrapper[33142]: I1204 00:53:12.077504 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.077685 master-0 kubenswrapper[33142]: I1204 00:53:12.077520 33142 scope.go:117] "RemoveContainer" containerID="daabdb748e1c714450ef9d83eb79cc3c8cd31889f1d74c72b2a2d3d806ef3ab4" Dec 04 00:53:12.082346 master-0 kubenswrapper[33142]: I1204 00:53:12.082300 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bccf97b47-glshl" event={"ID":"b22002da-75d9-4121-9201-d3d2b591e53a","Type":"ContainerStarted","Data":"020a81e676ffc0a6fc64e38ba223ddc25b1e8a742f74748dbe5394da7718d70c"} Dec 04 00:53:12.082346 master-0 kubenswrapper[33142]: I1204 00:53:12.082339 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bccf97b47-glshl" event={"ID":"b22002da-75d9-4121-9201-d3d2b591e53a","Type":"ContainerStarted","Data":"2841d39a27bf28b9a5c1322984624bcf4cb6f2e5001928f9bd0726ab37b757a4"} Dec 04 00:53:12.100253 master-0 kubenswrapper[33142]: I1204 00:53:12.100144 33142 scope.go:117] "RemoveContainer" containerID="6ed23a0a1eb12986104e22dab79d67db3d7c9755e77165272221f4b1c0afdb3f" Dec 04 00:53:12.113212 master-0 kubenswrapper[33142]: I1204 00:53:12.111538 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 00:53:12.122476 master-0 kubenswrapper[33142]: I1204 00:53:12.121951 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bccf97b47-glshl" podStartSLOduration=2.12190337 podStartE2EDuration="2.12190337s" podCreationTimestamp="2025-12-04 00:53:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:12.110120326 +0000 UTC m=+364.512122176" watchObservedRunningTime="2025-12-04 00:53:12.12190337 +0000 UTC m=+364.523905230" Dec 04 00:53:12.134701 master-0 kubenswrapper[33142]: I1204 00:53:12.134656 33142 scope.go:117] "RemoveContainer" containerID="94d90e74c22ad5d515c17a9ae4738cd5f749fc5f3f91002bbcb36643b3d4c951" Dec 04 00:53:12.147280 master-0 kubenswrapper[33142]: I1204 00:53:12.147211 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:12.154261 master-0 kubenswrapper[33142]: I1204 00:53:12.154215 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:12.163248 master-0 kubenswrapper[33142]: I1204 00:53:12.163212 33142 scope.go:117] "RemoveContainer" containerID="cfceebb485f61f7b0cda284796e2a6846cc0b7d447206490f77feda543d10e7e" Dec 04 00:53:12.177165 master-0 kubenswrapper[33142]: I1204 00:53:12.177118 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:12.181270 master-0 kubenswrapper[33142]: I1204 00:53:12.181238 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.184517 master-0 kubenswrapper[33142]: I1204 00:53:12.184413 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 00:53:12.184655 master-0 kubenswrapper[33142]: I1204 00:53:12.184630 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 00:53:12.184908 master-0 kubenswrapper[33142]: I1204 00:53:12.184892 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 00:53:12.185049 master-0 kubenswrapper[33142]: I1204 00:53:12.184906 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-33dcm3qc457cs" Dec 04 00:53:12.185256 master-0 kubenswrapper[33142]: I1204 00:53:12.185244 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 00:53:12.186399 master-0 kubenswrapper[33142]: I1204 00:53:12.186381 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 00:53:12.186686 master-0 kubenswrapper[33142]: I1204 00:53:12.186633 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 00:53:12.186907 master-0 kubenswrapper[33142]: I1204 00:53:12.186893 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 00:53:12.188369 master-0 kubenswrapper[33142]: I1204 00:53:12.187087 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 00:53:12.188575 master-0 kubenswrapper[33142]: I1204 00:53:12.188560 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 00:53:12.188721 master-0 kubenswrapper[33142]: I1204 00:53:12.188670 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-br9vs" Dec 04 00:53:12.192031 master-0 kubenswrapper[33142]: I1204 00:53:12.192007 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 00:53:12.194014 master-0 kubenswrapper[33142]: I1204 00:53:12.193765 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 00:53:12.200807 master-0 kubenswrapper[33142]: I1204 00:53:12.200765 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:12.234618 master-0 kubenswrapper[33142]: I1204 00:53:12.234281 33142 scope.go:117] "RemoveContainer" containerID="d0a9c8f979f554245cb3bfe5adf3d3f015694c65f7ac9ea8bfd41dc45a001a01" Dec 04 00:53:12.270338 master-0 kubenswrapper[33142]: I1204 00:53:12.270265 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:53:12.271751 master-0 kubenswrapper[33142]: I1204 00:53:12.271714 33142 scope.go:117] "RemoveContainer" containerID="32d3b141ebb22426932cebc2f95078b41d845016ed113358108f954bffd6cd1f" Dec 04 00:53:12.277146 master-0 kubenswrapper[33142]: W1204 00:53:12.277046 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5793144a_a95c_4f7c_8fd7_a5bda2057b68.slice/crio-4a4e33403e01562772c7febba55965afd1e88e953246df7f1adba0268acc1848 WatchSource:0}: Error finding container 4a4e33403e01562772c7febba55965afd1e88e953246df7f1adba0268acc1848: Status 404 returned error can't find the container with id 4a4e33403e01562772c7febba55965afd1e88e953246df7f1adba0268acc1848 Dec 04 00:53:12.301806 master-0 kubenswrapper[33142]: I1204 00:53:12.301734 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.301806 master-0 kubenswrapper[33142]: I1204 00:53:12.301790 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrx6\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-kube-api-access-khrx6\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.301829 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.301855 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.301880 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.301907 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.302000 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302148 master-0 kubenswrapper[33142]: I1204 00:53:12.302033 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302179 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302264 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302349 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302396 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302450 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302497 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302529 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302555 master-0 kubenswrapper[33142]: I1204 00:53:12.302559 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302875 master-0 kubenswrapper[33142]: I1204 00:53:12.302594 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.302875 master-0 kubenswrapper[33142]: I1204 00:53:12.302652 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.320365 master-0 kubenswrapper[33142]: I1204 00:53:12.320302 33142 scope.go:117] "RemoveContainer" containerID="3578f23afad3fbf0e79530532c6563a78014d3e68e7a72febf782bc78ecc28cf" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404486 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404551 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404577 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404604 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404620 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404645 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404675 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404702 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404725 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404744 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404778 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404819 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404845 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-khrx6\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-kube-api-access-khrx6\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404881 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404900 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404920 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404966 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.404993 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.405948 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.406485 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.406894 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.407059 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.407270 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.408847 master-0 kubenswrapper[33142]: I1204 00:53:12.408859 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.409987 master-0 kubenswrapper[33142]: I1204 00:53:12.408970 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.409987 master-0 kubenswrapper[33142]: I1204 00:53:12.409156 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.415283 master-0 kubenswrapper[33142]: I1204 00:53:12.414512 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.415664 master-0 kubenswrapper[33142]: I1204 00:53:12.415632 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.415724 master-0 kubenswrapper[33142]: I1204 00:53:12.415693 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.415781 master-0 kubenswrapper[33142]: I1204 00:53:12.415725 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.415836 master-0 kubenswrapper[33142]: I1204 00:53:12.415727 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.416046 master-0 kubenswrapper[33142]: I1204 00:53:12.415997 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.416237 master-0 kubenswrapper[33142]: I1204 00:53:12.416172 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.416879 master-0 kubenswrapper[33142]: I1204 00:53:12.415119 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.418135 master-0 kubenswrapper[33142]: I1204 00:53:12.418072 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.426755 master-0 kubenswrapper[33142]: I1204 00:53:12.426692 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrx6\" (UniqueName: \"kubernetes.io/projected/d835063d-37c3-4fc1-8fbe-a79ceb8b59eb-kube-api-access-khrx6\") pod \"prometheus-k8s-0\" (UID: \"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.536047 master-0 kubenswrapper[33142]: I1204 00:53:12.535951 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:12.806154 master-0 kubenswrapper[33142]: I1204 00:53:12.804488 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 00:53:12.999542 master-0 kubenswrapper[33142]: I1204 00:53:12.999259 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 00:53:13.005274 master-0 kubenswrapper[33142]: W1204 00:53:13.005237 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd835063d_37c3_4fc1_8fbe_a79ceb8b59eb.slice/crio-dec602763e16d8e2654daa97f9e4a0e862cb8227a35df75c7b6f514713f8e64e WatchSource:0}: Error finding container dec602763e16d8e2654daa97f9e4a0e862cb8227a35df75c7b6f514713f8e64e: Status 404 returned error can't find the container with id dec602763e16d8e2654daa97f9e4a0e862cb8227a35df75c7b6f514713f8e64e Dec 04 00:53:13.094239 master-0 kubenswrapper[33142]: I1204 00:53:13.094125 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"dec602763e16d8e2654daa97f9e4a0e862cb8227a35df75c7b6f514713f8e64e"} Dec 04 00:53:13.100117 master-0 kubenswrapper[33142]: I1204 00:53:13.097996 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" event={"ID":"5793144a-a95c-4f7c-8fd7-a5bda2057b68","Type":"ContainerStarted","Data":"007f891e3b435ea6e34e3564ab5e028a5a7f5125a40c2f36b451fbc6f513af41"} Dec 04 00:53:13.100117 master-0 kubenswrapper[33142]: I1204 00:53:13.098074 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" event={"ID":"5793144a-a95c-4f7c-8fd7-a5bda2057b68","Type":"ContainerStarted","Data":"4a4e33403e01562772c7febba55965afd1e88e953246df7f1adba0268acc1848"} Dec 04 00:53:13.100117 master-0 kubenswrapper[33142]: I1204 00:53:13.098687 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:13.103907 master-0 kubenswrapper[33142]: I1204 00:53:13.103849 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:53:13.155091 master-0 kubenswrapper[33142]: I1204 00:53:13.155037 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" podStartSLOduration=8.155016344 podStartE2EDuration="8.155016344s" podCreationTimestamp="2025-12-04 00:53:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:13.153547642 +0000 UTC m=+365.555549522" watchObservedRunningTime="2025-12-04 00:53:13.155016344 +0000 UTC m=+365.557018194" Dec 04 00:53:13.352366 master-0 kubenswrapper[33142]: E1204 00:53:13.351947 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd835063d_37c3_4fc1_8fbe_a79ceb8b59eb.slice/crio-conmon-b1e10366939bb2264b60411210c899f482db3cfb796d317e8dc40da52dece989.scope\": RecentStats: unable to find data in memory cache]" Dec 04 00:53:13.910123 master-0 kubenswrapper[33142]: I1204 00:53:13.910030 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6228387-579c-4398-adb0-1057429d2d5a" path="/var/lib/kubelet/pods/d6228387-579c-4398-adb0-1057429d2d5a/volumes" Dec 04 00:53:13.914015 master-0 kubenswrapper[33142]: I1204 00:53:13.913922 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 00:53:14.134122 master-0 kubenswrapper[33142]: I1204 00:53:14.134011 33142 generic.go:334] "Generic (PLEG): container finished" podID="d835063d-37c3-4fc1-8fbe-a79ceb8b59eb" containerID="b1e10366939bb2264b60411210c899f482db3cfb796d317e8dc40da52dece989" exitCode=0 Dec 04 00:53:14.135240 master-0 kubenswrapper[33142]: I1204 00:53:14.134710 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerDied","Data":"b1e10366939bb2264b60411210c899f482db3cfb796d317e8dc40da52dece989"} Dec 04 00:53:14.539981 master-0 kubenswrapper[33142]: I1204 00:53:14.539012 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.629546 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.629887 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="alertmanager" containerID="cri-o://ceac519cc78a0621f4e0f66fd933eef622f25925b900684fc9e3470b09d7fbfc" gracePeriod=120 Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.630035 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-metric" containerID="cri-o://719f415f557af07f94cc105e49d26d81b6e217134e978957e8b57ef12542d68c" gracePeriod=120 Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.630534 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="prom-label-proxy" containerID="cri-o://f14e74b3f0bd2e54f5e3dfefeb97bc72332a4df5c0dda0f58990bbee645076d3" gracePeriod=120 Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.630630 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-web" containerID="cri-o://1590a370115643af776ec49f6be908ea0a2961012c965f626da9d379be0ad735" gracePeriod=120 Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.630683 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy" containerID="cri-o://d344059697c171c9543feb745b02c0f41edae6d0375ef4f31a2390465b4af52e" gracePeriod=120 Dec 04 00:53:14.630898 master-0 kubenswrapper[33142]: I1204 00:53:14.630734 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="config-reloader" containerID="cri-o://6047e59de6d3739ed7cfa067e16161b9acd9f90daab68f4dbaf275d5c83236e2" gracePeriod=120 Dec 04 00:53:15.041011 master-0 kubenswrapper[33142]: I1204 00:53:15.028632 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 00:53:15.144422 master-0 kubenswrapper[33142]: I1204 00:53:15.144344 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"443135857aaf22533e9fd377407c42ffe6b0a0200b4baf2c5460457e6098ff4f"} Dec 04 00:53:15.144422 master-0 kubenswrapper[33142]: I1204 00:53:15.144412 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"0e21ac453bb43b5998a6fc836c14409b1401aa57c54bfcce1abbbb8787c9e00d"} Dec 04 00:53:15.144422 master-0 kubenswrapper[33142]: I1204 00:53:15.144427 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"0c57158436535b7205e84d11d338c376352bb6c6fccb388bfb489b7c65b92e47"} Dec 04 00:53:15.144422 master-0 kubenswrapper[33142]: I1204 00:53:15.144438 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"dab206f9d9c5cd44d259d4473a8b6b598787d8b117ed2cdb4b8e7dcfd222e656"} Dec 04 00:53:15.145093 master-0 kubenswrapper[33142]: I1204 00:53:15.144457 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"aff42dbaa5369c93db3514fbec411270f31df3eae10aee93dc2b2e013e4de26b"} Dec 04 00:53:15.151452 master-0 kubenswrapper[33142]: I1204 00:53:15.151414 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="f14e74b3f0bd2e54f5e3dfefeb97bc72332a4df5c0dda0f58990bbee645076d3" exitCode=0 Dec 04 00:53:15.151452 master-0 kubenswrapper[33142]: I1204 00:53:15.151445 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="719f415f557af07f94cc105e49d26d81b6e217134e978957e8b57ef12542d68c" exitCode=0 Dec 04 00:53:15.151452 master-0 kubenswrapper[33142]: I1204 00:53:15.151454 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="d344059697c171c9543feb745b02c0f41edae6d0375ef4f31a2390465b4af52e" exitCode=0 Dec 04 00:53:15.151598 master-0 kubenswrapper[33142]: I1204 00:53:15.151463 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="1590a370115643af776ec49f6be908ea0a2961012c965f626da9d379be0ad735" exitCode=0 Dec 04 00:53:15.151598 master-0 kubenswrapper[33142]: I1204 00:53:15.151471 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="6047e59de6d3739ed7cfa067e16161b9acd9f90daab68f4dbaf275d5c83236e2" exitCode=0 Dec 04 00:53:15.151598 master-0 kubenswrapper[33142]: I1204 00:53:15.151477 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerID="ceac519cc78a0621f4e0f66fd933eef622f25925b900684fc9e3470b09d7fbfc" exitCode=0 Dec 04 00:53:15.152175 master-0 kubenswrapper[33142]: I1204 00:53:15.152143 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"f14e74b3f0bd2e54f5e3dfefeb97bc72332a4df5c0dda0f58990bbee645076d3"} Dec 04 00:53:15.152175 master-0 kubenswrapper[33142]: I1204 00:53:15.152173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"719f415f557af07f94cc105e49d26d81b6e217134e978957e8b57ef12542d68c"} Dec 04 00:53:15.152263 master-0 kubenswrapper[33142]: I1204 00:53:15.152184 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"d344059697c171c9543feb745b02c0f41edae6d0375ef4f31a2390465b4af52e"} Dec 04 00:53:15.152263 master-0 kubenswrapper[33142]: I1204 00:53:15.152195 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"1590a370115643af776ec49f6be908ea0a2961012c965f626da9d379be0ad735"} Dec 04 00:53:15.152263 master-0 kubenswrapper[33142]: I1204 00:53:15.152204 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"6047e59de6d3739ed7cfa067e16161b9acd9f90daab68f4dbaf275d5c83236e2"} Dec 04 00:53:15.152263 master-0 kubenswrapper[33142]: I1204 00:53:15.152213 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"ceac519cc78a0621f4e0f66fd933eef622f25925b900684fc9e3470b09d7fbfc"} Dec 04 00:53:15.188437 master-0 kubenswrapper[33142]: I1204 00:53:15.188382 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.259937 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25xrb\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.259994 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260021 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260064 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260093 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260117 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260150 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260184 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260204 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260235 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260252 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.260330 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets\") pod \"c7fab3e2-b72e-482b-a5b8-555071666f3c\" (UID: \"c7fab3e2-b72e-482b-a5b8-555071666f3c\") " Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.261374 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.262189 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.262687 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb" (OuterVolumeSpecName: "kube-api-access-25xrb") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "kube-api-access-25xrb". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.263003 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267390 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267448 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume" (OuterVolumeSpecName: "config-volume") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267412 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267508 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267567 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out" (OuterVolumeSpecName: "config-out") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.267601 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.274075 master-0 kubenswrapper[33142]: I1204 00:53:15.268556 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.325445 master-0 kubenswrapper[33142]: I1204 00:53:15.325368 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config" (OuterVolumeSpecName: "web-config") pod "c7fab3e2-b72e-482b-a5b8-555071666f3c" (UID: "c7fab3e2-b72e-482b-a5b8-555071666f3c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:15.362546 master-0 kubenswrapper[33142]: I1204 00:53:15.362474 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-25xrb\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-kube-api-access-25xrb\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362546 master-0 kubenswrapper[33142]: I1204 00:53:15.362527 33142 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362546 master-0 kubenswrapper[33142]: I1204 00:53:15.362538 33142 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-web-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362546 master-0 kubenswrapper[33142]: I1204 00:53:15.362548 33142 reconciler_common.go:293] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-metrics-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362546 master-0 kubenswrapper[33142]: I1204 00:53:15.362558 33142 reconciler_common.go:293] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-main-db\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362568 33142 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-web\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362580 33142 reconciler_common.go:293] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fab3e2-b72e-482b-a5b8-555071666f3c-alertmanager-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362591 33142 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7fab3e2-b72e-482b-a5b8-555071666f3c-config-out\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362601 33142 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-main-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362614 33142 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362627 33142 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7fab3e2-b72e-482b-a5b8-555071666f3c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.362905 master-0 kubenswrapper[33142]: I1204 00:53:15.362640 33142 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7fab3e2-b72e-482b-a5b8-555071666f3c-tls-assets\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:15.535380 master-0 kubenswrapper[33142]: I1204 00:53:15.535190 33142 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 00:53:15.776481 master-0 kubenswrapper[33142]: I1204 00:53:15.776404 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 00:53:15.898535 master-0 kubenswrapper[33142]: I1204 00:53:15.898439 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:15.899517 master-0 kubenswrapper[33142]: I1204 00:53:15.899456 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:16.166677 master-0 kubenswrapper[33142]: I1204 00:53:16.166520 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7fab3e2-b72e-482b-a5b8-555071666f3c","Type":"ContainerDied","Data":"c45530bfeb63f93bb7bff09eef12c73cae09b69646a6f52660aaad5653923556"} Dec 04 00:53:16.166677 master-0 kubenswrapper[33142]: I1204 00:53:16.166599 33142 scope.go:117] "RemoveContainer" containerID="f14e74b3f0bd2e54f5e3dfefeb97bc72332a4df5c0dda0f58990bbee645076d3" Dec 04 00:53:16.166677 master-0 kubenswrapper[33142]: I1204 00:53:16.166604 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.173422 master-0 kubenswrapper[33142]: I1204 00:53:16.172643 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835063d-37c3-4fc1-8fbe-a79ceb8b59eb","Type":"ContainerStarted","Data":"24774024b7742d01b519eb692227934cfa406cdea3b344c92f12a92e78d58da3"} Dec 04 00:53:16.196535 master-0 kubenswrapper[33142]: I1204 00:53:16.195576 33142 scope.go:117] "RemoveContainer" containerID="719f415f557af07f94cc105e49d26d81b6e217134e978957e8b57ef12542d68c" Dec 04 00:53:16.206623 master-0 kubenswrapper[33142]: I1204 00:53:16.206335 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:16.213243 master-0 kubenswrapper[33142]: I1204 00:53:16.213182 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:16.218618 master-0 kubenswrapper[33142]: I1204 00:53:16.218570 33142 scope.go:117] "RemoveContainer" containerID="d344059697c171c9543feb745b02c0f41edae6d0375ef4f31a2390465b4af52e" Dec 04 00:53:16.244518 master-0 kubenswrapper[33142]: I1204 00:53:16.244318 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244661 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244678 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244688 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="alertmanager" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244693 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="alertmanager" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244704 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="init-config-reloader" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244711 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="init-config-reloader" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244722 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="config-reloader" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244728 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="config-reloader" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244738 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-web" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244745 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-web" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: E1204 00:53:16.244767 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="prom-label-proxy" Dec 04 00:53:16.244774 master-0 kubenswrapper[33142]: I1204 00:53:16.244774 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="prom-label-proxy" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: E1204 00:53:16.244799 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-metric" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.244806 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-metric" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.244949 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="alertmanager" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.244968 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="config-reloader" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.244985 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="prom-label-proxy" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.244994 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-metric" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.245008 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy" Dec 04 00:53:16.245290 master-0 kubenswrapper[33142]: I1204 00:53:16.245029 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" containerName="kube-rbac-proxy-web" Dec 04 00:53:16.247115 master-0 kubenswrapper[33142]: I1204 00:53:16.247073 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.249259 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-wmf68" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.250948 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.252981 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.253160 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.256265 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.256462 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 00:53:16.259018 master-0 kubenswrapper[33142]: I1204 00:53:16.257412 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 00:53:16.260602 master-0 kubenswrapper[33142]: I1204 00:53:16.260458 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 00:53:16.262596 master-0 kubenswrapper[33142]: I1204 00:53:16.262462 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:16.264452 master-0 kubenswrapper[33142]: I1204 00:53:16.264292 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.264268765 podStartE2EDuration="4.264268765s" podCreationTimestamp="2025-12-04 00:53:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:16.254240741 +0000 UTC m=+368.656242601" watchObservedRunningTime="2025-12-04 00:53:16.264268765 +0000 UTC m=+368.666270605" Dec 04 00:53:16.265721 master-0 kubenswrapper[33142]: I1204 00:53:16.265556 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 00:53:16.285472 master-0 kubenswrapper[33142]: I1204 00:53:16.277149 33142 scope.go:117] "RemoveContainer" containerID="1590a370115643af776ec49f6be908ea0a2961012c965f626da9d379be0ad735" Dec 04 00:53:16.301509 master-0 kubenswrapper[33142]: I1204 00:53:16.301466 33142 scope.go:117] "RemoveContainer" containerID="6047e59de6d3739ed7cfa067e16161b9acd9f90daab68f4dbaf275d5c83236e2" Dec 04 00:53:16.323233 master-0 kubenswrapper[33142]: I1204 00:53:16.323184 33142 scope.go:117] "RemoveContainer" containerID="ceac519cc78a0621f4e0f66fd933eef622f25925b900684fc9e3470b09d7fbfc" Dec 04 00:53:16.342141 master-0 kubenswrapper[33142]: I1204 00:53:16.342099 33142 scope.go:117] "RemoveContainer" containerID="31016be5d0c7e35636c6bcaec97c32d23fdfd166ac7d3370bbc96793ab36802b" Dec 04 00:53:16.379206 master-0 kubenswrapper[33142]: I1204 00:53:16.379138 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379306 master-0 kubenswrapper[33142]: I1204 00:53:16.379230 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379306 master-0 kubenswrapper[33142]: I1204 00:53:16.379254 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379306 master-0 kubenswrapper[33142]: I1204 00:53:16.379271 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379639 master-0 kubenswrapper[33142]: I1204 00:53:16.379577 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379705 master-0 kubenswrapper[33142]: I1204 00:53:16.379674 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379781 master-0 kubenswrapper[33142]: I1204 00:53:16.379757 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379822 master-0 kubenswrapper[33142]: I1204 00:53:16.379789 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379860 master-0 kubenswrapper[33142]: I1204 00:53:16.379832 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379896 master-0 kubenswrapper[33142]: I1204 00:53:16.379862 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.379951 master-0 kubenswrapper[33142]: I1204 00:53:16.379906 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrrdv\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-kube-api-access-lrrdv\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.380021 master-0 kubenswrapper[33142]: I1204 00:53:16.379998 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.445858 master-0 kubenswrapper[33142]: W1204 00:53:16.445788 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1f393a_2463_4144_a276_3673bdeae8a2.slice/crio-4a693538bd7af02f967725c9bcba2f464b5dd8729fe16e8cd7515588fd3cb1cb WatchSource:0}: Error finding container 4a693538bd7af02f967725c9bcba2f464b5dd8729fe16e8cd7515588fd3cb1cb: Status 404 returned error can't find the container with id 4a693538bd7af02f967725c9bcba2f464b5dd8729fe16e8cd7515588fd3cb1cb Dec 04 00:53:16.446652 master-0 kubenswrapper[33142]: I1204 00:53:16.446575 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-6dd96bc56-2k2q7"] Dec 04 00:53:16.481450 master-0 kubenswrapper[33142]: I1204 00:53:16.481373 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481470 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481509 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481526 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481543 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481577 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481602 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481631 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481649 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.481683 master-0 kubenswrapper[33142]: I1204 00:53:16.481670 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.482138 master-0 kubenswrapper[33142]: I1204 00:53:16.481688 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.482138 master-0 kubenswrapper[33142]: I1204 00:53:16.481708 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lrrdv\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-kube-api-access-lrrdv\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.485160 master-0 kubenswrapper[33142]: I1204 00:53:16.484620 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.485249 master-0 kubenswrapper[33142]: I1204 00:53:16.485206 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.487068 master-0 kubenswrapper[33142]: I1204 00:53:16.487028 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.487784 master-0 kubenswrapper[33142]: I1204 00:53:16.487581 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a86808d-5aed-496e-b46d-c62e0e2afc8c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.487839 master-0 kubenswrapper[33142]: I1204 00:53:16.487790 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.488603 master-0 kubenswrapper[33142]: I1204 00:53:16.488483 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.490010 master-0 kubenswrapper[33142]: I1204 00:53:16.489975 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-web-config\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.491585 master-0 kubenswrapper[33142]: I1204 00:53:16.491516 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.493548 master-0 kubenswrapper[33142]: I1204 00:53:16.493248 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a86808d-5aed-496e-b46d-c62e0e2afc8c-config-out\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.499240 master-0 kubenswrapper[33142]: I1204 00:53:16.494374 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a86808d-5aed-496e-b46d-c62e0e2afc8c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.499240 master-0 kubenswrapper[33142]: I1204 00:53:16.497137 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.500045 master-0 kubenswrapper[33142]: I1204 00:53:16.499666 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrrdv\" (UniqueName: \"kubernetes.io/projected/1a86808d-5aed-496e-b46d-c62e0e2afc8c-kube-api-access-lrrdv\") pod \"alertmanager-main-0\" (UID: \"1a86808d-5aed-496e-b46d-c62e0e2afc8c\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:16.590601 master-0 kubenswrapper[33142]: I1204 00:53:16.590516 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 00:53:17.022198 master-0 kubenswrapper[33142]: I1204 00:53:17.022125 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 00:53:17.028501 master-0 kubenswrapper[33142]: W1204 00:53:17.028399 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a86808d_5aed_496e_b46d_c62e0e2afc8c.slice/crio-8e4ea47701fb19531131e5faf353f363fd6ae9f499bb9d377bb3d3bf7c04e7b8 WatchSource:0}: Error finding container 8e4ea47701fb19531131e5faf353f363fd6ae9f499bb9d377bb3d3bf7c04e7b8: Status 404 returned error can't find the container with id 8e4ea47701fb19531131e5faf353f363fd6ae9f499bb9d377bb3d3bf7c04e7b8 Dec 04 00:53:17.181787 master-0 kubenswrapper[33142]: I1204 00:53:17.181717 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" event={"ID":"3d1f393a-2463-4144-a276-3673bdeae8a2","Type":"ContainerStarted","Data":"4e8cab8639319e0a0ad9ba72101e4fe64123e8868ba98cd9b7027a765cfbb8b2"} Dec 04 00:53:17.181787 master-0 kubenswrapper[33142]: I1204 00:53:17.181773 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" event={"ID":"3d1f393a-2463-4144-a276-3673bdeae8a2","Type":"ContainerStarted","Data":"4a693538bd7af02f967725c9bcba2f464b5dd8729fe16e8cd7515588fd3cb1cb"} Dec 04 00:53:17.182581 master-0 kubenswrapper[33142]: I1204 00:53:17.182557 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:17.187059 master-0 kubenswrapper[33142]: I1204 00:53:17.186871 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"8e4ea47701fb19531131e5faf353f363fd6ae9f499bb9d377bb3d3bf7c04e7b8"} Dec 04 00:53:17.189242 master-0 kubenswrapper[33142]: I1204 00:53:17.189141 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" Dec 04 00:53:17.212430 master-0 kubenswrapper[33142]: I1204 00:53:17.212324 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-6dd96bc56-2k2q7" podStartSLOduration=97.212299804 podStartE2EDuration="1m37.212299804s" podCreationTimestamp="2025-12-04 00:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:17.205578514 +0000 UTC m=+369.607580374" watchObservedRunningTime="2025-12-04 00:53:17.212299804 +0000 UTC m=+369.614301664" Dec 04 00:53:17.536360 master-0 kubenswrapper[33142]: I1204 00:53:17.536296 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:53:17.561531 master-0 kubenswrapper[33142]: I1204 00:53:17.561444 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:17.561531 master-0 kubenswrapper[33142]: I1204 00:53:17.561534 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:17.564228 master-0 kubenswrapper[33142]: I1204 00:53:17.564145 33142 patch_prober.go:28] interesting pod/console-7b76b9bf5c-pdhg4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.108:8443/health\": dial tcp 10.128.0.108:8443: connect: connection refused" start-of-body= Dec 04 00:53:17.564432 master-0 kubenswrapper[33142]: I1204 00:53:17.564252 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-7b76b9bf5c-pdhg4" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerName="console" probeResult="failure" output="Get \"https://10.128.0.108:8443/health\": dial tcp 10.128.0.108:8443: connect: connection refused" Dec 04 00:53:17.741877 master-0 kubenswrapper[33142]: I1204 00:53:17.741819 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Dec 04 00:53:17.908167 master-0 kubenswrapper[33142]: I1204 00:53:17.908091 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7fab3e2-b72e-482b-a5b8-555071666f3c" path="/var/lib/kubelet/pods/c7fab3e2-b72e-482b-a5b8-555071666f3c/volumes" Dec 04 00:53:18.201807 master-0 kubenswrapper[33142]: I1204 00:53:18.200581 33142 generic.go:334] "Generic (PLEG): container finished" podID="1a86808d-5aed-496e-b46d-c62e0e2afc8c" containerID="f36fcff0a295446256e6a46d4f7fb7c12d46274d50b38c5f2801da416473a192" exitCode=0 Dec 04 00:53:18.203575 master-0 kubenswrapper[33142]: I1204 00:53:18.202238 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerDied","Data":"f36fcff0a295446256e6a46d4f7fb7c12d46274d50b38c5f2801da416473a192"} Dec 04 00:53:18.400587 master-0 kubenswrapper[33142]: I1204 00:53:18.400524 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 00:53:19.211120 master-0 kubenswrapper[33142]: I1204 00:53:19.211043 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"7fb38b49a19fee3fff10ba19c0b1abc512179700d5319eed68bd8f46ccf86d6a"} Dec 04 00:53:19.211120 master-0 kubenswrapper[33142]: I1204 00:53:19.211124 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"70c3f525511e944a6e0e513505becd57f6d0c3a2a49eb5fbdd3b99c495318b9f"} Dec 04 00:53:19.211653 master-0 kubenswrapper[33142]: I1204 00:53:19.211138 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"a0449cad29beb75ed82f7c7cac93fb48004a15627c976129e3f0382408e47d09"} Dec 04 00:53:19.211653 master-0 kubenswrapper[33142]: I1204 00:53:19.211151 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"c393efac8fecd9f609e369bbb508dc14ec231bd9c1de18dcc4e55e89f53bec2a"} Dec 04 00:53:19.211653 master-0 kubenswrapper[33142]: I1204 00:53:19.211167 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"0242850f9362fce36505fd20ce0f28857e935a7a330c6618755542e6bdc8da88"} Dec 04 00:53:19.775497 master-0 kubenswrapper[33142]: I1204 00:53:19.775437 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 00:53:20.112558 master-0 kubenswrapper[33142]: I1204 00:53:20.112474 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 00:53:20.232357 master-0 kubenswrapper[33142]: I1204 00:53:20.232286 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a86808d-5aed-496e-b46d-c62e0e2afc8c","Type":"ContainerStarted","Data":"33d9ef07f5c8a141d3216bd20e0ade32be0bc660387786352303fdf3dc74b4de"} Dec 04 00:53:20.291628 master-0 kubenswrapper[33142]: I1204 00:53:20.291531 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.291510096 podStartE2EDuration="4.291510096s" podCreationTimestamp="2025-12-04 00:53:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:20.28564799 +0000 UTC m=+372.687649890" watchObservedRunningTime="2025-12-04 00:53:20.291510096 +0000 UTC m=+372.693511966" Dec 04 00:53:21.129085 master-0 kubenswrapper[33142]: I1204 00:53:21.128912 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:21.129664 master-0 kubenswrapper[33142]: I1204 00:53:21.129611 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:21.131126 master-0 kubenswrapper[33142]: I1204 00:53:21.131068 33142 patch_prober.go:28] interesting pod/console-7bccf97b47-glshl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.110:8443/health\": dial tcp 10.128.0.110:8443: connect: connection refused" start-of-body= Dec 04 00:53:21.131259 master-0 kubenswrapper[33142]: I1204 00:53:21.131133 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-7bccf97b47-glshl" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" probeResult="failure" output="Get \"https://10.128.0.110:8443/health\": dial tcp 10.128.0.110:8443: connect: connection refused" Dec 04 00:53:22.890194 master-0 kubenswrapper[33142]: I1204 00:53:22.890107 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 00:53:27.566972 master-0 kubenswrapper[33142]: I1204 00:53:27.566885 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:27.572518 master-0 kubenswrapper[33142]: I1204 00:53:27.572437 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:29.938972 master-0 kubenswrapper[33142]: I1204 00:53:29.938867 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7c696657b7-787rc"] Dec 04 00:53:29.941421 master-0 kubenswrapper[33142]: I1204 00:53:29.941088 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:29.948085 master-0 kubenswrapper[33142]: I1204 00:53:29.947001 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-console"/"networking-console-plugin" Dec 04 00:53:29.948085 master-0 kubenswrapper[33142]: I1204 00:53:29.947325 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-console"/"networking-console-plugin-cert" Dec 04 00:53:29.984758 master-0 kubenswrapper[33142]: I1204 00:53:29.984690 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7c696657b7-787rc"] Dec 04 00:53:30.075995 master-0 kubenswrapper[33142]: I1204 00:53:30.075824 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cb4f390-7961-4f36-b0d0-e196fc91fe90-networking-console-plugin-cert\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.076240 master-0 kubenswrapper[33142]: I1204 00:53:30.076031 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cb4f390-7961-4f36-b0d0-e196fc91fe90-nginx-conf\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.177988 master-0 kubenswrapper[33142]: I1204 00:53:30.177877 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cb4f390-7961-4f36-b0d0-e196fc91fe90-networking-console-plugin-cert\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.178290 master-0 kubenswrapper[33142]: I1204 00:53:30.178023 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cb4f390-7961-4f36-b0d0-e196fc91fe90-nginx-conf\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.182963 master-0 kubenswrapper[33142]: I1204 00:53:30.179957 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cb4f390-7961-4f36-b0d0-e196fc91fe90-nginx-conf\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.195918 master-0 kubenswrapper[33142]: I1204 00:53:30.195864 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cb4f390-7961-4f36-b0d0-e196fc91fe90-networking-console-plugin-cert\") pod \"networking-console-plugin-7c696657b7-787rc\" (UID: \"6cb4f390-7961-4f36-b0d0-e196fc91fe90\") " pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.275637 master-0 kubenswrapper[33142]: I1204 00:53:30.275580 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" Dec 04 00:53:30.339695 master-0 kubenswrapper[33142]: I1204 00:53:30.339560 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:53:30.346106 master-0 kubenswrapper[33142]: I1204 00:53:30.346042 33142 generic.go:334] "Generic (PLEG): container finished" podID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" containerID="77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432" exitCode=0 Dec 04 00:53:30.346267 master-0 kubenswrapper[33142]: I1204 00:53:30.346118 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" event={"ID":"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a","Type":"ContainerDied","Data":"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432"} Dec 04 00:53:30.346267 master-0 kubenswrapper[33142]: I1204 00:53:30.346163 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" event={"ID":"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a","Type":"ContainerDied","Data":"b11d5bb0f90292ef85990b14e37a8a9627a172bf5ac4e294c63942ae4fc2f58b"} Dec 04 00:53:30.346267 master-0 kubenswrapper[33142]: I1204 00:53:30.346198 33142 scope.go:117] "RemoveContainer" containerID="77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432" Dec 04 00:53:30.346378 master-0 kubenswrapper[33142]: I1204 00:53:30.346347 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b4bbf8466-qk67v" Dec 04 00:53:30.387203 master-0 kubenswrapper[33142]: I1204 00:53:30.387151 33142 scope.go:117] "RemoveContainer" containerID="77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432" Dec 04 00:53:30.388383 master-0 kubenswrapper[33142]: E1204 00:53:30.388322 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432\": container with ID starting with 77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432 not found: ID does not exist" containerID="77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432" Dec 04 00:53:30.388475 master-0 kubenswrapper[33142]: I1204 00:53:30.388368 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432"} err="failed to get container status \"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432\": rpc error: code = NotFound desc = could not find container \"77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432\": container with ID starting with 77f9f75bbff2812fa25ffcde134ed28bfcd3af324fe13b7dac3791d44aa34432 not found: ID does not exist" Dec 04 00:53:30.483331 master-0 kubenswrapper[33142]: I1204 00:53:30.483191 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.483730 master-0 kubenswrapper[33142]: I1204 00:53:30.483690 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.483890 master-0 kubenswrapper[33142]: I1204 00:53:30.483860 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.485200 master-0 kubenswrapper[33142]: I1204 00:53:30.484164 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.485200 master-0 kubenswrapper[33142]: I1204 00:53:30.484213 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.485200 master-0 kubenswrapper[33142]: I1204 00:53:30.484283 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.485200 master-0 kubenswrapper[33142]: I1204 00:53:30.484332 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") pod \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\" (UID: \"4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a\") " Dec 04 00:53:30.485548 master-0 kubenswrapper[33142]: I1204 00:53:30.485500 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles" (OuterVolumeSpecName: "metrics-server-audit-profiles") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "metrics-server-audit-profiles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:30.485848 master-0 kubenswrapper[33142]: I1204 00:53:30.485600 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log" (OuterVolumeSpecName: "audit-log") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "audit-log". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:53:30.485848 master-0 kubenswrapper[33142]: I1204 00:53:30.485812 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:30.486472 master-0 kubenswrapper[33142]: I1204 00:53:30.486432 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle" (OuterVolumeSpecName: "client-ca-bundle") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "client-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:30.487337 master-0 kubenswrapper[33142]: I1204 00:53:30.487286 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h" (OuterVolumeSpecName: "kube-api-access-2jn9h") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "kube-api-access-2jn9h". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:30.488267 master-0 kubenswrapper[33142]: I1204 00:53:30.488225 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls" (OuterVolumeSpecName: "secret-metrics-server-tls") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "secret-metrics-server-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:30.488431 master-0 kubenswrapper[33142]: I1204 00:53:30.488349 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" (UID: "4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586585 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-client-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586643 33142 reconciler_common.go:293] "Volume detached for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-audit-log\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586658 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2jn9h\" (UniqueName: \"kubernetes.io/projected/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-kube-api-access-2jn9h\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586673 33142 reconciler_common.go:293] "Volume detached for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-server-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586689 33142 reconciler_common.go:293] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-secret-metrics-client-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586704 33142 reconciler_common.go:293] "Volume detached for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-metrics-server-audit-profiles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.588422 master-0 kubenswrapper[33142]: I1204 00:53:30.586719 33142 reconciler_common.go:293] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a-configmap-kubelet-serving-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:30.703895 master-0 kubenswrapper[33142]: I1204 00:53:30.703828 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:53:30.708859 master-0 kubenswrapper[33142]: I1204 00:53:30.708796 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/metrics-server-6b4bbf8466-qk67v"] Dec 04 00:53:30.729957 master-0 kubenswrapper[33142]: I1204 00:53:30.729880 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7c696657b7-787rc"] Dec 04 00:53:31.132748 master-0 kubenswrapper[33142]: I1204 00:53:31.132677 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:31.136568 master-0 kubenswrapper[33142]: I1204 00:53:31.136541 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:53:31.336652 master-0 kubenswrapper[33142]: I1204 00:53:31.336567 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:31.372860 master-0 kubenswrapper[33142]: I1204 00:53:31.371518 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" event={"ID":"6cb4f390-7961-4f36-b0d0-e196fc91fe90","Type":"ContainerStarted","Data":"92ed43fc49d05c265757ec964957ad64ee3dc617a3c2c53b94982530bb9e9da8"} Dec 04 00:53:31.912716 master-0 kubenswrapper[33142]: I1204 00:53:31.912659 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" path="/var/lib/kubelet/pods/4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a/volumes" Dec 04 00:53:32.256330 master-0 kubenswrapper[33142]: I1204 00:53:32.256151 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-5fb74f878d-dqq2p" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" containerID="cri-o://9027d1ac1b02172fe1d037c3f0ec1cc0a7094de2c3f5906c4a6e487a604f306d" gracePeriod=15 Dec 04 00:53:32.382160 master-0 kubenswrapper[33142]: I1204 00:53:32.382077 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb74f878d-dqq2p_b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86/console/0.log" Dec 04 00:53:32.382422 master-0 kubenswrapper[33142]: I1204 00:53:32.382173 33142 generic.go:334] "Generic (PLEG): container finished" podID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerID="9027d1ac1b02172fe1d037c3f0ec1cc0a7094de2c3f5906c4a6e487a604f306d" exitCode=2 Dec 04 00:53:32.382422 master-0 kubenswrapper[33142]: I1204 00:53:32.382226 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb74f878d-dqq2p" event={"ID":"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86","Type":"ContainerDied","Data":"9027d1ac1b02172fe1d037c3f0ec1cc0a7094de2c3f5906c4a6e487a604f306d"} Dec 04 00:53:33.249480 master-0 kubenswrapper[33142]: I1204 00:53:33.249423 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb74f878d-dqq2p_b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86/console/0.log" Dec 04 00:53:33.249625 master-0 kubenswrapper[33142]: I1204 00:53:33.249562 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:53:33.393827 master-0 kubenswrapper[33142]: I1204 00:53:33.393742 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" event={"ID":"6cb4f390-7961-4f36-b0d0-e196fc91fe90","Type":"ContainerStarted","Data":"0529b65ba6adaa89da17e05d852f7fc369f76e2383e3141afc40cd338206ddaf"} Dec 04 00:53:33.398650 master-0 kubenswrapper[33142]: I1204 00:53:33.398567 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb74f878d-dqq2p_b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86/console/0.log" Dec 04 00:53:33.398903 master-0 kubenswrapper[33142]: I1204 00:53:33.398718 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb74f878d-dqq2p" event={"ID":"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86","Type":"ContainerDied","Data":"d04b0b3db66462080f7ae4c4b26dc82cf86f293a81f1a5260b8c60ec324dc02a"} Dec 04 00:53:33.398903 master-0 kubenswrapper[33142]: I1204 00:53:33.398773 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb74f878d-dqq2p" Dec 04 00:53:33.398903 master-0 kubenswrapper[33142]: I1204 00:53:33.398799 33142 scope.go:117] "RemoveContainer" containerID="9027d1ac1b02172fe1d037c3f0ec1cc0a7094de2c3f5906c4a6e487a604f306d" Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.436522 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.436621 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.436714 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22nd5\" (UniqueName: \"kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.436776 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.436802 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.437198 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca\") pod \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\" (UID: \"b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86\") " Dec 04 00:53:33.438064 master-0 kubenswrapper[33142]: I1204 00:53:33.437965 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:33.438481 master-0 kubenswrapper[33142]: I1204 00:53:33.438162 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config" (OuterVolumeSpecName: "console-config") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:33.438481 master-0 kubenswrapper[33142]: I1204 00:53:33.438219 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:33.440747 master-0 kubenswrapper[33142]: I1204 00:53:33.440718 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:33.440980 master-0 kubenswrapper[33142]: I1204 00:53:33.440878 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5" (OuterVolumeSpecName: "kube-api-access-22nd5") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "kube-api-access-22nd5". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:33.441228 master-0 kubenswrapper[33142]: I1204 00:53:33.441198 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" (UID: "b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:33.540357 master-0 kubenswrapper[33142]: I1204 00:53:33.540294 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.540357 master-0 kubenswrapper[33142]: I1204 00:53:33.540353 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.540552 master-0 kubenswrapper[33142]: I1204 00:53:33.540379 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.540552 master-0 kubenswrapper[33142]: I1204 00:53:33.540400 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-22nd5\" (UniqueName: \"kubernetes.io/projected/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-kube-api-access-22nd5\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.540552 master-0 kubenswrapper[33142]: I1204 00:53:33.540418 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.540552 master-0 kubenswrapper[33142]: I1204 00:53:33.540435 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:33.770504 master-0 kubenswrapper[33142]: I1204 00:53:33.770395 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:53:33.817853 master-0 kubenswrapper[33142]: I1204 00:53:33.817753 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb74f878d-dqq2p"] Dec 04 00:53:33.924240 master-0 kubenswrapper[33142]: I1204 00:53:33.924154 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" path="/var/lib/kubelet/pods/b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86/volumes" Dec 04 00:53:34.495705 master-0 kubenswrapper[33142]: I1204 00:53:34.495586 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7c696657b7-787rc" podStartSLOduration=3.148471466 podStartE2EDuration="5.495553252s" podCreationTimestamp="2025-12-04 00:53:29 +0000 UTC" firstStartedPulling="2025-12-04 00:53:30.724854333 +0000 UTC m=+383.126856183" lastFinishedPulling="2025-12-04 00:53:33.071936119 +0000 UTC m=+385.473937969" observedRunningTime="2025-12-04 00:53:34.491432315 +0000 UTC m=+386.893434195" watchObservedRunningTime="2025-12-04 00:53:34.495553252 +0000 UTC m=+386.897555112" Dec 04 00:53:35.791886 master-0 kubenswrapper[33142]: I1204 00:53:35.791736 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-584b5bc58b-k2thl" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" containerID="cri-o://c88fe8acc2de8cc22b6b5f4c39aacb25104105ea8fcf1c8b42732a501acc8b0a" gracePeriod=15 Dec 04 00:53:36.429010 master-0 kubenswrapper[33142]: I1204 00:53:36.428951 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-584b5bc58b-k2thl_aad5a3ac-d69e-457d-b873-3c18d4fa0cf4/console/0.log" Dec 04 00:53:36.429286 master-0 kubenswrapper[33142]: I1204 00:53:36.429248 33142 generic.go:334] "Generic (PLEG): container finished" podID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerID="c88fe8acc2de8cc22b6b5f4c39aacb25104105ea8fcf1c8b42732a501acc8b0a" exitCode=2 Dec 04 00:53:36.429357 master-0 kubenswrapper[33142]: I1204 00:53:36.429295 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584b5bc58b-k2thl" event={"ID":"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4","Type":"ContainerDied","Data":"c88fe8acc2de8cc22b6b5f4c39aacb25104105ea8fcf1c8b42732a501acc8b0a"} Dec 04 00:53:37.074965 master-0 kubenswrapper[33142]: I1204 00:53:37.074879 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-584b5bc58b-k2thl_aad5a3ac-d69e-457d-b873-3c18d4fa0cf4/console/0.log" Dec 04 00:53:37.075619 master-0 kubenswrapper[33142]: I1204 00:53:37.074994 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:53:37.105387 master-0 kubenswrapper[33142]: I1204 00:53:37.105311 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105630 master-0 kubenswrapper[33142]: I1204 00:53:37.105437 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105630 master-0 kubenswrapper[33142]: I1204 00:53:37.105488 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105630 master-0 kubenswrapper[33142]: I1204 00:53:37.105523 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105630 master-0 kubenswrapper[33142]: I1204 00:53:37.105597 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105630 master-0 kubenswrapper[33142]: I1204 00:53:37.105623 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.105830 master-0 kubenswrapper[33142]: I1204 00:53:37.105645 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtttn\" (UniqueName: \"kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn\") pod \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\" (UID: \"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4\") " Dec 04 00:53:37.109037 master-0 kubenswrapper[33142]: I1204 00:53:37.107534 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:37.109037 master-0 kubenswrapper[33142]: I1204 00:53:37.108136 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:37.109037 master-0 kubenswrapper[33142]: I1204 00:53:37.108767 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config" (OuterVolumeSpecName: "console-config") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:37.110303 master-0 kubenswrapper[33142]: I1204 00:53:37.110211 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:37.110616 master-0 kubenswrapper[33142]: I1204 00:53:37.110563 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:37.112457 master-0 kubenswrapper[33142]: I1204 00:53:37.112390 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:37.116188 master-0 kubenswrapper[33142]: I1204 00:53:37.116138 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn" (OuterVolumeSpecName: "kube-api-access-jtttn") pod "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" (UID: "aad5a3ac-d69e-457d-b873-3c18d4fa0cf4"). InnerVolumeSpecName "kube-api-access-jtttn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:37.207407 master-0 kubenswrapper[33142]: I1204 00:53:37.207325 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207407 master-0 kubenswrapper[33142]: I1204 00:53:37.207383 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207407 master-0 kubenswrapper[33142]: I1204 00:53:37.207399 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207407 master-0 kubenswrapper[33142]: I1204 00:53:37.207412 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207407 master-0 kubenswrapper[33142]: I1204 00:53:37.207424 33142 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207844 master-0 kubenswrapper[33142]: I1204 00:53:37.207438 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtttn\" (UniqueName: \"kubernetes.io/projected/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-kube-api-access-jtttn\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.207844 master-0 kubenswrapper[33142]: I1204 00:53:37.207450 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:37.438249 master-0 kubenswrapper[33142]: I1204 00:53:37.438161 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-584b5bc58b-k2thl_aad5a3ac-d69e-457d-b873-3c18d4fa0cf4/console/0.log" Dec 04 00:53:37.438570 master-0 kubenswrapper[33142]: I1204 00:53:37.438267 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584b5bc58b-k2thl" event={"ID":"aad5a3ac-d69e-457d-b873-3c18d4fa0cf4","Type":"ContainerDied","Data":"1c0247cf1936aa86ee593140285df4afd5f08dae136a9ba513c18bca36ad6cd5"} Dec 04 00:53:37.438570 master-0 kubenswrapper[33142]: I1204 00:53:37.438332 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584b5bc58b-k2thl" Dec 04 00:53:37.438570 master-0 kubenswrapper[33142]: I1204 00:53:37.438336 33142 scope.go:117] "RemoveContainer" containerID="c88fe8acc2de8cc22b6b5f4c39aacb25104105ea8fcf1c8b42732a501acc8b0a" Dec 04 00:53:37.485981 master-0 kubenswrapper[33142]: I1204 00:53:37.485857 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:53:37.500646 master-0 kubenswrapper[33142]: I1204 00:53:37.500574 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584b5bc58b-k2thl"] Dec 04 00:53:37.907649 master-0 kubenswrapper[33142]: I1204 00:53:37.907530 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" path="/var/lib/kubelet/pods/aad5a3ac-d69e-457d-b873-3c18d4fa0cf4/volumes" Dec 04 00:53:44.489789 master-0 kubenswrapper[33142]: I1204 00:53:44.489734 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:53:44.490872 master-0 kubenswrapper[33142]: E1204 00:53:44.490849 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" containerName="metrics-server" Dec 04 00:53:44.491000 master-0 kubenswrapper[33142]: I1204 00:53:44.490984 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" containerName="metrics-server" Dec 04 00:53:44.491119 master-0 kubenswrapper[33142]: E1204 00:53:44.491104 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" Dec 04 00:53:44.491197 master-0 kubenswrapper[33142]: I1204 00:53:44.491185 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" Dec 04 00:53:44.491300 master-0 kubenswrapper[33142]: E1204 00:53:44.491286 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" Dec 04 00:53:44.491380 master-0 kubenswrapper[33142]: I1204 00:53:44.491367 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" Dec 04 00:53:44.491617 master-0 kubenswrapper[33142]: I1204 00:53:44.491600 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="4c154d51-5e12-4f76-a0ad-6b5d85ba5e0a" containerName="metrics-server" Dec 04 00:53:44.491730 master-0 kubenswrapper[33142]: I1204 00:53:44.491716 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="aad5a3ac-d69e-457d-b873-3c18d4fa0cf4" containerName="console" Dec 04 00:53:44.491816 master-0 kubenswrapper[33142]: I1204 00:53:44.491803 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6ab2496-d38e-4ec8-bea5-ea9f6bce8a86" containerName="console" Dec 04 00:53:44.492613 master-0 kubenswrapper[33142]: I1204 00:53:44.492591 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.507530 master-0 kubenswrapper[33142]: I1204 00:53:44.507464 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542135 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542227 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542440 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542596 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4hwx\" (UniqueName: \"kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542633 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542671 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.545895 master-0 kubenswrapper[33142]: I1204 00:53:44.542719 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645085 master-0 kubenswrapper[33142]: I1204 00:53:44.645018 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645085 master-0 kubenswrapper[33142]: I1204 00:53:44.645093 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645455 master-0 kubenswrapper[33142]: I1204 00:53:44.645132 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645455 master-0 kubenswrapper[33142]: I1204 00:53:44.645202 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t4hwx\" (UniqueName: \"kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645455 master-0 kubenswrapper[33142]: I1204 00:53:44.645230 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645455 master-0 kubenswrapper[33142]: I1204 00:53:44.645254 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.645455 master-0 kubenswrapper[33142]: I1204 00:53:44.645295 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.646495 master-0 kubenswrapper[33142]: I1204 00:53:44.646462 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.646640 master-0 kubenswrapper[33142]: I1204 00:53:44.646590 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.646862 master-0 kubenswrapper[33142]: I1204 00:53:44.646840 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.649697 master-0 kubenswrapper[33142]: I1204 00:53:44.649640 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.650248 master-0 kubenswrapper[33142]: I1204 00:53:44.650222 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.652102 master-0 kubenswrapper[33142]: I1204 00:53:44.652038 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.666346 master-0 kubenswrapper[33142]: I1204 00:53:44.666264 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4hwx\" (UniqueName: \"kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx\") pod \"console-7857bf7774-r72g8\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:44.818498 master-0 kubenswrapper[33142]: I1204 00:53:44.818292 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:45.290750 master-0 kubenswrapper[33142]: I1204 00:53:45.290677 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:53:45.294965 master-0 kubenswrapper[33142]: W1204 00:53:45.294852 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f703a1_0e2c_4545_a9a3_cbc9e3768766.slice/crio-e1dbb7c7ee8829de12df4b2c94fd087ca24746d881a5ceb955b6f3d82faa442a WatchSource:0}: Error finding container e1dbb7c7ee8829de12df4b2c94fd087ca24746d881a5ceb955b6f3d82faa442a: Status 404 returned error can't find the container with id e1dbb7c7ee8829de12df4b2c94fd087ca24746d881a5ceb955b6f3d82faa442a Dec 04 00:53:45.506862 master-0 kubenswrapper[33142]: I1204 00:53:45.506762 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857bf7774-r72g8" event={"ID":"c9f703a1-0e2c-4545-a9a3-cbc9e3768766","Type":"ContainerStarted","Data":"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b"} Dec 04 00:53:45.506862 master-0 kubenswrapper[33142]: I1204 00:53:45.506841 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857bf7774-r72g8" event={"ID":"c9f703a1-0e2c-4545-a9a3-cbc9e3768766","Type":"ContainerStarted","Data":"e1dbb7c7ee8829de12df4b2c94fd087ca24746d881a5ceb955b6f3d82faa442a"} Dec 04 00:53:45.536375 master-0 kubenswrapper[33142]: I1204 00:53:45.536230 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7857bf7774-r72g8" podStartSLOduration=1.536194616 podStartE2EDuration="1.536194616s" podCreationTimestamp="2025-12-04 00:53:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:53:45.530832944 +0000 UTC m=+397.932834804" watchObservedRunningTime="2025-12-04 00:53:45.536194616 +0000 UTC m=+397.938196466" Dec 04 00:53:54.818405 master-0 kubenswrapper[33142]: I1204 00:53:54.818335 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:54.819278 master-0 kubenswrapper[33142]: I1204 00:53:54.819256 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:54.825167 master-0 kubenswrapper[33142]: I1204 00:53:54.825111 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:55.610805 master-0 kubenswrapper[33142]: I1204 00:53:55.610737 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:53:55.707493 master-0 kubenswrapper[33142]: I1204 00:53:55.707436 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:53:56.380042 master-0 kubenswrapper[33142]: I1204 00:53:56.379826 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-7b76b9bf5c-pdhg4" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerName="console" containerID="cri-o://907bfb75caf20de81fc13e88a6a794f8f7552c16230f2035d597ff056d47dea8" gracePeriod=15 Dec 04 00:53:56.623452 master-0 kubenswrapper[33142]: I1204 00:53:56.623415 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b76b9bf5c-pdhg4_d6827961-175c-463a-8fd5-d3bd923a67f5/console/0.log" Dec 04 00:53:56.623739 master-0 kubenswrapper[33142]: I1204 00:53:56.623716 33142 generic.go:334] "Generic (PLEG): container finished" podID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerID="907bfb75caf20de81fc13e88a6a794f8f7552c16230f2035d597ff056d47dea8" exitCode=2 Dec 04 00:53:56.623918 master-0 kubenswrapper[33142]: I1204 00:53:56.623852 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b76b9bf5c-pdhg4" event={"ID":"d6827961-175c-463a-8fd5-d3bd923a67f5","Type":"ContainerDied","Data":"907bfb75caf20de81fc13e88a6a794f8f7552c16230f2035d597ff056d47dea8"} Dec 04 00:53:56.981534 master-0 kubenswrapper[33142]: I1204 00:53:56.981457 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b76b9bf5c-pdhg4_d6827961-175c-463a-8fd5-d3bd923a67f5/console/0.log" Dec 04 00:53:56.981813 master-0 kubenswrapper[33142]: I1204 00:53:56.981549 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:57.073262 master-0 kubenswrapper[33142]: I1204 00:53:57.072312 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073499 master-0 kubenswrapper[33142]: I1204 00:53:57.073360 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073499 master-0 kubenswrapper[33142]: I1204 00:53:57.073488 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073638 master-0 kubenswrapper[33142]: I1204 00:53:57.073596 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv56g\" (UniqueName: \"kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073738 master-0 kubenswrapper[33142]: I1204 00:53:57.073667 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:57.073738 master-0 kubenswrapper[33142]: I1204 00:53:57.073713 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073829 master-0 kubenswrapper[33142]: I1204 00:53:57.073779 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.073885 master-0 kubenswrapper[33142]: I1204 00:53:57.073852 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca\") pod \"d6827961-175c-463a-8fd5-d3bd923a67f5\" (UID: \"d6827961-175c-463a-8fd5-d3bd923a67f5\") " Dec 04 00:53:57.074534 master-0 kubenswrapper[33142]: I1204 00:53:57.074501 33142 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.074644 master-0 kubenswrapper[33142]: I1204 00:53:57.074602 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:57.074946 master-0 kubenswrapper[33142]: I1204 00:53:57.074887 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config" (OuterVolumeSpecName: "console-config") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:57.077351 master-0 kubenswrapper[33142]: I1204 00:53:57.077297 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:57.077686 master-0 kubenswrapper[33142]: I1204 00:53:57.077612 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:53:57.078728 master-0 kubenswrapper[33142]: I1204 00:53:57.078665 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:53:57.079654 master-0 kubenswrapper[33142]: I1204 00:53:57.079606 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g" (OuterVolumeSpecName: "kube-api-access-rv56g") pod "d6827961-175c-463a-8fd5-d3bd923a67f5" (UID: "d6827961-175c-463a-8fd5-d3bd923a67f5"). InnerVolumeSpecName "kube-api-access-rv56g". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176252 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176303 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176317 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rv56g\" (UniqueName: \"kubernetes.io/projected/d6827961-175c-463a-8fd5-d3bd923a67f5-kube-api-access-rv56g\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176330 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6827961-175c-463a-8fd5-d3bd923a67f5-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176342 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.176389 master-0 kubenswrapper[33142]: I1204 00:53:57.176355 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6827961-175c-463a-8fd5-d3bd923a67f5-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:53:57.636352 master-0 kubenswrapper[33142]: I1204 00:53:57.636276 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b76b9bf5c-pdhg4_d6827961-175c-463a-8fd5-d3bd923a67f5/console/0.log" Dec 04 00:53:57.637116 master-0 kubenswrapper[33142]: I1204 00:53:57.636426 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b76b9bf5c-pdhg4" event={"ID":"d6827961-175c-463a-8fd5-d3bd923a67f5","Type":"ContainerDied","Data":"1e50844ff949a27eef6a967254aa8c99881f876e8341760c9cd13d33e32a0167"} Dec 04 00:53:57.637116 master-0 kubenswrapper[33142]: I1204 00:53:57.636507 33142 scope.go:117] "RemoveContainer" containerID="907bfb75caf20de81fc13e88a6a794f8f7552c16230f2035d597ff056d47dea8" Dec 04 00:53:57.637116 master-0 kubenswrapper[33142]: I1204 00:53:57.636508 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b76b9bf5c-pdhg4" Dec 04 00:53:57.686962 master-0 kubenswrapper[33142]: I1204 00:53:57.686882 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:57.692794 master-0 kubenswrapper[33142]: I1204 00:53:57.692730 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b76b9bf5c-pdhg4"] Dec 04 00:53:57.909421 master-0 kubenswrapper[33142]: I1204 00:53:57.909223 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" path="/var/lib/kubelet/pods/d6827961-175c-463a-8fd5-d3bd923a67f5/volumes" Dec 04 00:54:05.267261 master-0 kubenswrapper[33142]: I1204 00:54:05.267179 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:54:05.268033 master-0 kubenswrapper[33142]: I1204 00:54:05.267437 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" podUID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" containerName="controller-manager" containerID="cri-o://007f891e3b435ea6e34e3564ab5e028a5a7f5125a40c2f36b451fbc6f513af41" gracePeriod=30 Dec 04 00:54:05.303226 master-0 kubenswrapper[33142]: I1204 00:54:05.303159 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:54:05.303484 master-0 kubenswrapper[33142]: I1204 00:54:05.303444 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" podUID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" containerName="route-controller-manager" containerID="cri-o://0320058e12801c93c0632c1992f396e4be7e368baf4bc8c077854cc324eacefa" gracePeriod=30 Dec 04 00:54:05.758839 master-0 kubenswrapper[33142]: I1204 00:54:05.756985 33142 generic.go:334] "Generic (PLEG): container finished" podID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" containerID="007f891e3b435ea6e34e3564ab5e028a5a7f5125a40c2f36b451fbc6f513af41" exitCode=0 Dec 04 00:54:05.758839 master-0 kubenswrapper[33142]: I1204 00:54:05.757055 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" event={"ID":"5793144a-a95c-4f7c-8fd7-a5bda2057b68","Type":"ContainerDied","Data":"007f891e3b435ea6e34e3564ab5e028a5a7f5125a40c2f36b451fbc6f513af41"} Dec 04 00:54:05.763998 master-0 kubenswrapper[33142]: I1204 00:54:05.759270 33142 generic.go:334] "Generic (PLEG): container finished" podID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" containerID="0320058e12801c93c0632c1992f396e4be7e368baf4bc8c077854cc324eacefa" exitCode=0 Dec 04 00:54:05.763998 master-0 kubenswrapper[33142]: I1204 00:54:05.759296 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" event={"ID":"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042","Type":"ContainerDied","Data":"0320058e12801c93c0632c1992f396e4be7e368baf4bc8c077854cc324eacefa"} Dec 04 00:54:05.826789 master-0 kubenswrapper[33142]: I1204 00:54:05.826732 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:54:05.847319 master-0 kubenswrapper[33142]: I1204 00:54:05.845793 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz2rs\" (UniqueName: \"kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs\") pod \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " Dec 04 00:54:05.849893 master-0 kubenswrapper[33142]: I1204 00:54:05.849841 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs" (OuterVolumeSpecName: "kube-api-access-zz2rs") pod "5793144a-a95c-4f7c-8fd7-a5bda2057b68" (UID: "5793144a-a95c-4f7c-8fd7-a5bda2057b68"). InnerVolumeSpecName "kube-api-access-zz2rs". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:54:05.874116 master-0 kubenswrapper[33142]: I1204 00:54:05.874058 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:54:05.947158 master-0 kubenswrapper[33142]: I1204 00:54:05.947096 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles\") pod \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " Dec 04 00:54:05.947415 master-0 kubenswrapper[33142]: I1204 00:54:05.947213 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca\") pod \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " Dec 04 00:54:05.947415 master-0 kubenswrapper[33142]: I1204 00:54:05.947342 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert\") pod \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " Dec 04 00:54:05.947415 master-0 kubenswrapper[33142]: I1204 00:54:05.947373 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config\") pod \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\" (UID: \"5793144a-a95c-4f7c-8fd7-a5bda2057b68\") " Dec 04 00:54:05.947754 master-0 kubenswrapper[33142]: I1204 00:54:05.947735 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zz2rs\" (UniqueName: \"kubernetes.io/projected/5793144a-a95c-4f7c-8fd7-a5bda2057b68-kube-api-access-zz2rs\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:05.948681 master-0 kubenswrapper[33142]: I1204 00:54:05.948654 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca" (OuterVolumeSpecName: "client-ca") pod "5793144a-a95c-4f7c-8fd7-a5bda2057b68" (UID: "5793144a-a95c-4f7c-8fd7-a5bda2057b68"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:05.948829 master-0 kubenswrapper[33142]: I1204 00:54:05.948776 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config" (OuterVolumeSpecName: "config") pod "5793144a-a95c-4f7c-8fd7-a5bda2057b68" (UID: "5793144a-a95c-4f7c-8fd7-a5bda2057b68"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:05.949436 master-0 kubenswrapper[33142]: I1204 00:54:05.949409 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "5793144a-a95c-4f7c-8fd7-a5bda2057b68" (UID: "5793144a-a95c-4f7c-8fd7-a5bda2057b68"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:05.950785 master-0 kubenswrapper[33142]: I1204 00:54:05.950727 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "5793144a-a95c-4f7c-8fd7-a5bda2057b68" (UID: "5793144a-a95c-4f7c-8fd7-a5bda2057b68"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:06.048509 master-0 kubenswrapper[33142]: I1204 00:54:06.048448 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lthc6\" (UniqueName: \"kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6\") pod \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " Dec 04 00:54:06.048767 master-0 kubenswrapper[33142]: I1204 00:54:06.048604 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca\") pod \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " Dec 04 00:54:06.048767 master-0 kubenswrapper[33142]: I1204 00:54:06.048686 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert\") pod \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " Dec 04 00:54:06.048767 master-0 kubenswrapper[33142]: I1204 00:54:06.048726 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config\") pod \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\" (UID: \"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042\") " Dec 04 00:54:06.049321 master-0 kubenswrapper[33142]: I1204 00:54:06.049260 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.049321 master-0 kubenswrapper[33142]: I1204 00:54:06.049292 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5793144a-a95c-4f7c-8fd7-a5bda2057b68-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.049321 master-0 kubenswrapper[33142]: I1204 00:54:06.049305 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.049321 master-0 kubenswrapper[33142]: I1204 00:54:06.049316 33142 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5793144a-a95c-4f7c-8fd7-a5bda2057b68-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.050024 master-0 kubenswrapper[33142]: I1204 00:54:06.050004 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca" (OuterVolumeSpecName: "client-ca") pod "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" (UID: "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:06.050141 master-0 kubenswrapper[33142]: I1204 00:54:06.050088 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config" (OuterVolumeSpecName: "config") pod "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" (UID: "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:06.051573 master-0 kubenswrapper[33142]: I1204 00:54:06.051546 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6" (OuterVolumeSpecName: "kube-api-access-lthc6") pod "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" (UID: "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042"). InnerVolumeSpecName "kube-api-access-lthc6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:54:06.051638 master-0 kubenswrapper[33142]: I1204 00:54:06.051577 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" (UID: "71bfa586-3d08-4dd3-a6cb-3c54b1bd2042"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:06.151168 master-0 kubenswrapper[33142]: I1204 00:54:06.151009 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lthc6\" (UniqueName: \"kubernetes.io/projected/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-kube-api-access-lthc6\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.151168 master-0 kubenswrapper[33142]: I1204 00:54:06.151070 33142 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.151168 master-0 kubenswrapper[33142]: I1204 00:54:06.151094 33142 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.151168 master-0 kubenswrapper[33142]: I1204 00:54:06.151116 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:06.444211 master-0 kubenswrapper[33142]: I1204 00:54:06.444000 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-r8gfl"] Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: E1204 00:54:06.444459 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" containerName="controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444481 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" containerName="controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: E1204 00:54:06.444540 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerName="console" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444550 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerName="console" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: E1204 00:54:06.444571 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" containerName="route-controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444580 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" containerName="route-controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444780 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6827961-175c-463a-8fd5-d3bd923a67f5" containerName="console" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444809 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" containerName="route-controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.444839 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" containerName="controller-manager" Dec 04 00:54:06.445512 master-0 kubenswrapper[33142]: I1204 00:54:06.445441 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.463146 master-0 kubenswrapper[33142]: I1204 00:54:06.457232 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7"] Dec 04 00:54:06.463146 master-0 kubenswrapper[33142]: I1204 00:54:06.459281 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.470246 master-0 kubenswrapper[33142]: I1204 00:54:06.470146 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-r8gfl"] Dec 04 00:54:06.482525 master-0 kubenswrapper[33142]: I1204 00:54:06.481550 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7"] Dec 04 00:54:06.560048 master-0 kubenswrapper[33142]: I1204 00:54:06.559903 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-client-ca\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.560353 master-0 kubenswrapper[33142]: I1204 00:54:06.560176 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.560353 master-0 kubenswrapper[33142]: I1204 00:54:06.560309 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-config\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.560447 master-0 kubenswrapper[33142]: I1204 00:54:06.560359 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcbd\" (UniqueName: \"kubernetes.io/projected/577dfee6-627b-4b63-a427-87cdced9520d-kube-api-access-rrcbd\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.560447 master-0 kubenswrapper[33142]: I1204 00:54:06.560386 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/577dfee6-627b-4b63-a427-87cdced9520d-serving-cert\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.662998 master-0 kubenswrapper[33142]: I1204 00:54:06.661884 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-client-ca\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.662998 master-0 kubenswrapper[33142]: I1204 00:54:06.662027 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790e7ce-ac49-4df8-96e4-a15fa6201c61-serving-cert\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.662998 master-0 kubenswrapper[33142]: I1204 00:54:06.662115 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-config\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.662998 master-0 kubenswrapper[33142]: I1204 00:54:06.662165 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.662998 master-0 kubenswrapper[33142]: I1204 00:54:06.662885 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-client-ca\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.664084 master-0 kubenswrapper[33142]: I1204 00:54:06.663042 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-config\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.664084 master-0 kubenswrapper[33142]: I1204 00:54:06.663100 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcbd\" (UniqueName: \"kubernetes.io/projected/577dfee6-627b-4b63-a427-87cdced9520d-kube-api-access-rrcbd\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.664084 master-0 kubenswrapper[33142]: I1204 00:54:06.663189 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/577dfee6-627b-4b63-a427-87cdced9520d-serving-cert\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.664084 master-0 kubenswrapper[33142]: I1204 00:54:06.663244 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kxs\" (UniqueName: \"kubernetes.io/projected/8790e7ce-ac49-4df8-96e4-a15fa6201c61-kube-api-access-s6kxs\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.664084 master-0 kubenswrapper[33142]: I1204 00:54:06.662909 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-client-ca\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.665703 master-0 kubenswrapper[33142]: I1204 00:54:06.664745 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-proxy-ca-bundles\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.665703 master-0 kubenswrapper[33142]: I1204 00:54:06.665651 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/577dfee6-627b-4b63-a427-87cdced9520d-config\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.668917 master-0 kubenswrapper[33142]: I1204 00:54:06.668846 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/577dfee6-627b-4b63-a427-87cdced9520d-serving-cert\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.687970 master-0 kubenswrapper[33142]: I1204 00:54:06.687888 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcbd\" (UniqueName: \"kubernetes.io/projected/577dfee6-627b-4b63-a427-87cdced9520d-kube-api-access-rrcbd\") pod \"controller-manager-549b9b4c6-r8gfl\" (UID: \"577dfee6-627b-4b63-a427-87cdced9520d\") " pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.765277 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790e7ce-ac49-4df8-96e4-a15fa6201c61-serving-cert\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.765364 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-config\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.765437 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-client-ca\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.765470 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kxs\" (UniqueName: \"kubernetes.io/projected/8790e7ce-ac49-4df8-96e4-a15fa6201c61-kube-api-access-s6kxs\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.767567 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-config\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.767895 master-0 kubenswrapper[33142]: I1204 00:54:06.767843 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8790e7ce-ac49-4df8-96e4-a15fa6201c61-client-ca\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.776083 master-0 kubenswrapper[33142]: I1204 00:54:06.770660 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" event={"ID":"5793144a-a95c-4f7c-8fd7-a5bda2057b68","Type":"ContainerDied","Data":"4a4e33403e01562772c7febba55965afd1e88e953246df7f1adba0268acc1848"} Dec 04 00:54:06.776083 master-0 kubenswrapper[33142]: I1204 00:54:06.770717 33142 scope.go:117] "RemoveContainer" containerID="007f891e3b435ea6e34e3564ab5e028a5a7f5125a40c2f36b451fbc6f513af41" Dec 04 00:54:06.776083 master-0 kubenswrapper[33142]: I1204 00:54:06.770859 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n" Dec 04 00:54:06.776083 master-0 kubenswrapper[33142]: I1204 00:54:06.771487 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790e7ce-ac49-4df8-96e4-a15fa6201c61-serving-cert\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.779826 master-0 kubenswrapper[33142]: I1204 00:54:06.779669 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" event={"ID":"71bfa586-3d08-4dd3-a6cb-3c54b1bd2042","Type":"ContainerDied","Data":"0ab6489dc4658e3f43399c404f9314624b7908472538b6e47b22f398663759a1"} Dec 04 00:54:06.779826 master-0 kubenswrapper[33142]: I1204 00:54:06.779707 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5" Dec 04 00:54:06.785587 master-0 kubenswrapper[33142]: I1204 00:54:06.785482 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:06.788362 master-0 kubenswrapper[33142]: I1204 00:54:06.788310 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kxs\" (UniqueName: \"kubernetes.io/projected/8790e7ce-ac49-4df8-96e4-a15fa6201c61-kube-api-access-s6kxs\") pod \"route-controller-manager-6795888bd7-kbjr7\" (UID: \"8790e7ce-ac49-4df8-96e4-a15fa6201c61\") " pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.818064 master-0 kubenswrapper[33142]: I1204 00:54:06.817169 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:06.847617 master-0 kubenswrapper[33142]: I1204 00:54:06.847573 33142 scope.go:117] "RemoveContainer" containerID="0320058e12801c93c0632c1992f396e4be7e368baf4bc8c077854cc324eacefa" Dec 04 00:54:06.877999 master-0 kubenswrapper[33142]: I1204 00:54:06.877938 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:54:06.884909 master-0 kubenswrapper[33142]: I1204 00:54:06.884854 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-645ffb9d5f-xqp4n"] Dec 04 00:54:06.929110 master-0 kubenswrapper[33142]: I1204 00:54:06.929042 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:54:06.938242 master-0 kubenswrapper[33142]: I1204 00:54:06.938188 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-68bc8d8fcb-gmfm5"] Dec 04 00:54:07.264054 master-0 kubenswrapper[33142]: I1204 00:54:07.263969 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-549b9b4c6-r8gfl"] Dec 04 00:54:07.267739 master-0 kubenswrapper[33142]: W1204 00:54:07.267636 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577dfee6_627b_4b63_a427_87cdced9520d.slice/crio-3f29c75d1ae76d61bdf5f5d6f2556d4651173c6cb281fe17c6cb457e74ce0703 WatchSource:0}: Error finding container 3f29c75d1ae76d61bdf5f5d6f2556d4651173c6cb281fe17c6cb457e74ce0703: Status 404 returned error can't find the container with id 3f29c75d1ae76d61bdf5f5d6f2556d4651173c6cb281fe17c6cb457e74ce0703 Dec 04 00:54:07.327907 master-0 kubenswrapper[33142]: W1204 00:54:07.327831 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8790e7ce_ac49_4df8_96e4_a15fa6201c61.slice/crio-08776d1f4e15f10c9defaf19149444ddc61cb3fad61e88c665b7585c2f2d837c WatchSource:0}: Error finding container 08776d1f4e15f10c9defaf19149444ddc61cb3fad61e88c665b7585c2f2d837c: Status 404 returned error can't find the container with id 08776d1f4e15f10c9defaf19149444ddc61cb3fad61e88c665b7585c2f2d837c Dec 04 00:54:07.330552 master-0 kubenswrapper[33142]: I1204 00:54:07.330460 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7"] Dec 04 00:54:07.446860 master-0 kubenswrapper[33142]: I1204 00:54:07.446768 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:54:07.456402 master-0 kubenswrapper[33142]: I1204 00:54:07.448878 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.464571 master-0 kubenswrapper[33142]: I1204 00:54:07.464508 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:54:07.580395 master-0 kubenswrapper[33142]: I1204 00:54:07.580022 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.580395 master-0 kubenswrapper[33142]: I1204 00:54:07.580246 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.580395 master-0 kubenswrapper[33142]: I1204 00:54:07.580352 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.581038 master-0 kubenswrapper[33142]: I1204 00:54:07.580430 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.581038 master-0 kubenswrapper[33142]: I1204 00:54:07.580527 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.581038 master-0 kubenswrapper[33142]: I1204 00:54:07.580670 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.581038 master-0 kubenswrapper[33142]: I1204 00:54:07.580739 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.682178 master-0 kubenswrapper[33142]: I1204 00:54:07.682052 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682414 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682459 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682555 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682619 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682661 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.683388 master-0 kubenswrapper[33142]: I1204 00:54:07.682708 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.685498 master-0 kubenswrapper[33142]: I1204 00:54:07.684191 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.685498 master-0 kubenswrapper[33142]: I1204 00:54:07.684208 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.685498 master-0 kubenswrapper[33142]: I1204 00:54:07.684283 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.685498 master-0 kubenswrapper[33142]: I1204 00:54:07.684543 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.690075 master-0 kubenswrapper[33142]: I1204 00:54:07.689920 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.690760 master-0 kubenswrapper[33142]: I1204 00:54:07.690721 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.714528 master-0 kubenswrapper[33142]: I1204 00:54:07.714460 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq\") pod \"console-7d4f88899d-xxj4h\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.786735 master-0 kubenswrapper[33142]: I1204 00:54:07.786212 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:07.798340 master-0 kubenswrapper[33142]: I1204 00:54:07.795904 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" event={"ID":"577dfee6-627b-4b63-a427-87cdced9520d","Type":"ContainerStarted","Data":"56132da52530121199e80026246e40a51a2d2fbd81c869123729f203e8e201ab"} Dec 04 00:54:07.798340 master-0 kubenswrapper[33142]: I1204 00:54:07.796015 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" event={"ID":"577dfee6-627b-4b63-a427-87cdced9520d","Type":"ContainerStarted","Data":"3f29c75d1ae76d61bdf5f5d6f2556d4651173c6cb281fe17c6cb457e74ce0703"} Dec 04 00:54:07.798340 master-0 kubenswrapper[33142]: I1204 00:54:07.796649 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:07.801681 master-0 kubenswrapper[33142]: I1204 00:54:07.801631 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" Dec 04 00:54:07.811115 master-0 kubenswrapper[33142]: I1204 00:54:07.808636 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" event={"ID":"8790e7ce-ac49-4df8-96e4-a15fa6201c61","Type":"ContainerStarted","Data":"fdc5765affe5a193b876b29b95e03397f1386d4426104284cbc13909cb2c7d2f"} Dec 04 00:54:07.811115 master-0 kubenswrapper[33142]: I1204 00:54:07.808746 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" event={"ID":"8790e7ce-ac49-4df8-96e4-a15fa6201c61","Type":"ContainerStarted","Data":"08776d1f4e15f10c9defaf19149444ddc61cb3fad61e88c665b7585c2f2d837c"} Dec 04 00:54:07.811115 master-0 kubenswrapper[33142]: I1204 00:54:07.808950 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:07.862001 master-0 kubenswrapper[33142]: I1204 00:54:07.857063 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-549b9b4c6-r8gfl" podStartSLOduration=2.857041856 podStartE2EDuration="2.857041856s" podCreationTimestamp="2025-12-04 00:54:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:54:07.821340827 +0000 UTC m=+420.223342687" watchObservedRunningTime="2025-12-04 00:54:07.857041856 +0000 UTC m=+420.259043706" Dec 04 00:54:07.934976 master-0 kubenswrapper[33142]: I1204 00:54:07.934102 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" podStartSLOduration=2.931224983 podStartE2EDuration="2.931224983s" podCreationTimestamp="2025-12-04 00:54:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:54:07.924970206 +0000 UTC m=+420.326972056" watchObservedRunningTime="2025-12-04 00:54:07.931224983 +0000 UTC m=+420.333226833" Dec 04 00:54:07.939196 master-0 kubenswrapper[33142]: I1204 00:54:07.939135 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5793144a-a95c-4f7c-8fd7-a5bda2057b68" path="/var/lib/kubelet/pods/5793144a-a95c-4f7c-8fd7-a5bda2057b68/volumes" Dec 04 00:54:07.939774 master-0 kubenswrapper[33142]: I1204 00:54:07.939743 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71bfa586-3d08-4dd3-a6cb-3c54b1bd2042" path="/var/lib/kubelet/pods/71bfa586-3d08-4dd3-a6cb-3c54b1bd2042/volumes" Dec 04 00:54:07.975701 master-0 kubenswrapper[33142]: I1204 00:54:07.975498 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-6795888bd7-kbjr7" Dec 04 00:54:08.307053 master-0 kubenswrapper[33142]: W1204 00:54:08.306859 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f11cf6_069f_4890_a61d_1f3c1ae5ad97.slice/crio-8d65546d635c3ddf4c856a766ee9990190d59cbd9ae928bac29f4f94d9f894e3 WatchSource:0}: Error finding container 8d65546d635c3ddf4c856a766ee9990190d59cbd9ae928bac29f4f94d9f894e3: Status 404 returned error can't find the container with id 8d65546d635c3ddf4c856a766ee9990190d59cbd9ae928bac29f4f94d9f894e3 Dec 04 00:54:08.307053 master-0 kubenswrapper[33142]: I1204 00:54:08.307032 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:54:08.819747 master-0 kubenswrapper[33142]: I1204 00:54:08.819554 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4f88899d-xxj4h" event={"ID":"79f11cf6-069f-4890-a61d-1f3c1ae5ad97","Type":"ContainerStarted","Data":"9525cb71fa0036f637ba3aa3358140ff68120fe0721cc90c249e3ea3430ad984"} Dec 04 00:54:08.819747 master-0 kubenswrapper[33142]: I1204 00:54:08.819634 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4f88899d-xxj4h" event={"ID":"79f11cf6-069f-4890-a61d-1f3c1ae5ad97","Type":"ContainerStarted","Data":"8d65546d635c3ddf4c856a766ee9990190d59cbd9ae928bac29f4f94d9f894e3"} Dec 04 00:54:08.846647 master-0 kubenswrapper[33142]: I1204 00:54:08.846508 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d4f88899d-xxj4h" podStartSLOduration=1.846485554 podStartE2EDuration="1.846485554s" podCreationTimestamp="2025-12-04 00:54:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:54:08.845941339 +0000 UTC m=+421.247943199" watchObservedRunningTime="2025-12-04 00:54:08.846485554 +0000 UTC m=+421.248487414" Dec 04 00:54:12.536255 master-0 kubenswrapper[33142]: I1204 00:54:12.536147 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:54:12.565638 master-0 kubenswrapper[33142]: I1204 00:54:12.565578 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:54:12.882570 master-0 kubenswrapper[33142]: I1204 00:54:12.882492 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 00:54:17.787661 master-0 kubenswrapper[33142]: I1204 00:54:17.787495 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:17.787661 master-0 kubenswrapper[33142]: I1204 00:54:17.787600 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:17.795881 master-0 kubenswrapper[33142]: I1204 00:54:17.795812 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:17.896023 master-0 kubenswrapper[33142]: I1204 00:54:17.895915 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:54:17.987980 master-0 kubenswrapper[33142]: I1204 00:54:17.987866 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:54:20.745114 master-0 kubenswrapper[33142]: I1204 00:54:20.744965 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-7bccf97b47-glshl" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" containerID="cri-o://020a81e676ffc0a6fc64e38ba223ddc25b1e8a742f74748dbe5394da7718d70c" gracePeriod=15 Dec 04 00:54:20.919990 master-0 kubenswrapper[33142]: I1204 00:54:20.919893 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bccf97b47-glshl_b22002da-75d9-4121-9201-d3d2b591e53a/console/0.log" Dec 04 00:54:20.920252 master-0 kubenswrapper[33142]: I1204 00:54:20.920009 33142 generic.go:334] "Generic (PLEG): container finished" podID="b22002da-75d9-4121-9201-d3d2b591e53a" containerID="020a81e676ffc0a6fc64e38ba223ddc25b1e8a742f74748dbe5394da7718d70c" exitCode=2 Dec 04 00:54:20.920252 master-0 kubenswrapper[33142]: I1204 00:54:20.920059 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bccf97b47-glshl" event={"ID":"b22002da-75d9-4121-9201-d3d2b591e53a","Type":"ContainerDied","Data":"020a81e676ffc0a6fc64e38ba223ddc25b1e8a742f74748dbe5394da7718d70c"} Dec 04 00:54:21.440484 master-0 kubenswrapper[33142]: I1204 00:54:21.440433 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bccf97b47-glshl_b22002da-75d9-4121-9201-d3d2b591e53a/console/0.log" Dec 04 00:54:21.440892 master-0 kubenswrapper[33142]: I1204 00:54:21.440875 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:54:21.538765 master-0 kubenswrapper[33142]: I1204 00:54:21.538688 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.538765 master-0 kubenswrapper[33142]: I1204 00:54:21.538749 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.539196 master-0 kubenswrapper[33142]: I1204 00:54:21.538811 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.539196 master-0 kubenswrapper[33142]: I1204 00:54:21.538849 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.539196 master-0 kubenswrapper[33142]: I1204 00:54:21.538894 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.539196 master-0 kubenswrapper[33142]: I1204 00:54:21.538992 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.539196 master-0 kubenswrapper[33142]: I1204 00:54:21.539031 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mg79\" (UniqueName: \"kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79\") pod \"b22002da-75d9-4121-9201-d3d2b591e53a\" (UID: \"b22002da-75d9-4121-9201-d3d2b591e53a\") " Dec 04 00:54:21.540311 master-0 kubenswrapper[33142]: I1204 00:54:21.540253 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:21.540537 master-0 kubenswrapper[33142]: I1204 00:54:21.540461 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config" (OuterVolumeSpecName: "console-config") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:21.540733 master-0 kubenswrapper[33142]: I1204 00:54:21.540655 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:21.540889 master-0 kubenswrapper[33142]: I1204 00:54:21.540795 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:21.544093 master-0 kubenswrapper[33142]: I1204 00:54:21.543969 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79" (OuterVolumeSpecName: "kube-api-access-6mg79") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "kube-api-access-6mg79". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:54:21.544863 master-0 kubenswrapper[33142]: I1204 00:54:21.544793 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:21.545543 master-0 kubenswrapper[33142]: I1204 00:54:21.545486 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b22002da-75d9-4121-9201-d3d2b591e53a" (UID: "b22002da-75d9-4121-9201-d3d2b591e53a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:21.641018 master-0 kubenswrapper[33142]: I1204 00:54:21.640768 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6mg79\" (UniqueName: \"kubernetes.io/projected/b22002da-75d9-4121-9201-d3d2b591e53a-kube-api-access-6mg79\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641018 master-0 kubenswrapper[33142]: I1204 00:54:21.640900 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641018 master-0 kubenswrapper[33142]: I1204 00:54:21.640996 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641525 master-0 kubenswrapper[33142]: I1204 00:54:21.641026 33142 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641525 master-0 kubenswrapper[33142]: I1204 00:54:21.641103 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641525 master-0 kubenswrapper[33142]: I1204 00:54:21.641173 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b22002da-75d9-4121-9201-d3d2b591e53a-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.641525 master-0 kubenswrapper[33142]: I1204 00:54:21.641207 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b22002da-75d9-4121-9201-d3d2b591e53a-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:21.931340 master-0 kubenswrapper[33142]: I1204 00:54:21.931269 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bccf97b47-glshl_b22002da-75d9-4121-9201-d3d2b591e53a/console/0.log" Dec 04 00:54:21.932099 master-0 kubenswrapper[33142]: I1204 00:54:21.931381 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bccf97b47-glshl" event={"ID":"b22002da-75d9-4121-9201-d3d2b591e53a","Type":"ContainerDied","Data":"2841d39a27bf28b9a5c1322984624bcf4cb6f2e5001928f9bd0726ab37b757a4"} Dec 04 00:54:21.932099 master-0 kubenswrapper[33142]: I1204 00:54:21.931452 33142 scope.go:117] "RemoveContainer" containerID="020a81e676ffc0a6fc64e38ba223ddc25b1e8a742f74748dbe5394da7718d70c" Dec 04 00:54:21.932099 master-0 kubenswrapper[33142]: I1204 00:54:21.931668 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bccf97b47-glshl" Dec 04 00:54:21.962545 master-0 kubenswrapper[33142]: I1204 00:54:21.962481 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:54:21.967940 master-0 kubenswrapper[33142]: I1204 00:54:21.967891 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bccf97b47-glshl"] Dec 04 00:54:22.130063 master-0 kubenswrapper[33142]: I1204 00:54:22.129984 33142 patch_prober.go:28] interesting pod/console-7bccf97b47-glshl container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.128.0.110:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 00:54:22.130336 master-0 kubenswrapper[33142]: I1204 00:54:22.130062 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/console-7bccf97b47-glshl" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" probeResult="failure" output="Get \"https://10.128.0.110:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 00:54:23.909372 master-0 kubenswrapper[33142]: I1204 00:54:23.909239 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" path="/var/lib/kubelet/pods/b22002da-75d9-4121-9201-d3d2b591e53a/volumes" Dec 04 00:54:24.101323 master-0 kubenswrapper[33142]: I1204 00:54:24.101242 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 00:54:24.101730 master-0 kubenswrapper[33142]: E1204 00:54:24.101678 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" Dec 04 00:54:24.101730 master-0 kubenswrapper[33142]: I1204 00:54:24.101707 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" Dec 04 00:54:24.102016 master-0 kubenswrapper[33142]: I1204 00:54:24.101997 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b22002da-75d9-4121-9201-d3d2b591e53a" containerName="console" Dec 04 00:54:24.104591 master-0 kubenswrapper[33142]: I1204 00:54:24.102893 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.108070 master-0 kubenswrapper[33142]: I1204 00:54:24.108025 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-xwbnk" Dec 04 00:54:24.108232 master-0 kubenswrapper[33142]: I1204 00:54:24.108194 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 00:54:24.121688 master-0 kubenswrapper[33142]: I1204 00:54:24.121609 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 00:54:24.188154 master-0 kubenswrapper[33142]: I1204 00:54:24.188010 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.188154 master-0 kubenswrapper[33142]: I1204 00:54:24.188089 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.188154 master-0 kubenswrapper[33142]: I1204 00:54:24.188148 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.289397 master-0 kubenswrapper[33142]: I1204 00:54:24.289297 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.289744 master-0 kubenswrapper[33142]: I1204 00:54:24.289423 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.289744 master-0 kubenswrapper[33142]: I1204 00:54:24.289461 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.289744 master-0 kubenswrapper[33142]: I1204 00:54:24.289509 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.289744 master-0 kubenswrapper[33142]: I1204 00:54:24.289544 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.311428 master-0 kubenswrapper[33142]: I1204 00:54:24.311266 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access\") pod \"installer-4-master-0\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.447744 master-0 kubenswrapper[33142]: I1204 00:54:24.447566 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:54:24.938368 master-0 kubenswrapper[33142]: W1204 00:54:24.937573 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1dcbb5f1_d0a1_4223_96b6_b9beb2813d60.slice/crio-dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1 WatchSource:0}: Error finding container dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1: Status 404 returned error can't find the container with id dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1 Dec 04 00:54:24.941842 master-0 kubenswrapper[33142]: I1204 00:54:24.941224 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 00:54:24.993345 master-0 kubenswrapper[33142]: I1204 00:54:24.993266 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60","Type":"ContainerStarted","Data":"dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1"} Dec 04 00:54:26.004129 master-0 kubenswrapper[33142]: I1204 00:54:26.004042 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60","Type":"ContainerStarted","Data":"5719f7949b120d3be636ca4e41d8fd4edbafd1e91f04bc055f477c6caaf0d584"} Dec 04 00:54:26.037054 master-0 kubenswrapper[33142]: I1204 00:54:26.036905 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-4-master-0" podStartSLOduration=2.036875091 podStartE2EDuration="2.036875091s" podCreationTimestamp="2025-12-04 00:54:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:54:26.0258765 +0000 UTC m=+438.427878390" watchObservedRunningTime="2025-12-04 00:54:26.036875091 +0000 UTC m=+438.438876951" Dec 04 00:54:43.036061 master-0 kubenswrapper[33142]: I1204 00:54:43.035771 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-7857bf7774-r72g8" podUID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" containerName="console" containerID="cri-o://b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b" gracePeriod=15 Dec 04 00:54:43.729557 master-0 kubenswrapper[33142]: I1204 00:54:43.729469 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7857bf7774-r72g8_c9f703a1-0e2c-4545-a9a3-cbc9e3768766/console/0.log" Dec 04 00:54:43.729963 master-0 kubenswrapper[33142]: I1204 00:54:43.729599 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743409 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743540 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743595 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743635 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743660 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.743712 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.744383 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.744629 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4hwx\" (UniqueName: \"kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx\") pod \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\" (UID: \"c9f703a1-0e2c-4545-a9a3-cbc9e3768766\") " Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.744598 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.744917 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:43.745146 master-0 kubenswrapper[33142]: I1204 00:54:43.745086 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config" (OuterVolumeSpecName: "console-config") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:54:43.745830 master-0 kubenswrapper[33142]: I1204 00:54:43.745427 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.745830 master-0 kubenswrapper[33142]: I1204 00:54:43.745462 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.745830 master-0 kubenswrapper[33142]: I1204 00:54:43.745483 33142 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.745830 master-0 kubenswrapper[33142]: I1204 00:54:43.745505 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.747036 master-0 kubenswrapper[33142]: I1204 00:54:43.746910 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:43.749758 master-0 kubenswrapper[33142]: I1204 00:54:43.749711 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx" (OuterVolumeSpecName: "kube-api-access-t4hwx") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "kube-api-access-t4hwx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:54:43.750703 master-0 kubenswrapper[33142]: I1204 00:54:43.750634 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9f703a1-0e2c-4545-a9a3-cbc9e3768766" (UID: "c9f703a1-0e2c-4545-a9a3-cbc9e3768766"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:54:43.847627 master-0 kubenswrapper[33142]: I1204 00:54:43.847541 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.847627 master-0 kubenswrapper[33142]: I1204 00:54:43.847595 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t4hwx\" (UniqueName: \"kubernetes.io/projected/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-kube-api-access-t4hwx\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:43.847627 master-0 kubenswrapper[33142]: I1204 00:54:43.847611 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9f703a1-0e2c-4545-a9a3-cbc9e3768766-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:44.181984 master-0 kubenswrapper[33142]: I1204 00:54:44.181758 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7857bf7774-r72g8_c9f703a1-0e2c-4545-a9a3-cbc9e3768766/console/0.log" Dec 04 00:54:44.181984 master-0 kubenswrapper[33142]: I1204 00:54:44.181869 33142 generic.go:334] "Generic (PLEG): container finished" podID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" containerID="b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b" exitCode=2 Dec 04 00:54:44.181984 master-0 kubenswrapper[33142]: I1204 00:54:44.181960 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857bf7774-r72g8" event={"ID":"c9f703a1-0e2c-4545-a9a3-cbc9e3768766","Type":"ContainerDied","Data":"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b"} Dec 04 00:54:44.183237 master-0 kubenswrapper[33142]: I1204 00:54:44.182000 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7857bf7774-r72g8" Dec 04 00:54:44.183237 master-0 kubenswrapper[33142]: I1204 00:54:44.182032 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7857bf7774-r72g8" event={"ID":"c9f703a1-0e2c-4545-a9a3-cbc9e3768766","Type":"ContainerDied","Data":"e1dbb7c7ee8829de12df4b2c94fd087ca24746d881a5ceb955b6f3d82faa442a"} Dec 04 00:54:44.183237 master-0 kubenswrapper[33142]: I1204 00:54:44.182075 33142 scope.go:117] "RemoveContainer" containerID="b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b" Dec 04 00:54:44.206360 master-0 kubenswrapper[33142]: I1204 00:54:44.206286 33142 scope.go:117] "RemoveContainer" containerID="b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b" Dec 04 00:54:44.208232 master-0 kubenswrapper[33142]: E1204 00:54:44.208109 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b\": container with ID starting with b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b not found: ID does not exist" containerID="b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b" Dec 04 00:54:44.208523 master-0 kubenswrapper[33142]: I1204 00:54:44.208229 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b"} err="failed to get container status \"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b\": rpc error: code = NotFound desc = could not find container \"b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b\": container with ID starting with b6511003ccd8adf05c10b298f15713a1d1f30b2319ea3b3398f090adb1bfa54b not found: ID does not exist" Dec 04 00:54:44.218759 master-0 kubenswrapper[33142]: I1204 00:54:44.218489 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:54:44.234352 master-0 kubenswrapper[33142]: I1204 00:54:44.234262 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7857bf7774-r72g8"] Dec 04 00:54:45.915098 master-0 kubenswrapper[33142]: I1204 00:54:45.914989 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" path="/var/lib/kubelet/pods/c9f703a1-0e2c-4545-a9a3-cbc9e3768766/volumes" Dec 04 00:54:50.184611 master-0 kubenswrapper[33142]: I1204 00:54:50.184011 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 00:54:50.185453 master-0 kubenswrapper[33142]: E1204 00:54:50.184893 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" containerName="console" Dec 04 00:54:50.185453 master-0 kubenswrapper[33142]: I1204 00:54:50.184909 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" containerName="console" Dec 04 00:54:50.185453 master-0 kubenswrapper[33142]: I1204 00:54:50.185063 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c9f703a1-0e2c-4545-a9a3-cbc9e3768766" containerName="console" Dec 04 00:54:50.185609 master-0 kubenswrapper[33142]: I1204 00:54:50.185547 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.188006 master-0 kubenswrapper[33142]: I1204 00:54:50.187951 33142 reflector.go:368] Caches populated for *v1.Secret from object-"sushy-emulator"/"os-client-config" Dec 04 00:54:50.188278 master-0 kubenswrapper[33142]: I1204 00:54:50.188243 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"sushy-emulator-config" Dec 04 00:54:50.188422 master-0 kubenswrapper[33142]: I1204 00:54:50.188388 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"openshift-service-ca.crt" Dec 04 00:54:50.188780 master-0 kubenswrapper[33142]: I1204 00:54:50.188749 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"kube-root-ca.crt" Dec 04 00:54:50.207673 master-0 kubenswrapper[33142]: I1204 00:54:50.207590 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 00:54:50.261227 master-0 kubenswrapper[33142]: I1204 00:54:50.261153 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.261227 master-0 kubenswrapper[33142]: I1204 00:54:50.261220 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrjt\" (UniqueName: \"kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.261630 master-0 kubenswrapper[33142]: I1204 00:54:50.261560 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.363648 master-0 kubenswrapper[33142]: I1204 00:54:50.363492 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.364019 master-0 kubenswrapper[33142]: I1204 00:54:50.363744 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.364019 master-0 kubenswrapper[33142]: I1204 00:54:50.363791 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrjt\" (UniqueName: \"kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.365889 master-0 kubenswrapper[33142]: I1204 00:54:50.365807 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.371525 master-0 kubenswrapper[33142]: I1204 00:54:50.371443 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.394507 master-0 kubenswrapper[33142]: I1204 00:54:50.394389 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrjt\" (UniqueName: \"kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt\") pod \"sushy-emulator-58f4c9b998-spf9s\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:50.525275 master-0 kubenswrapper[33142]: I1204 00:54:50.525056 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:54:51.049856 master-0 kubenswrapper[33142]: I1204 00:54:51.049786 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 00:54:51.250799 master-0 kubenswrapper[33142]: I1204 00:54:51.250684 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" event={"ID":"e9095d9b-8127-4abe-9519-53049c22eca9","Type":"ContainerStarted","Data":"49609a32729795c6d8c6b1f9a9a9507e5cb4f17821035d6dcc6a8869d5494ccc"} Dec 04 00:54:58.121160 master-0 kubenswrapper[33142]: I1204 00:54:58.121058 33142 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:54:58.123034 master-0 kubenswrapper[33142]: I1204 00:54:58.121474 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="cluster-policy-controller" containerID="cri-o://434f681e919ca1d4a7e6d3cc6871129aaf80f11e7828dbb5c2fc533ee961dd5e" gracePeriod=30 Dec 04 00:54:58.123034 master-0 kubenswrapper[33142]: I1204 00:54:58.121629 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-cert-syncer" containerID="cri-o://affb4b606d4a460d9fa96dc6ef006e5a40d7b5d8bfb995af1fe9f65b0b0f1b79" gracePeriod=30 Dec 04 00:54:58.123034 master-0 kubenswrapper[33142]: I1204 00:54:58.121572 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-recovery-controller" containerID="cri-o://6c04a6465a60cad27aaeb9552551a4268a706b1b3d17d6ca722d3b5267fe28d7" gracePeriod=30 Dec 04 00:54:58.123034 master-0 kubenswrapper[33142]: I1204 00:54:58.121614 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" containerID="cri-o://dafec2eef03d87ac491eeba79aebadb73a2644b0bfc16f504f9227d6a66b8866" gracePeriod=30 Dec 04 00:54:58.123671 master-0 kubenswrapper[33142]: I1204 00:54:58.123573 33142 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:54:58.124294 master-0 kubenswrapper[33142]: E1204 00:54:58.124224 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.124294 master-0 kubenswrapper[33142]: I1204 00:54:58.124284 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.124479 master-0 kubenswrapper[33142]: E1204 00:54:58.124310 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.124479 master-0 kubenswrapper[33142]: I1204 00:54:58.124361 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.124479 master-0 kubenswrapper[33142]: E1204 00:54:58.124446 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-recovery-controller" Dec 04 00:54:58.124479 master-0 kubenswrapper[33142]: I1204 00:54:58.124458 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-recovery-controller" Dec 04 00:54:58.124777 master-0 kubenswrapper[33142]: E1204 00:54:58.124483 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="cluster-policy-controller" Dec 04 00:54:58.124777 master-0 kubenswrapper[33142]: I1204 00:54:58.124528 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="cluster-policy-controller" Dec 04 00:54:58.124777 master-0 kubenswrapper[33142]: E1204 00:54:58.124560 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-cert-syncer" Dec 04 00:54:58.124777 master-0 kubenswrapper[33142]: I1204 00:54:58.124568 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-cert-syncer" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.124866 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.124889 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-cert-syncer" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.125013 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.125030 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.125082 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager-recovery-controller" Dec 04 00:54:58.125222 master-0 kubenswrapper[33142]: I1204 00:54:58.125123 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="cluster-policy-controller" Dec 04 00:54:58.125766 master-0 kubenswrapper[33142]: E1204 00:54:58.125607 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.125766 master-0 kubenswrapper[33142]: I1204 00:54:58.125625 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.125766 master-0 kubenswrapper[33142]: E1204 00:54:58.125642 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.126123 master-0 kubenswrapper[33142]: I1204 00:54:58.125780 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.131346 master-0 kubenswrapper[33142]: I1204 00:54:58.126263 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="295a01fb7c14d9ac3c44b1615db211d7" containerName="kube-controller-manager" Dec 04 00:54:58.191713 master-0 kubenswrapper[33142]: I1204 00:54:58.191636 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.191713 master-0 kubenswrapper[33142]: I1204 00:54:58.191703 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.293518 master-0 kubenswrapper[33142]: I1204 00:54:58.293458 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.293518 master-0 kubenswrapper[33142]: I1204 00:54:58.293518 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.293673 master-0 kubenswrapper[33142]: I1204 00:54:58.293599 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.293673 master-0 kubenswrapper[33142]: I1204 00:54:58.293616 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f733b7faa4780a3e99e211531fc4c672-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"f733b7faa4780a3e99e211531fc4c672\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.305305 master-0 kubenswrapper[33142]: I1204 00:54:58.305250 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/2.log" Dec 04 00:54:58.307602 master-0 kubenswrapper[33142]: I1204 00:54:58.307564 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager-cert-syncer/0.log" Dec 04 00:54:58.308403 master-0 kubenswrapper[33142]: I1204 00:54:58.308329 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.312340 master-0 kubenswrapper[33142]: I1204 00:54:58.312252 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="295a01fb7c14d9ac3c44b1615db211d7" podUID="f733b7faa4780a3e99e211531fc4c672" Dec 04 00:54:58.318832 master-0 kubenswrapper[33142]: I1204 00:54:58.318770 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager/2.log" Dec 04 00:54:58.319780 master-0 kubenswrapper[33142]: I1204 00:54:58.319739 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager-cert-syncer/0.log" Dec 04 00:54:58.321064 master-0 kubenswrapper[33142]: I1204 00:54:58.321001 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="dafec2eef03d87ac491eeba79aebadb73a2644b0bfc16f504f9227d6a66b8866" exitCode=0 Dec 04 00:54:58.321064 master-0 kubenswrapper[33142]: I1204 00:54:58.321047 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:54:58.321166 master-0 kubenswrapper[33142]: I1204 00:54:58.321080 33142 scope.go:117] "RemoveContainer" containerID="a9f46ab0530e92450429ce714caea1fa34042867e5342b639cce68ab97d356c1" Dec 04 00:54:58.321166 master-0 kubenswrapper[33142]: I1204 00:54:58.321065 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="6c04a6465a60cad27aaeb9552551a4268a706b1b3d17d6ca722d3b5267fe28d7" exitCode=0 Dec 04 00:54:58.321228 master-0 kubenswrapper[33142]: I1204 00:54:58.321170 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="affb4b606d4a460d9fa96dc6ef006e5a40d7b5d8bfb995af1fe9f65b0b0f1b79" exitCode=2 Dec 04 00:54:58.321228 master-0 kubenswrapper[33142]: I1204 00:54:58.321183 33142 generic.go:334] "Generic (PLEG): container finished" podID="295a01fb7c14d9ac3c44b1615db211d7" containerID="434f681e919ca1d4a7e6d3cc6871129aaf80f11e7828dbb5c2fc533ee961dd5e" exitCode=0 Dec 04 00:54:58.321287 master-0 kubenswrapper[33142]: I1204 00:54:58.321240 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae75a737e3caf50b2759d82edfe95dcc414e4dc4208eaaaf71006a15afec627a" Dec 04 00:54:58.324555 master-0 kubenswrapper[33142]: I1204 00:54:58.324507 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" event={"ID":"e9095d9b-8127-4abe-9519-53049c22eca9","Type":"ContainerStarted","Data":"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38"} Dec 04 00:54:58.325422 master-0 kubenswrapper[33142]: I1204 00:54:58.325376 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="295a01fb7c14d9ac3c44b1615db211d7" podUID="f733b7faa4780a3e99e211531fc4c672" Dec 04 00:54:58.350025 master-0 kubenswrapper[33142]: I1204 00:54:58.349916 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" podStartSLOduration=2.146383196 podStartE2EDuration="8.349898229s" podCreationTimestamp="2025-12-04 00:54:50 +0000 UTC" firstStartedPulling="2025-12-04 00:54:51.054904072 +0000 UTC m=+463.456905932" lastFinishedPulling="2025-12-04 00:54:57.258419115 +0000 UTC m=+469.660420965" observedRunningTime="2025-12-04 00:54:58.344788354 +0000 UTC m=+470.746790244" watchObservedRunningTime="2025-12-04 00:54:58.349898229 +0000 UTC m=+470.751900079" Dec 04 00:54:58.394137 master-0 kubenswrapper[33142]: I1204 00:54:58.393897 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir\") pod \"295a01fb7c14d9ac3c44b1615db211d7\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " Dec 04 00:54:58.394137 master-0 kubenswrapper[33142]: I1204 00:54:58.394031 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir\") pod \"295a01fb7c14d9ac3c44b1615db211d7\" (UID: \"295a01fb7c14d9ac3c44b1615db211d7\") " Dec 04 00:54:58.394485 master-0 kubenswrapper[33142]: I1204 00:54:58.394022 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "295a01fb7c14d9ac3c44b1615db211d7" (UID: "295a01fb7c14d9ac3c44b1615db211d7"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:54:58.394485 master-0 kubenswrapper[33142]: I1204 00:54:58.394104 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "295a01fb7c14d9ac3c44b1615db211d7" (UID: "295a01fb7c14d9ac3c44b1615db211d7"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:54:58.394867 master-0 kubenswrapper[33142]: I1204 00:54:58.394824 33142 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:58.394867 master-0 kubenswrapper[33142]: I1204 00:54:58.394858 33142 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/295a01fb7c14d9ac3c44b1615db211d7-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:54:58.648004 master-0 kubenswrapper[33142]: I1204 00:54:58.647830 33142 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="295a01fb7c14d9ac3c44b1615db211d7" podUID="f733b7faa4780a3e99e211531fc4c672" Dec 04 00:54:59.342549 master-0 kubenswrapper[33142]: I1204 00:54:59.342441 33142 generic.go:334] "Generic (PLEG): container finished" podID="1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" containerID="5719f7949b120d3be636ca4e41d8fd4edbafd1e91f04bc055f477c6caaf0d584" exitCode=0 Dec 04 00:54:59.343590 master-0 kubenswrapper[33142]: I1204 00:54:59.342557 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60","Type":"ContainerDied","Data":"5719f7949b120d3be636ca4e41d8fd4edbafd1e91f04bc055f477c6caaf0d584"} Dec 04 00:54:59.347732 master-0 kubenswrapper[33142]: I1204 00:54:59.347677 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_295a01fb7c14d9ac3c44b1615db211d7/kube-controller-manager-cert-syncer/0.log" Dec 04 00:54:59.914245 master-0 kubenswrapper[33142]: I1204 00:54:59.914097 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="295a01fb7c14d9ac3c44b1615db211d7" path="/var/lib/kubelet/pods/295a01fb7c14d9ac3c44b1615db211d7/volumes" Dec 04 00:55:00.526068 master-0 kubenswrapper[33142]: I1204 00:55:00.525951 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:55:00.526068 master-0 kubenswrapper[33142]: I1204 00:55:00.526039 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:55:00.541309 master-0 kubenswrapper[33142]: I1204 00:55:00.541248 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:55:00.758349 master-0 kubenswrapper[33142]: I1204 00:55:00.758269 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:55:00.835102 master-0 kubenswrapper[33142]: I1204 00:55:00.835026 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir\") pod \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " Dec 04 00:55:00.835366 master-0 kubenswrapper[33142]: I1204 00:55:00.835284 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock\") pod \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " Dec 04 00:55:00.835560 master-0 kubenswrapper[33142]: I1204 00:55:00.835475 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access\") pod \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\" (UID: \"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60\") " Dec 04 00:55:00.835803 master-0 kubenswrapper[33142]: I1204 00:55:00.835715 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock" (OuterVolumeSpecName: "var-lock") pod "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" (UID: "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:55:00.835986 master-0 kubenswrapper[33142]: I1204 00:55:00.835751 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" (UID: "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 00:55:00.836277 master-0 kubenswrapper[33142]: I1204 00:55:00.836245 33142 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:00.836432 master-0 kubenswrapper[33142]: I1204 00:55:00.836408 33142 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:00.840991 master-0 kubenswrapper[33142]: I1204 00:55:00.840914 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" (UID: "1dcbb5f1-d0a1-4223-96b6-b9beb2813d60"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:55:00.938522 master-0 kubenswrapper[33142]: I1204 00:55:00.938385 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1dcbb5f1-d0a1-4223-96b6-b9beb2813d60-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:01.367215 master-0 kubenswrapper[33142]: I1204 00:55:01.367142 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 00:55:01.367215 master-0 kubenswrapper[33142]: I1204 00:55:01.367139 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"1dcbb5f1-d0a1-4223-96b6-b9beb2813d60","Type":"ContainerDied","Data":"dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1"} Dec 04 00:55:01.367215 master-0 kubenswrapper[33142]: I1204 00:55:01.367224 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd6f220400e08c65cfb77f1ece823ec23286b1b34c3acac73eecddf126e1afc1" Dec 04 00:55:01.370642 master-0 kubenswrapper[33142]: I1204 00:55:01.370597 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 00:55:08.387629 master-0 kubenswrapper[33142]: I1204 00:55:08.387510 33142 scope.go:117] "RemoveContainer" containerID="6c04a6465a60cad27aaeb9552551a4268a706b1b3d17d6ca722d3b5267fe28d7" Dec 04 00:55:08.414227 master-0 kubenswrapper[33142]: I1204 00:55:08.414168 33142 scope.go:117] "RemoveContainer" containerID="affb4b606d4a460d9fa96dc6ef006e5a40d7b5d8bfb995af1fe9f65b0b0f1b79" Dec 04 00:55:08.436406 master-0 kubenswrapper[33142]: I1204 00:55:08.436358 33142 scope.go:117] "RemoveContainer" containerID="434f681e919ca1d4a7e6d3cc6871129aaf80f11e7828dbb5c2fc533ee961dd5e" Dec 04 00:55:09.898016 master-0 kubenswrapper[33142]: I1204 00:55:09.897901 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:09.923652 master-0 kubenswrapper[33142]: I1204 00:55:09.923540 33142 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="93d8de92-83f1-4c6c-8f2a-6129f0dd75d6" Dec 04 00:55:09.923652 master-0 kubenswrapper[33142]: I1204 00:55:09.923640 33142 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="93d8de92-83f1-4c6c-8f2a-6129f0dd75d6" Dec 04 00:55:09.947346 master-0 kubenswrapper[33142]: I1204 00:55:09.946866 33142 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:09.950967 master-0 kubenswrapper[33142]: I1204 00:55:09.950854 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:55:09.962681 master-0 kubenswrapper[33142]: I1204 00:55:09.962588 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:55:09.967090 master-0 kubenswrapper[33142]: I1204 00:55:09.964336 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:09.977726 master-0 kubenswrapper[33142]: I1204 00:55:09.977643 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 00:55:09.997003 master-0 kubenswrapper[33142]: W1204 00:55:09.996799 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf733b7faa4780a3e99e211531fc4c672.slice/crio-ea98efca4280f98de7a70312a0f3d9cc673e60a364962a283f263b8830130291 WatchSource:0}: Error finding container ea98efca4280f98de7a70312a0f3d9cc673e60a364962a283f263b8830130291: Status 404 returned error can't find the container with id ea98efca4280f98de7a70312a0f3d9cc673e60a364962a283f263b8830130291 Dec 04 00:55:10.457484 master-0 kubenswrapper[33142]: I1204 00:55:10.457355 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"f733b7faa4780a3e99e211531fc4c672","Type":"ContainerStarted","Data":"5c7811dd4be86d56585f5b14415762e14b4f32d90ae6f67876d3d8aad79c926e"} Dec 04 00:55:10.457484 master-0 kubenswrapper[33142]: I1204 00:55:10.457413 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"f733b7faa4780a3e99e211531fc4c672","Type":"ContainerStarted","Data":"ea98efca4280f98de7a70312a0f3d9cc673e60a364962a283f263b8830130291"} Dec 04 00:55:11.468192 master-0 kubenswrapper[33142]: I1204 00:55:11.468110 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"f733b7faa4780a3e99e211531fc4c672","Type":"ContainerStarted","Data":"2d904c3e2d8095ca9648cedf03ff947581212bd1390fdb98e699df9cb9b3d432"} Dec 04 00:55:11.468192 master-0 kubenswrapper[33142]: I1204 00:55:11.468167 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"f733b7faa4780a3e99e211531fc4c672","Type":"ContainerStarted","Data":"8a0828080ba8504bb2802a6a524f009427d0d1c29f187b2b02c69e66af36643f"} Dec 04 00:55:11.468192 master-0 kubenswrapper[33142]: I1204 00:55:11.468177 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"f733b7faa4780a3e99e211531fc4c672","Type":"ContainerStarted","Data":"63ce33a070fbea82b3fbe4a276bc9de202dcbb214f2720d22a621db3b5ce4e51"} Dec 04 00:55:11.507856 master-0 kubenswrapper[33142]: I1204 00:55:11.507729 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=2.507694539 podStartE2EDuration="2.507694539s" podCreationTimestamp="2025-12-04 00:55:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:55:11.496913034 +0000 UTC m=+483.898914924" watchObservedRunningTime="2025-12-04 00:55:11.507694539 +0000 UTC m=+483.909696399" Dec 04 00:55:19.965511 master-0 kubenswrapper[33142]: I1204 00:55:19.965372 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:19.965511 master-0 kubenswrapper[33142]: I1204 00:55:19.965535 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:19.967019 master-0 kubenswrapper[33142]: I1204 00:55:19.965573 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:19.967019 master-0 kubenswrapper[33142]: I1204 00:55:19.965598 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:19.970817 master-0 kubenswrapper[33142]: I1204 00:55:19.970743 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:19.973381 master-0 kubenswrapper[33142]: I1204 00:55:19.973291 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:20.578788 master-0 kubenswrapper[33142]: I1204 00:55:20.578144 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:20.580670 master-0 kubenswrapper[33142]: I1204 00:55:20.580535 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 00:55:32.903492 master-0 kubenswrapper[33142]: I1204 00:55:32.903413 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq"] Dec 04 00:55:32.904213 master-0 kubenswrapper[33142]: E1204 00:55:32.903886 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" containerName="installer" Dec 04 00:55:32.904213 master-0 kubenswrapper[33142]: I1204 00:55:32.903912 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" containerName="installer" Dec 04 00:55:32.904313 master-0 kubenswrapper[33142]: I1204 00:55:32.904238 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1dcbb5f1-d0a1-4223-96b6-b9beb2813d60" containerName="installer" Dec 04 00:55:32.909514 master-0 kubenswrapper[33142]: I1204 00:55:32.906379 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:32.916585 master-0 kubenswrapper[33142]: I1204 00:55:32.916503 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq"] Dec 04 00:55:32.917712 master-0 kubenswrapper[33142]: I1204 00:55:32.916888 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:32.917712 master-0 kubenswrapper[33142]: I1204 00:55:32.917000 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:32.917712 master-0 kubenswrapper[33142]: I1204 00:55:32.916915 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-dnqtf" Dec 04 00:55:32.917712 master-0 kubenswrapper[33142]: I1204 00:55:32.917235 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gkh\" (UniqueName: \"kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.018863 master-0 kubenswrapper[33142]: I1204 00:55:33.018814 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.019192 master-0 kubenswrapper[33142]: I1204 00:55:33.019168 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.019550 master-0 kubenswrapper[33142]: I1204 00:55:33.019526 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gkh\" (UniqueName: \"kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.019847 master-0 kubenswrapper[33142]: I1204 00:55:33.019818 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.020010 master-0 kubenswrapper[33142]: I1204 00:55:33.019960 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.043284 master-0 kubenswrapper[33142]: I1204 00:55:33.043205 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gkh\" (UniqueName: \"kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.225618 master-0 kubenswrapper[33142]: I1204 00:55:33.225464 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:33.681522 master-0 kubenswrapper[33142]: W1204 00:55:33.681461 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d5c870_8950_4aac_b6c4_cf5472a917fe.slice/crio-1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552 WatchSource:0}: Error finding container 1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552: Status 404 returned error can't find the container with id 1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552 Dec 04 00:55:33.683828 master-0 kubenswrapper[33142]: I1204 00:55:33.683782 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq"] Dec 04 00:55:34.692079 master-0 kubenswrapper[33142]: I1204 00:55:34.692017 33142 generic.go:334] "Generic (PLEG): container finished" podID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerID="41d354b705deca65d7e2f83a226ecc5eeee7bbeb3804ebe0425c82504827b7de" exitCode=0 Dec 04 00:55:34.693003 master-0 kubenswrapper[33142]: I1204 00:55:34.692117 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" event={"ID":"e5d5c870-8950-4aac-b6c4-cf5472a917fe","Type":"ContainerDied","Data":"41d354b705deca65d7e2f83a226ecc5eeee7bbeb3804ebe0425c82504827b7de"} Dec 04 00:55:34.693100 master-0 kubenswrapper[33142]: I1204 00:55:34.693056 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" event={"ID":"e5d5c870-8950-4aac-b6c4-cf5472a917fe","Type":"ContainerStarted","Data":"1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552"} Dec 04 00:55:34.694698 master-0 kubenswrapper[33142]: I1204 00:55:34.694664 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 00:55:35.208060 master-0 kubenswrapper[33142]: I1204 00:55:35.207986 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:55:35.211188 master-0 kubenswrapper[33142]: I1204 00:55:35.210299 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.228018 master-0 kubenswrapper[33142]: I1204 00:55:35.227569 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:55:35.257073 master-0 kubenswrapper[33142]: I1204 00:55:35.256981 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.257073 master-0 kubenswrapper[33142]: I1204 00:55:35.257076 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.257350 master-0 kubenswrapper[33142]: I1204 00:55:35.257112 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lpbn\" (UniqueName: \"kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.359309 master-0 kubenswrapper[33142]: I1204 00:55:35.359179 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.359309 master-0 kubenswrapper[33142]: I1204 00:55:35.359295 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.359309 master-0 kubenswrapper[33142]: I1204 00:55:35.359344 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpbn\" (UniqueName: \"kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.359891 master-0 kubenswrapper[33142]: I1204 00:55:35.359837 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.360278 master-0 kubenswrapper[33142]: I1204 00:55:35.360151 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.383171 master-0 kubenswrapper[33142]: I1204 00:55:35.383086 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lpbn\" (UniqueName: \"kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn\") pod \"redhat-operators-bw2vt\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.539245 master-0 kubenswrapper[33142]: I1204 00:55:35.539086 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:35.968675 master-0 kubenswrapper[33142]: I1204 00:55:35.968632 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:55:36.709192 master-0 kubenswrapper[33142]: I1204 00:55:36.709122 33142 generic.go:334] "Generic (PLEG): container finished" podID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerID="5414afc246c3492226b79f8232573bea830c3b50b15dc75110c4e99b721977d4" exitCode=0 Dec 04 00:55:36.709466 master-0 kubenswrapper[33142]: I1204 00:55:36.709227 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerDied","Data":"5414afc246c3492226b79f8232573bea830c3b50b15dc75110c4e99b721977d4"} Dec 04 00:55:36.709466 master-0 kubenswrapper[33142]: I1204 00:55:36.709289 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerStarted","Data":"4fc375b6106026cd5d68516188e09286145664d78325739bf31317b1fe6bfd8c"} Dec 04 00:55:36.712164 master-0 kubenswrapper[33142]: I1204 00:55:36.711835 33142 generic.go:334] "Generic (PLEG): container finished" podID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerID="15280d64523767082926104e0ee9d65efdaf3bf3a5bbf4533d3f7ee75edcb67d" exitCode=0 Dec 04 00:55:36.712164 master-0 kubenswrapper[33142]: I1204 00:55:36.711886 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" event={"ID":"e5d5c870-8950-4aac-b6c4-cf5472a917fe","Type":"ContainerDied","Data":"15280d64523767082926104e0ee9d65efdaf3bf3a5bbf4533d3f7ee75edcb67d"} Dec 04 00:55:37.724283 master-0 kubenswrapper[33142]: I1204 00:55:37.724181 33142 generic.go:334] "Generic (PLEG): container finished" podID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerID="af19f91de2c9cbcf73b0cea4e04b02a59758eef126a6482cb8c0f6f1196fd4e9" exitCode=0 Dec 04 00:55:37.725071 master-0 kubenswrapper[33142]: I1204 00:55:37.724249 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" event={"ID":"e5d5c870-8950-4aac-b6c4-cf5472a917fe","Type":"ContainerDied","Data":"af19f91de2c9cbcf73b0cea4e04b02a59758eef126a6482cb8c0f6f1196fd4e9"} Dec 04 00:55:37.738354 master-0 kubenswrapper[33142]: I1204 00:55:37.738245 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerStarted","Data":"df49c07bfda1eec39060fec1148192b4058a60832d828fc9ac92cfd4a8b29f4c"} Dec 04 00:55:38.752879 master-0 kubenswrapper[33142]: I1204 00:55:38.752770 33142 generic.go:334] "Generic (PLEG): container finished" podID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerID="df49c07bfda1eec39060fec1148192b4058a60832d828fc9ac92cfd4a8b29f4c" exitCode=0 Dec 04 00:55:38.752879 master-0 kubenswrapper[33142]: I1204 00:55:38.752874 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerDied","Data":"df49c07bfda1eec39060fec1148192b4058a60832d828fc9ac92cfd4a8b29f4c"} Dec 04 00:55:39.151843 master-0 kubenswrapper[33142]: I1204 00:55:39.151774 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:39.327734 master-0 kubenswrapper[33142]: I1204 00:55:39.327671 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle\") pod \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " Dec 04 00:55:39.328042 master-0 kubenswrapper[33142]: I1204 00:55:39.327783 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9gkh\" (UniqueName: \"kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh\") pod \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " Dec 04 00:55:39.328042 master-0 kubenswrapper[33142]: I1204 00:55:39.328034 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util\") pod \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\" (UID: \"e5d5c870-8950-4aac-b6c4-cf5472a917fe\") " Dec 04 00:55:39.329740 master-0 kubenswrapper[33142]: I1204 00:55:39.329490 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle" (OuterVolumeSpecName: "bundle") pod "e5d5c870-8950-4aac-b6c4-cf5472a917fe" (UID: "e5d5c870-8950-4aac-b6c4-cf5472a917fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:55:39.331789 master-0 kubenswrapper[33142]: I1204 00:55:39.331730 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh" (OuterVolumeSpecName: "kube-api-access-c9gkh") pod "e5d5c870-8950-4aac-b6c4-cf5472a917fe" (UID: "e5d5c870-8950-4aac-b6c4-cf5472a917fe"). InnerVolumeSpecName "kube-api-access-c9gkh". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:55:39.429750 master-0 kubenswrapper[33142]: I1204 00:55:39.429630 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:39.429750 master-0 kubenswrapper[33142]: I1204 00:55:39.429685 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c9gkh\" (UniqueName: \"kubernetes.io/projected/e5d5c870-8950-4aac-b6c4-cf5472a917fe-kube-api-access-c9gkh\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:39.432724 master-0 kubenswrapper[33142]: I1204 00:55:39.432434 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util" (OuterVolumeSpecName: "util") pod "e5d5c870-8950-4aac-b6c4-cf5472a917fe" (UID: "e5d5c870-8950-4aac-b6c4-cf5472a917fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:55:39.531401 master-0 kubenswrapper[33142]: I1204 00:55:39.531362 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5d5c870-8950-4aac-b6c4-cf5472a917fe-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:55:39.765028 master-0 kubenswrapper[33142]: I1204 00:55:39.764966 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" Dec 04 00:55:39.765647 master-0 kubenswrapper[33142]: I1204 00:55:39.764965 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d4sqflq" event={"ID":"e5d5c870-8950-4aac-b6c4-cf5472a917fe","Type":"ContainerDied","Data":"1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552"} Dec 04 00:55:39.765647 master-0 kubenswrapper[33142]: I1204 00:55:39.765129 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a0ee1184af88291099297e442a2a2fb33aadcb6a4bf71955771c9996fb03552" Dec 04 00:55:39.767776 master-0 kubenswrapper[33142]: I1204 00:55:39.767730 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerStarted","Data":"13cac9245e9eb7baad0744ba8eb8f84dc8c12ec95a570bb94605636ce361d656"} Dec 04 00:55:39.800252 master-0 kubenswrapper[33142]: I1204 00:55:39.800108 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-bw2vt" podStartSLOduration=2.050676642 podStartE2EDuration="4.800083548s" podCreationTimestamp="2025-12-04 00:55:35 +0000 UTC" firstStartedPulling="2025-12-04 00:55:36.710908478 +0000 UTC m=+509.112910328" lastFinishedPulling="2025-12-04 00:55:39.460315364 +0000 UTC m=+511.862317234" observedRunningTime="2025-12-04 00:55:39.796396403 +0000 UTC m=+512.198398283" watchObservedRunningTime="2025-12-04 00:55:39.800083548 +0000 UTC m=+512.202085418" Dec 04 00:55:44.605221 master-0 kubenswrapper[33142]: I1204 00:55:44.605145 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: E1204 00:55:44.605494 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="extract" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: I1204 00:55:44.605513 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="extract" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: E1204 00:55:44.605539 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="util" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: I1204 00:55:44.605548 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="util" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: E1204 00:55:44.605568 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="pull" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: I1204 00:55:44.605576 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="pull" Dec 04 00:55:44.605989 master-0 kubenswrapper[33142]: I1204 00:55:44.605821 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5d5c870-8950-4aac-b6c4-cf5472a917fe" containerName="extract" Dec 04 00:55:44.607228 master-0 kubenswrapper[33142]: I1204 00:55:44.607195 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.623504 master-0 kubenswrapper[33142]: I1204 00:55:44.623422 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkt2t\" (UniqueName: \"kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.623867 master-0 kubenswrapper[33142]: I1204 00:55:44.623748 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.623867 master-0 kubenswrapper[33142]: I1204 00:55:44.623828 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.627401 master-0 kubenswrapper[33142]: I1204 00:55:44.626512 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:55:44.725402 master-0 kubenswrapper[33142]: I1204 00:55:44.725314 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.725402 master-0 kubenswrapper[33142]: I1204 00:55:44.725378 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.725841 master-0 kubenswrapper[33142]: I1204 00:55:44.725438 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vkt2t\" (UniqueName: \"kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.726273 master-0 kubenswrapper[33142]: I1204 00:55:44.726212 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.726356 master-0 kubenswrapper[33142]: I1204 00:55:44.726302 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.743804 master-0 kubenswrapper[33142]: I1204 00:55:44.743716 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkt2t\" (UniqueName: \"kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t\") pod \"certified-operators-4ndfn\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:44.926636 master-0 kubenswrapper[33142]: I1204 00:55:44.926455 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:45.396413 master-0 kubenswrapper[33142]: I1204 00:55:45.396351 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:55:45.397916 master-0 kubenswrapper[33142]: W1204 00:55:45.397833 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e3949f_683a_4c4e_a0a8_fa000797683e.slice/crio-2d8205dec3b82348ab7e256ddbe513d91282558de798d4632401fb27368bc6c8 WatchSource:0}: Error finding container 2d8205dec3b82348ab7e256ddbe513d91282558de798d4632401fb27368bc6c8: Status 404 returned error can't find the container with id 2d8205dec3b82348ab7e256ddbe513d91282558de798d4632401fb27368bc6c8 Dec 04 00:55:45.539608 master-0 kubenswrapper[33142]: I1204 00:55:45.539517 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:45.539608 master-0 kubenswrapper[33142]: I1204 00:55:45.539611 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:45.838323 master-0 kubenswrapper[33142]: I1204 00:55:45.838178 33142 generic.go:334] "Generic (PLEG): container finished" podID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerID="90e90aa8fb400150cdc09cb4083f2fc8f3953b738403754c1fdfc9e21d6fefa4" exitCode=0 Dec 04 00:55:45.838323 master-0 kubenswrapper[33142]: I1204 00:55:45.838248 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerDied","Data":"90e90aa8fb400150cdc09cb4083f2fc8f3953b738403754c1fdfc9e21d6fefa4"} Dec 04 00:55:45.838958 master-0 kubenswrapper[33142]: I1204 00:55:45.838356 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerStarted","Data":"2d8205dec3b82348ab7e256ddbe513d91282558de798d4632401fb27368bc6c8"} Dec 04 00:55:45.930000 master-0 kubenswrapper[33142]: I1204 00:55:45.929906 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/lvms-operator-6bbcbcc6bc-grfjq"] Dec 04 00:55:45.931248 master-0 kubenswrapper[33142]: I1204 00:55:45.931218 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:45.933291 master-0 kubenswrapper[33142]: I1204 00:55:45.933228 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-metrics-cert" Dec 04 00:55:45.934192 master-0 kubenswrapper[33142]: I1204 00:55:45.934156 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-service-cert" Dec 04 00:55:45.934918 master-0 kubenswrapper[33142]: I1204 00:55:45.934877 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"kube-root-ca.crt" Dec 04 00:55:45.935094 master-0 kubenswrapper[33142]: I1204 00:55:45.935059 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-webhook-server-cert" Dec 04 00:55:45.935397 master-0 kubenswrapper[33142]: I1204 00:55:45.935373 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"openshift-service-ca.crt" Dec 04 00:55:45.946634 master-0 kubenswrapper[33142]: I1204 00:55:45.946578 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-6bbcbcc6bc-grfjq"] Dec 04 00:55:46.049452 master-0 kubenswrapper[33142]: I1204 00:55:46.048996 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-apiservice-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.049452 master-0 kubenswrapper[33142]: I1204 00:55:46.049164 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshls\" (UniqueName: \"kubernetes.io/projected/4acf6cd3-4c2e-498b-9590-72341b9339a2-kube-api-access-lshls\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.049452 master-0 kubenswrapper[33142]: I1204 00:55:46.049230 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-metrics-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.049452 master-0 kubenswrapper[33142]: I1204 00:55:46.049262 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-webhook-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.049452 master-0 kubenswrapper[33142]: I1204 00:55:46.049308 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acf6cd3-4c2e-498b-9590-72341b9339a2-socket-dir\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.150311 master-0 kubenswrapper[33142]: I1204 00:55:46.150251 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-apiservice-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.150555 master-0 kubenswrapper[33142]: I1204 00:55:46.150341 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lshls\" (UniqueName: \"kubernetes.io/projected/4acf6cd3-4c2e-498b-9590-72341b9339a2-kube-api-access-lshls\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.150555 master-0 kubenswrapper[33142]: I1204 00:55:46.150390 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-metrics-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.150555 master-0 kubenswrapper[33142]: I1204 00:55:46.150414 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-webhook-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.150555 master-0 kubenswrapper[33142]: I1204 00:55:46.150443 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acf6cd3-4c2e-498b-9590-72341b9339a2-socket-dir\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.151010 master-0 kubenswrapper[33142]: I1204 00:55:46.150978 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/4acf6cd3-4c2e-498b-9590-72341b9339a2-socket-dir\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.154815 master-0 kubenswrapper[33142]: I1204 00:55:46.154743 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-apiservice-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.154815 master-0 kubenswrapper[33142]: I1204 00:55:46.154794 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-webhook-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.156033 master-0 kubenswrapper[33142]: I1204 00:55:46.156007 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4acf6cd3-4c2e-498b-9590-72341b9339a2-metrics-cert\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.168386 master-0 kubenswrapper[33142]: I1204 00:55:46.168325 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshls\" (UniqueName: \"kubernetes.io/projected/4acf6cd3-4c2e-498b-9590-72341b9339a2-kube-api-access-lshls\") pod \"lvms-operator-6bbcbcc6bc-grfjq\" (UID: \"4acf6cd3-4c2e-498b-9590-72341b9339a2\") " pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.247776 master-0 kubenswrapper[33142]: I1204 00:55:46.247698 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:46.593640 master-0 kubenswrapper[33142]: I1204 00:55:46.593553 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-bw2vt" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="registry-server" probeResult="failure" output=< Dec 04 00:55:46.593640 master-0 kubenswrapper[33142]: timeout: failed to connect service ":50051" within 1s Dec 04 00:55:46.593640 master-0 kubenswrapper[33142]: > Dec 04 00:55:46.711239 master-0 kubenswrapper[33142]: I1204 00:55:46.711188 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-6bbcbcc6bc-grfjq"] Dec 04 00:55:46.713240 master-0 kubenswrapper[33142]: W1204 00:55:46.713157 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acf6cd3_4c2e_498b_9590_72341b9339a2.slice/crio-6a3605c6c25ee1566b9101cc361551d2354c19bb5c0db97f01d40f5c942c1ca0 WatchSource:0}: Error finding container 6a3605c6c25ee1566b9101cc361551d2354c19bb5c0db97f01d40f5c942c1ca0: Status 404 returned error can't find the container with id 6a3605c6c25ee1566b9101cc361551d2354c19bb5c0db97f01d40f5c942c1ca0 Dec 04 00:55:46.852108 master-0 kubenswrapper[33142]: I1204 00:55:46.852038 33142 generic.go:334] "Generic (PLEG): container finished" podID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerID="b020d51589a8529aa25fab99df35b440bc25812bf2253de9309bd2e739906fa7" exitCode=0 Dec 04 00:55:46.852659 master-0 kubenswrapper[33142]: I1204 00:55:46.852116 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerDied","Data":"b020d51589a8529aa25fab99df35b440bc25812bf2253de9309bd2e739906fa7"} Dec 04 00:55:46.855950 master-0 kubenswrapper[33142]: I1204 00:55:46.855367 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" event={"ID":"4acf6cd3-4c2e-498b-9590-72341b9339a2","Type":"ContainerStarted","Data":"6a3605c6c25ee1566b9101cc361551d2354c19bb5c0db97f01d40f5c942c1ca0"} Dec 04 00:55:47.865599 master-0 kubenswrapper[33142]: I1204 00:55:47.865534 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerStarted","Data":"2fea08b52550cd135dcffb134d6c6c4cb939833966992bd5a88356715d79232f"} Dec 04 00:55:47.899077 master-0 kubenswrapper[33142]: I1204 00:55:47.897325 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-4ndfn" podStartSLOduration=2.237154497 podStartE2EDuration="3.897305963s" podCreationTimestamp="2025-12-04 00:55:44 +0000 UTC" firstStartedPulling="2025-12-04 00:55:45.840945956 +0000 UTC m=+518.242947806" lastFinishedPulling="2025-12-04 00:55:47.501097422 +0000 UTC m=+519.903099272" observedRunningTime="2025-12-04 00:55:47.891788546 +0000 UTC m=+520.293790386" watchObservedRunningTime="2025-12-04 00:55:47.897305963 +0000 UTC m=+520.299307813" Dec 04 00:55:52.906265 master-0 kubenswrapper[33142]: I1204 00:55:52.906194 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" event={"ID":"4acf6cd3-4c2e-498b-9590-72341b9339a2","Type":"ContainerStarted","Data":"6e5e5ff5127a149d06f442942020fd6070bd9d596beff6e960f1a1b56f27187a"} Dec 04 00:55:52.906836 master-0 kubenswrapper[33142]: I1204 00:55:52.906393 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:53.032212 master-0 kubenswrapper[33142]: I1204 00:55:53.032107 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" podStartSLOduration=2.34133886 podStartE2EDuration="8.032085493s" podCreationTimestamp="2025-12-04 00:55:45 +0000 UTC" firstStartedPulling="2025-12-04 00:55:46.715567644 +0000 UTC m=+519.117569494" lastFinishedPulling="2025-12-04 00:55:52.406314227 +0000 UTC m=+524.808316127" observedRunningTime="2025-12-04 00:55:53.029794319 +0000 UTC m=+525.431796209" watchObservedRunningTime="2025-12-04 00:55:53.032085493 +0000 UTC m=+525.434087343" Dec 04 00:55:53.929948 master-0 kubenswrapper[33142]: I1204 00:55:53.929818 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/lvms-operator-6bbcbcc6bc-grfjq" Dec 04 00:55:54.927227 master-0 kubenswrapper[33142]: I1204 00:55:54.927088 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:54.927227 master-0 kubenswrapper[33142]: I1204 00:55:54.927201 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:55.019710 master-0 kubenswrapper[33142]: I1204 00:55:55.019329 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:55.599844 master-0 kubenswrapper[33142]: I1204 00:55:55.599766 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:55.644854 master-0 kubenswrapper[33142]: I1204 00:55:55.644800 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:55:56.015573 master-0 kubenswrapper[33142]: I1204 00:55:56.015414 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:55:58.243412 master-0 kubenswrapper[33142]: I1204 00:55:58.243341 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb"] Dec 04 00:55:58.244871 master-0 kubenswrapper[33142]: I1204 00:55:58.244835 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.246855 master-0 kubenswrapper[33142]: I1204 00:55:58.246806 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-dnqtf" Dec 04 00:55:58.254194 master-0 kubenswrapper[33142]: I1204 00:55:58.254133 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb"] Dec 04 00:55:58.280535 master-0 kubenswrapper[33142]: I1204 00:55:58.280440 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.280535 master-0 kubenswrapper[33142]: I1204 00:55:58.280518 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.281013 master-0 kubenswrapper[33142]: I1204 00:55:58.280611 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45cnr\" (UniqueName: \"kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.383196 master-0 kubenswrapper[33142]: I1204 00:55:58.383070 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-45cnr\" (UniqueName: \"kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.383483 master-0 kubenswrapper[33142]: I1204 00:55:58.383241 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.383483 master-0 kubenswrapper[33142]: I1204 00:55:58.383343 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.384019 master-0 kubenswrapper[33142]: I1204 00:55:58.383967 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.384308 master-0 kubenswrapper[33142]: I1204 00:55:58.384257 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.414633 master-0 kubenswrapper[33142]: I1204 00:55:58.414542 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-45cnr\" (UniqueName: \"kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.560164 master-0 kubenswrapper[33142]: I1204 00:55:58.559882 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:55:58.671670 master-0 kubenswrapper[33142]: I1204 00:55:58.671605 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg"] Dec 04 00:55:58.673721 master-0 kubenswrapper[33142]: I1204 00:55:58.673678 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.691180 master-0 kubenswrapper[33142]: I1204 00:55:58.691069 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.691467 master-0 kubenswrapper[33142]: I1204 00:55:58.691204 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.691467 master-0 kubenswrapper[33142]: I1204 00:55:58.691247 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2n9q\" (UniqueName: \"kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.700247 master-0 kubenswrapper[33142]: I1204 00:55:58.700169 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg"] Dec 04 00:55:58.792675 master-0 kubenswrapper[33142]: I1204 00:55:58.792627 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.792938 master-0 kubenswrapper[33142]: I1204 00:55:58.792717 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.792938 master-0 kubenswrapper[33142]: I1204 00:55:58.792752 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2n9q\" (UniqueName: \"kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.793598 master-0 kubenswrapper[33142]: I1204 00:55:58.793552 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.793719 master-0 kubenswrapper[33142]: I1204 00:55:58.793646 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:58.815071 master-0 kubenswrapper[33142]: I1204 00:55:58.814952 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2n9q\" (UniqueName: \"kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:59.000721 master-0 kubenswrapper[33142]: I1204 00:55:59.000629 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:55:59.153677 master-0 kubenswrapper[33142]: W1204 00:55:59.153520 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebbd5e9_d5a0_46d0_a173_8a61d0534f7a.slice/crio-09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c WatchSource:0}: Error finding container 09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c: Status 404 returned error can't find the container with id 09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c Dec 04 00:55:59.165419 master-0 kubenswrapper[33142]: I1204 00:55:59.157273 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb"] Dec 04 00:55:59.742760 master-0 kubenswrapper[33142]: I1204 00:55:59.742662 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:55:59.743479 master-0 kubenswrapper[33142]: W1204 00:55:59.743174 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4dcc82_6228_46b4_9ad8_9277f45821d8.slice/crio-5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da WatchSource:0}: Error finding container 5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da: Status 404 returned error can't find the container with id 5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da Dec 04 00:55:59.743479 master-0 kubenswrapper[33142]: I1204 00:55:59.743238 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-4ndfn" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="registry-server" containerID="cri-o://2fea08b52550cd135dcffb134d6c6c4cb939833966992bd5a88356715d79232f" gracePeriod=2 Dec 04 00:55:59.762168 master-0 kubenswrapper[33142]: I1204 00:55:59.762069 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg"] Dec 04 00:55:59.816641 master-0 kubenswrapper[33142]: I1204 00:55:59.816553 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld"] Dec 04 00:55:59.821683 master-0 kubenswrapper[33142]: I1204 00:55:59.821637 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:55:59.830588 master-0 kubenswrapper[33142]: I1204 00:55:59.829799 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld"] Dec 04 00:55:59.913067 master-0 kubenswrapper[33142]: I1204 00:55:59.912529 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhjc\" (UniqueName: \"kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:55:59.913067 master-0 kubenswrapper[33142]: I1204 00:55:59.912620 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:55:59.913067 master-0 kubenswrapper[33142]: I1204 00:55:59.912731 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:55:59.975851 master-0 kubenswrapper[33142]: I1204 00:55:59.975660 33142 generic.go:334] "Generic (PLEG): container finished" podID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerID="2fea08b52550cd135dcffb134d6c6c4cb939833966992bd5a88356715d79232f" exitCode=0 Dec 04 00:55:59.975851 master-0 kubenswrapper[33142]: I1204 00:55:59.975716 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerDied","Data":"2fea08b52550cd135dcffb134d6c6c4cb939833966992bd5a88356715d79232f"} Dec 04 00:55:59.977618 master-0 kubenswrapper[33142]: I1204 00:55:59.977574 33142 generic.go:334] "Generic (PLEG): container finished" podID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerID="fa9e8b73bb407ad995f5638d46e2b4b529dd321b9ad76438cecad1b8bc4b60aa" exitCode=0 Dec 04 00:55:59.977618 master-0 kubenswrapper[33142]: I1204 00:55:59.977610 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" event={"ID":"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a","Type":"ContainerDied","Data":"fa9e8b73bb407ad995f5638d46e2b4b529dd321b9ad76438cecad1b8bc4b60aa"} Dec 04 00:55:59.977867 master-0 kubenswrapper[33142]: I1204 00:55:59.977648 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" event={"ID":"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a","Type":"ContainerStarted","Data":"09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c"} Dec 04 00:55:59.978960 master-0 kubenswrapper[33142]: I1204 00:55:59.978748 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" event={"ID":"3d4dcc82-6228-46b4-9ad8-9277f45821d8","Type":"ContainerStarted","Data":"5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da"} Dec 04 00:56:00.014376 master-0 kubenswrapper[33142]: I1204 00:56:00.014274 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.014376 master-0 kubenswrapper[33142]: I1204 00:56:00.014391 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhjc\" (UniqueName: \"kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.014775 master-0 kubenswrapper[33142]: I1204 00:56:00.014423 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.015107 master-0 kubenswrapper[33142]: I1204 00:56:00.015065 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.016771 master-0 kubenswrapper[33142]: I1204 00:56:00.016717 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.032162 master-0 kubenswrapper[33142]: I1204 00:56:00.032104 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhjc\" (UniqueName: \"kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.124611 master-0 kubenswrapper[33142]: I1204 00:56:00.124531 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:00.234109 master-0 kubenswrapper[33142]: I1204 00:56:00.234038 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:56:00.319788 master-0 kubenswrapper[33142]: I1204 00:56:00.319707 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkt2t\" (UniqueName: \"kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t\") pod \"81e3949f-683a-4c4e-a0a8-fa000797683e\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " Dec 04 00:56:00.320083 master-0 kubenswrapper[33142]: I1204 00:56:00.319845 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content\") pod \"81e3949f-683a-4c4e-a0a8-fa000797683e\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " Dec 04 00:56:00.320083 master-0 kubenswrapper[33142]: I1204 00:56:00.319917 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities\") pod \"81e3949f-683a-4c4e-a0a8-fa000797683e\" (UID: \"81e3949f-683a-4c4e-a0a8-fa000797683e\") " Dec 04 00:56:00.320981 master-0 kubenswrapper[33142]: I1204 00:56:00.320915 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities" (OuterVolumeSpecName: "utilities") pod "81e3949f-683a-4c4e-a0a8-fa000797683e" (UID: "81e3949f-683a-4c4e-a0a8-fa000797683e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:00.324707 master-0 kubenswrapper[33142]: I1204 00:56:00.324590 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t" (OuterVolumeSpecName: "kube-api-access-vkt2t") pod "81e3949f-683a-4c4e-a0a8-fa000797683e" (UID: "81e3949f-683a-4c4e-a0a8-fa000797683e"). InnerVolumeSpecName "kube-api-access-vkt2t". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:00.377958 master-0 kubenswrapper[33142]: I1204 00:56:00.377823 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "81e3949f-683a-4c4e-a0a8-fa000797683e" (UID: "81e3949f-683a-4c4e-a0a8-fa000797683e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:00.421602 master-0 kubenswrapper[33142]: I1204 00:56:00.421515 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vkt2t\" (UniqueName: \"kubernetes.io/projected/81e3949f-683a-4c4e-a0a8-fa000797683e-kube-api-access-vkt2t\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:00.421602 master-0 kubenswrapper[33142]: I1204 00:56:00.421571 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:00.421602 master-0 kubenswrapper[33142]: I1204 00:56:00.421584 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81e3949f-683a-4c4e-a0a8-fa000797683e-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:00.603188 master-0 kubenswrapper[33142]: I1204 00:56:00.602520 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:56:00.603982 master-0 kubenswrapper[33142]: I1204 00:56:00.603424 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-bw2vt" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="registry-server" containerID="cri-o://13cac9245e9eb7baad0744ba8eb8f84dc8c12ec95a570bb94605636ce361d656" gracePeriod=2 Dec 04 00:56:00.633912 master-0 kubenswrapper[33142]: I1204 00:56:00.633502 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld"] Dec 04 00:56:00.638466 master-0 kubenswrapper[33142]: W1204 00:56:00.638381 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db6ff94_e069_47b5_b076_d892cfe90dfc.slice/crio-9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a WatchSource:0}: Error finding container 9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a: Status 404 returned error can't find the container with id 9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a Dec 04 00:56:00.990115 master-0 kubenswrapper[33142]: I1204 00:56:00.989979 33142 generic.go:334] "Generic (PLEG): container finished" podID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerID="b65cb9d261ed9150d71673de9cb91bfb5659829c2c4147c34d8ec26381c82dae" exitCode=0 Dec 04 00:56:00.990115 master-0 kubenswrapper[33142]: I1204 00:56:00.990053 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" event={"ID":"3d4dcc82-6228-46b4-9ad8-9277f45821d8","Type":"ContainerDied","Data":"b65cb9d261ed9150d71673de9cb91bfb5659829c2c4147c34d8ec26381c82dae"} Dec 04 00:56:00.996143 master-0 kubenswrapper[33142]: I1204 00:56:00.996011 33142 generic.go:334] "Generic (PLEG): container finished" podID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerID="13cac9245e9eb7baad0744ba8eb8f84dc8c12ec95a570bb94605636ce361d656" exitCode=0 Dec 04 00:56:00.996143 master-0 kubenswrapper[33142]: I1204 00:56:00.996078 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerDied","Data":"13cac9245e9eb7baad0744ba8eb8f84dc8c12ec95a570bb94605636ce361d656"} Dec 04 00:56:00.999176 master-0 kubenswrapper[33142]: I1204 00:56:00.999014 33142 generic.go:334] "Generic (PLEG): container finished" podID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerID="6401e00bc7a0f8fd9b5c5859f58fcbf0ab17225847b4c4216857991394534329" exitCode=0 Dec 04 00:56:00.999176 master-0 kubenswrapper[33142]: I1204 00:56:00.999084 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" event={"ID":"2db6ff94-e069-47b5-b076-d892cfe90dfc","Type":"ContainerDied","Data":"6401e00bc7a0f8fd9b5c5859f58fcbf0ab17225847b4c4216857991394534329"} Dec 04 00:56:00.999176 master-0 kubenswrapper[33142]: I1204 00:56:00.999146 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" event={"ID":"2db6ff94-e069-47b5-b076-d892cfe90dfc","Type":"ContainerStarted","Data":"9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a"} Dec 04 00:56:01.002557 master-0 kubenswrapper[33142]: I1204 00:56:01.002515 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-4ndfn" event={"ID":"81e3949f-683a-4c4e-a0a8-fa000797683e","Type":"ContainerDied","Data":"2d8205dec3b82348ab7e256ddbe513d91282558de798d4632401fb27368bc6c8"} Dec 04 00:56:01.002759 master-0 kubenswrapper[33142]: I1204 00:56:01.002571 33142 scope.go:117] "RemoveContainer" containerID="2fea08b52550cd135dcffb134d6c6c4cb939833966992bd5a88356715d79232f" Dec 04 00:56:01.002759 master-0 kubenswrapper[33142]: I1204 00:56:01.002602 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-4ndfn" Dec 04 00:56:01.025131 master-0 kubenswrapper[33142]: I1204 00:56:01.025078 33142 scope.go:117] "RemoveContainer" containerID="b020d51589a8529aa25fab99df35b440bc25812bf2253de9309bd2e739906fa7" Dec 04 00:56:01.069339 master-0 kubenswrapper[33142]: I1204 00:56:01.067754 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:56:01.071628 master-0 kubenswrapper[33142]: I1204 00:56:01.071530 33142 scope.go:117] "RemoveContainer" containerID="90e90aa8fb400150cdc09cb4083f2fc8f3953b738403754c1fdfc9e21d6fefa4" Dec 04 00:56:01.085367 master-0 kubenswrapper[33142]: I1204 00:56:01.085257 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-4ndfn"] Dec 04 00:56:01.106281 master-0 kubenswrapper[33142]: I1204 00:56:01.106231 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:56:01.135962 master-0 kubenswrapper[33142]: I1204 00:56:01.133427 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities\") pod \"f1d14b8b-7738-4e29-97b2-17136a4cd379\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " Dec 04 00:56:01.135962 master-0 kubenswrapper[33142]: I1204 00:56:01.133608 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lpbn\" (UniqueName: \"kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn\") pod \"f1d14b8b-7738-4e29-97b2-17136a4cd379\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " Dec 04 00:56:01.135962 master-0 kubenswrapper[33142]: I1204 00:56:01.133661 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content\") pod \"f1d14b8b-7738-4e29-97b2-17136a4cd379\" (UID: \"f1d14b8b-7738-4e29-97b2-17136a4cd379\") " Dec 04 00:56:01.154956 master-0 kubenswrapper[33142]: I1204 00:56:01.150193 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn" (OuterVolumeSpecName: "kube-api-access-8lpbn") pod "f1d14b8b-7738-4e29-97b2-17136a4cd379" (UID: "f1d14b8b-7738-4e29-97b2-17136a4cd379"). InnerVolumeSpecName "kube-api-access-8lpbn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:01.154956 master-0 kubenswrapper[33142]: I1204 00:56:01.154050 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities" (OuterVolumeSpecName: "utilities") pod "f1d14b8b-7738-4e29-97b2-17136a4cd379" (UID: "f1d14b8b-7738-4e29-97b2-17136a4cd379"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:01.235770 master-0 kubenswrapper[33142]: I1204 00:56:01.235644 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8lpbn\" (UniqueName: \"kubernetes.io/projected/f1d14b8b-7738-4e29-97b2-17136a4cd379-kube-api-access-8lpbn\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:01.235770 master-0 kubenswrapper[33142]: I1204 00:56:01.235681 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:01.287502 master-0 kubenswrapper[33142]: I1204 00:56:01.287408 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f1d14b8b-7738-4e29-97b2-17136a4cd379" (UID: "f1d14b8b-7738-4e29-97b2-17136a4cd379"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:01.337938 master-0 kubenswrapper[33142]: I1204 00:56:01.337850 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f1d14b8b-7738-4e29-97b2-17136a4cd379-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:01.910198 master-0 kubenswrapper[33142]: I1204 00:56:01.910046 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" path="/var/lib/kubelet/pods/81e3949f-683a-4c4e-a0a8-fa000797683e/volumes" Dec 04 00:56:02.012712 master-0 kubenswrapper[33142]: I1204 00:56:02.012603 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bw2vt" event={"ID":"f1d14b8b-7738-4e29-97b2-17136a4cd379","Type":"ContainerDied","Data":"4fc375b6106026cd5d68516188e09286145664d78325739bf31317b1fe6bfd8c"} Dec 04 00:56:02.012712 master-0 kubenswrapper[33142]: I1204 00:56:02.012650 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bw2vt" Dec 04 00:56:02.012712 master-0 kubenswrapper[33142]: I1204 00:56:02.012675 33142 scope.go:117] "RemoveContainer" containerID="13cac9245e9eb7baad0744ba8eb8f84dc8c12ec95a570bb94605636ce361d656" Dec 04 00:56:02.043083 master-0 kubenswrapper[33142]: I1204 00:56:02.043013 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:56:02.045383 master-0 kubenswrapper[33142]: I1204 00:56:02.045336 33142 scope.go:117] "RemoveContainer" containerID="df49c07bfda1eec39060fec1148192b4058a60832d828fc9ac92cfd4a8b29f4c" Dec 04 00:56:02.052525 master-0 kubenswrapper[33142]: I1204 00:56:02.052464 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-bw2vt"] Dec 04 00:56:03.104843 master-0 kubenswrapper[33142]: I1204 00:56:03.104746 33142 scope.go:117] "RemoveContainer" containerID="5414afc246c3492226b79f8232573bea830c3b50b15dc75110c4e99b721977d4" Dec 04 00:56:03.910039 master-0 kubenswrapper[33142]: I1204 00:56:03.909791 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" path="/var/lib/kubelet/pods/f1d14b8b-7738-4e29-97b2-17136a4cd379/volumes" Dec 04 00:56:04.041153 master-0 kubenswrapper[33142]: I1204 00:56:04.040901 33142 generic.go:334] "Generic (PLEG): container finished" podID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerID="943268c71287f2be07fa055ca8eb0d15c83d5a53ff59df2388a495d1d1a34dcf" exitCode=0 Dec 04 00:56:04.041153 master-0 kubenswrapper[33142]: I1204 00:56:04.041040 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" event={"ID":"2db6ff94-e069-47b5-b076-d892cfe90dfc","Type":"ContainerDied","Data":"943268c71287f2be07fa055ca8eb0d15c83d5a53ff59df2388a495d1d1a34dcf"} Dec 04 00:56:04.046202 master-0 kubenswrapper[33142]: I1204 00:56:04.046148 33142 generic.go:334] "Generic (PLEG): container finished" podID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerID="86392fc2ebe39254871c8343f49b8b26affe944214cae529f08e4347bf0df512" exitCode=0 Dec 04 00:56:04.046358 master-0 kubenswrapper[33142]: I1204 00:56:04.046253 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" event={"ID":"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a","Type":"ContainerDied","Data":"86392fc2ebe39254871c8343f49b8b26affe944214cae529f08e4347bf0df512"} Dec 04 00:56:04.050672 master-0 kubenswrapper[33142]: I1204 00:56:04.050595 33142 generic.go:334] "Generic (PLEG): container finished" podID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerID="732df559b3a7768045bd4b37b9561d77ef99a99a2f74e100f27147c32c339433" exitCode=0 Dec 04 00:56:04.050981 master-0 kubenswrapper[33142]: I1204 00:56:04.050680 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" event={"ID":"3d4dcc82-6228-46b4-9ad8-9277f45821d8","Type":"ContainerDied","Data":"732df559b3a7768045bd4b37b9561d77ef99a99a2f74e100f27147c32c339433"} Dec 04 00:56:05.068490 master-0 kubenswrapper[33142]: I1204 00:56:05.068395 33142 generic.go:334] "Generic (PLEG): container finished" podID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerID="ea4c2148849fd0b5e75b5c8367eb6c99227e584abc56c6a63cf595538a459b6e" exitCode=0 Dec 04 00:56:05.069637 master-0 kubenswrapper[33142]: I1204 00:56:05.068480 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" event={"ID":"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a","Type":"ContainerDied","Data":"ea4c2148849fd0b5e75b5c8367eb6c99227e584abc56c6a63cf595538a459b6e"} Dec 04 00:56:05.074533 master-0 kubenswrapper[33142]: I1204 00:56:05.074453 33142 generic.go:334] "Generic (PLEG): container finished" podID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerID="67c869b0e3b531f5cd159bd4126443e9f8d2482be4fd017d42fc64fb9f334f0c" exitCode=0 Dec 04 00:56:05.074718 master-0 kubenswrapper[33142]: I1204 00:56:05.074583 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" event={"ID":"3d4dcc82-6228-46b4-9ad8-9277f45821d8","Type":"ContainerDied","Data":"67c869b0e3b531f5cd159bd4126443e9f8d2482be4fd017d42fc64fb9f334f0c"} Dec 04 00:56:05.079295 master-0 kubenswrapper[33142]: I1204 00:56:05.079214 33142 generic.go:334] "Generic (PLEG): container finished" podID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerID="7e3b8630b1b3920eff44f18d8cfdf5c46213a03f6dc24e951dd493603b042180" exitCode=0 Dec 04 00:56:05.079477 master-0 kubenswrapper[33142]: I1204 00:56:05.079300 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" event={"ID":"2db6ff94-e069-47b5-b076-d892cfe90dfc","Type":"ContainerDied","Data":"7e3b8630b1b3920eff44f18d8cfdf5c46213a03f6dc24e951dd493603b042180"} Dec 04 00:56:06.470607 master-0 kubenswrapper[33142]: I1204 00:56:06.470547 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:56:06.538632 master-0 kubenswrapper[33142]: I1204 00:56:06.538543 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util\") pod \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " Dec 04 00:56:06.538632 master-0 kubenswrapper[33142]: I1204 00:56:06.538643 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle\") pod \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " Dec 04 00:56:06.539080 master-0 kubenswrapper[33142]: I1204 00:56:06.538773 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2n9q\" (UniqueName: \"kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q\") pod \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\" (UID: \"3d4dcc82-6228-46b4-9ad8-9277f45821d8\") " Dec 04 00:56:06.540506 master-0 kubenswrapper[33142]: I1204 00:56:06.540457 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle" (OuterVolumeSpecName: "bundle") pod "3d4dcc82-6228-46b4-9ad8-9277f45821d8" (UID: "3d4dcc82-6228-46b4-9ad8-9277f45821d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.543905 master-0 kubenswrapper[33142]: I1204 00:56:06.543853 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q" (OuterVolumeSpecName: "kube-api-access-w2n9q") pod "3d4dcc82-6228-46b4-9ad8-9277f45821d8" (UID: "3d4dcc82-6228-46b4-9ad8-9277f45821d8"). InnerVolumeSpecName "kube-api-access-w2n9q". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:06.557632 master-0 kubenswrapper[33142]: I1204 00:56:06.557526 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util" (OuterVolumeSpecName: "util") pod "3d4dcc82-6228-46b4-9ad8-9277f45821d8" (UID: "3d4dcc82-6228-46b4-9ad8-9277f45821d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.642107 master-0 kubenswrapper[33142]: I1204 00:56:06.641948 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2n9q\" (UniqueName: \"kubernetes.io/projected/3d4dcc82-6228-46b4-9ad8-9277f45821d8-kube-api-access-w2n9q\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.642107 master-0 kubenswrapper[33142]: I1204 00:56:06.641988 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.642107 master-0 kubenswrapper[33142]: I1204 00:56:06.641998 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d4dcc82-6228-46b4-9ad8-9277f45821d8-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.711390 master-0 kubenswrapper[33142]: I1204 00:56:06.711311 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:56:06.716729 master-0 kubenswrapper[33142]: I1204 00:56:06.716683 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:06.742685 master-0 kubenswrapper[33142]: I1204 00:56:06.742598 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle\") pod \"2db6ff94-e069-47b5-b076-d892cfe90dfc\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " Dec 04 00:56:06.742685 master-0 kubenswrapper[33142]: I1204 00:56:06.742666 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle\") pod \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " Dec 04 00:56:06.743000 master-0 kubenswrapper[33142]: I1204 00:56:06.742714 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util\") pod \"2db6ff94-e069-47b5-b076-d892cfe90dfc\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " Dec 04 00:56:06.743000 master-0 kubenswrapper[33142]: I1204 00:56:06.742783 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util\") pod \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " Dec 04 00:56:06.743000 master-0 kubenswrapper[33142]: I1204 00:56:06.742883 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhjc\" (UniqueName: \"kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc\") pod \"2db6ff94-e069-47b5-b076-d892cfe90dfc\" (UID: \"2db6ff94-e069-47b5-b076-d892cfe90dfc\") " Dec 04 00:56:06.743150 master-0 kubenswrapper[33142]: I1204 00:56:06.743063 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45cnr\" (UniqueName: \"kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr\") pod \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\" (UID: \"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a\") " Dec 04 00:56:06.743315 master-0 kubenswrapper[33142]: I1204 00:56:06.743261 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle" (OuterVolumeSpecName: "bundle") pod "2db6ff94-e069-47b5-b076-d892cfe90dfc" (UID: "2db6ff94-e069-47b5-b076-d892cfe90dfc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.743732 master-0 kubenswrapper[33142]: I1204 00:56:06.743692 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.745714 master-0 kubenswrapper[33142]: I1204 00:56:06.745633 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle" (OuterVolumeSpecName: "bundle") pod "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" (UID: "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.747871 master-0 kubenswrapper[33142]: I1204 00:56:06.747815 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr" (OuterVolumeSpecName: "kube-api-access-45cnr") pod "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" (UID: "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a"). InnerVolumeSpecName "kube-api-access-45cnr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:06.747972 master-0 kubenswrapper[33142]: I1204 00:56:06.747949 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc" (OuterVolumeSpecName: "kube-api-access-hkhjc") pod "2db6ff94-e069-47b5-b076-d892cfe90dfc" (UID: "2db6ff94-e069-47b5-b076-d892cfe90dfc"). InnerVolumeSpecName "kube-api-access-hkhjc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:06.757182 master-0 kubenswrapper[33142]: I1204 00:56:06.757120 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util" (OuterVolumeSpecName: "util") pod "2db6ff94-e069-47b5-b076-d892cfe90dfc" (UID: "2db6ff94-e069-47b5-b076-d892cfe90dfc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.758593 master-0 kubenswrapper[33142]: I1204 00:56:06.758537 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util" (OuterVolumeSpecName: "util") pod "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" (UID: "9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:06.845736 master-0 kubenswrapper[33142]: I1204 00:56:06.845655 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-45cnr\" (UniqueName: \"kubernetes.io/projected/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-kube-api-access-45cnr\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.845736 master-0 kubenswrapper[33142]: I1204 00:56:06.845708 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.845736 master-0 kubenswrapper[33142]: I1204 00:56:06.845723 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db6ff94-e069-47b5-b076-d892cfe90dfc-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.845736 master-0 kubenswrapper[33142]: I1204 00:56:06.845733 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:06.845736 master-0 kubenswrapper[33142]: I1204 00:56:06.845742 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hkhjc\" (UniqueName: \"kubernetes.io/projected/2db6ff94-e069-47b5-b076-d892cfe90dfc-kube-api-access-hkhjc\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:07.105230 master-0 kubenswrapper[33142]: I1204 00:56:07.105124 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" event={"ID":"2db6ff94-e069-47b5-b076-d892cfe90dfc","Type":"ContainerDied","Data":"9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a"} Dec 04 00:56:07.105230 master-0 kubenswrapper[33142]: I1204 00:56:07.105203 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ca1a306e9d6ae410155a361e59e61a7d3de033627f2838401fffc474a451d3a" Dec 04 00:56:07.105640 master-0 kubenswrapper[33142]: I1204 00:56:07.105236 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fnwfld" Dec 04 00:56:07.109234 master-0 kubenswrapper[33142]: I1204 00:56:07.109173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" event={"ID":"9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a","Type":"ContainerDied","Data":"09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c"} Dec 04 00:56:07.109234 master-0 kubenswrapper[33142]: I1204 00:56:07.109229 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09bce3cc8a635717677174376b7c7c7c5c8652e2ab22e4c33a703f9f8a52f01c" Dec 04 00:56:07.109416 master-0 kubenswrapper[33142]: I1204 00:56:07.109335 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931a54gjb" Dec 04 00:56:07.113988 master-0 kubenswrapper[33142]: I1204 00:56:07.113858 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" event={"ID":"3d4dcc82-6228-46b4-9ad8-9277f45821d8","Type":"ContainerDied","Data":"5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da"} Dec 04 00:56:07.113988 master-0 kubenswrapper[33142]: I1204 00:56:07.113959 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d3b59c0aa7ec6c67df8b1bc3c36a07c845bd14bae9392851db26e344f36d0da" Dec 04 00:56:07.114208 master-0 kubenswrapper[33142]: I1204 00:56:07.113978 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f834pzzg" Dec 04 00:56:09.228992 master-0 kubenswrapper[33142]: I1204 00:56:09.228861 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229321 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229342 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229371 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="extract-utilities" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229384 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="extract-utilities" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229397 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229407 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229429 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="extract-content" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229438 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="extract-content" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229453 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229461 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229470 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229478 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229493 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="extract-utilities" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229501 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="extract-utilities" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229514 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229523 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229537 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229545 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229570 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229578 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229587 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="extract-content" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229595 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="extract-content" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229610 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229621 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="pull" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229637 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229646 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229658 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229666 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="util" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: E1204 00:56:09.229678 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229687 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229888 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1d14b8b-7738-4e29-97b2-17136a4cd379" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229924 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d4dcc82-6228-46b4-9ad8-9277f45821d8" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229956 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="81e3949f-683a-4c4e-a0a8-fa000797683e" containerName="registry-server" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229978 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2db6ff94-e069-47b5-b076-d892cfe90dfc" containerName="extract" Dec 04 00:56:09.230110 master-0 kubenswrapper[33142]: I1204 00:56:09.229989 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ebbd5e9-d5a0-46d0-a173-8a61d0534f7a" containerName="extract" Dec 04 00:56:09.231983 master-0 kubenswrapper[33142]: I1204 00:56:09.231454 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.290116 master-0 kubenswrapper[33142]: I1204 00:56:09.288937 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.290116 master-0 kubenswrapper[33142]: I1204 00:56:09.289068 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4jn\" (UniqueName: \"kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.290116 master-0 kubenswrapper[33142]: I1204 00:56:09.289219 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.290116 master-0 kubenswrapper[33142]: I1204 00:56:09.289968 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:09.395954 master-0 kubenswrapper[33142]: I1204 00:56:09.392900 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4jn\" (UniqueName: \"kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.395954 master-0 kubenswrapper[33142]: I1204 00:56:09.393072 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.395954 master-0 kubenswrapper[33142]: I1204 00:56:09.393129 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.395954 master-0 kubenswrapper[33142]: I1204 00:56:09.393715 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.395954 master-0 kubenswrapper[33142]: I1204 00:56:09.394879 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.418280 master-0 kubenswrapper[33142]: I1204 00:56:09.418018 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4jn\" (UniqueName: \"kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn\") pod \"redhat-marketplace-ghl5v\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:09.571679 master-0 kubenswrapper[33142]: I1204 00:56:09.547768 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:10.117520 master-0 kubenswrapper[33142]: I1204 00:56:10.117464 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:10.124789 master-0 kubenswrapper[33142]: W1204 00:56:10.124211 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e87f2d_8675_430b_9279_c37d6c2a627c.slice/crio-8c46af993ef9ec838169007b5fe2999a9dc77b8a0a1237ba3c27310a4e491987 WatchSource:0}: Error finding container 8c46af993ef9ec838169007b5fe2999a9dc77b8a0a1237ba3c27310a4e491987: Status 404 returned error can't find the container with id 8c46af993ef9ec838169007b5fe2999a9dc77b8a0a1237ba3c27310a4e491987 Dec 04 00:56:10.148137 master-0 kubenswrapper[33142]: I1204 00:56:10.148058 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerStarted","Data":"8c46af993ef9ec838169007b5fe2999a9dc77b8a0a1237ba3c27310a4e491987"} Dec 04 00:56:11.158321 master-0 kubenswrapper[33142]: I1204 00:56:11.158252 33142 generic.go:334] "Generic (PLEG): container finished" podID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerID="e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274" exitCode=0 Dec 04 00:56:11.158862 master-0 kubenswrapper[33142]: I1204 00:56:11.158327 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerDied","Data":"e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274"} Dec 04 00:56:12.168180 master-0 kubenswrapper[33142]: I1204 00:56:12.168089 33142 generic.go:334] "Generic (PLEG): container finished" podID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerID="e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e" exitCode=0 Dec 04 00:56:12.168180 master-0 kubenswrapper[33142]: I1204 00:56:12.168161 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerDied","Data":"e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e"} Dec 04 00:56:12.627387 master-0 kubenswrapper[33142]: I1204 00:56:12.627304 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc"] Dec 04 00:56:12.629011 master-0 kubenswrapper[33142]: I1204 00:56:12.628980 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.632239 master-0 kubenswrapper[33142]: I1204 00:56:12.632210 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"openshift-service-ca.crt" Dec 04 00:56:12.632438 master-0 kubenswrapper[33142]: I1204 00:56:12.632383 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"kube-root-ca.crt" Dec 04 00:56:12.664725 master-0 kubenswrapper[33142]: I1204 00:56:12.664657 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e28e5-f865-426e-b4d3-bf8182c64b73-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.664996 master-0 kubenswrapper[33142]: I1204 00:56:12.664751 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkhx\" (UniqueName: \"kubernetes.io/projected/f35e28e5-f865-426e-b4d3-bf8182c64b73-kube-api-access-ljkhx\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.672618 master-0 kubenswrapper[33142]: I1204 00:56:12.672552 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc"] Dec 04 00:56:12.766903 master-0 kubenswrapper[33142]: I1204 00:56:12.766861 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkhx\" (UniqueName: \"kubernetes.io/projected/f35e28e5-f865-426e-b4d3-bf8182c64b73-kube-api-access-ljkhx\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.767276 master-0 kubenswrapper[33142]: I1204 00:56:12.767252 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e28e5-f865-426e-b4d3-bf8182c64b73-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.769066 master-0 kubenswrapper[33142]: I1204 00:56:12.768990 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e28e5-f865-426e-b4d3-bf8182c64b73-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.796431 master-0 kubenswrapper[33142]: I1204 00:56:12.796353 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkhx\" (UniqueName: \"kubernetes.io/projected/f35e28e5-f865-426e-b4d3-bf8182c64b73-kube-api-access-ljkhx\") pod \"cert-manager-operator-controller-manager-64cf6dff88-rnfvc\" (UID: \"f35e28e5-f865-426e-b4d3-bf8182c64b73\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:12.996418 master-0 kubenswrapper[33142]: I1204 00:56:12.996257 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" Dec 04 00:56:13.198314 master-0 kubenswrapper[33142]: I1204 00:56:13.198247 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerStarted","Data":"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607"} Dec 04 00:56:13.220172 master-0 kubenswrapper[33142]: I1204 00:56:13.219948 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:13.246494 master-0 kubenswrapper[33142]: I1204 00:56:13.242262 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.267687 master-0 kubenswrapper[33142]: I1204 00:56:13.265959 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:13.272051 master-0 kubenswrapper[33142]: I1204 00:56:13.271740 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-ghl5v" podStartSLOduration=2.826191986 podStartE2EDuration="4.271719658s" podCreationTimestamp="2025-12-04 00:56:09 +0000 UTC" firstStartedPulling="2025-12-04 00:56:11.160439688 +0000 UTC m=+543.562441538" lastFinishedPulling="2025-12-04 00:56:12.60596735 +0000 UTC m=+545.007969210" observedRunningTime="2025-12-04 00:56:13.238431296 +0000 UTC m=+545.640433146" watchObservedRunningTime="2025-12-04 00:56:13.271719658 +0000 UTC m=+545.673721508" Dec 04 00:56:13.276107 master-0 kubenswrapper[33142]: I1204 00:56:13.275913 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.276107 master-0 kubenswrapper[33142]: I1204 00:56:13.275979 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.276107 master-0 kubenswrapper[33142]: I1204 00:56:13.276056 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjh6\" (UniqueName: \"kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.377273 master-0 kubenswrapper[33142]: I1204 00:56:13.377214 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjh6\" (UniqueName: \"kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.377506 master-0 kubenswrapper[33142]: I1204 00:56:13.377336 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.377506 master-0 kubenswrapper[33142]: I1204 00:56:13.377356 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.377988 master-0 kubenswrapper[33142]: I1204 00:56:13.377946 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.378056 master-0 kubenswrapper[33142]: I1204 00:56:13.378007 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.393379 master-0 kubenswrapper[33142]: I1204 00:56:13.393334 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjh6\" (UniqueName: \"kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6\") pod \"community-operators-gssk8\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:13.516101 master-0 kubenswrapper[33142]: I1204 00:56:13.515276 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc"] Dec 04 00:56:13.520519 master-0 kubenswrapper[33142]: W1204 00:56:13.520284 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35e28e5_f865_426e_b4d3_bf8182c64b73.slice/crio-97a0f222983bfec5a3e113a7984f9d3396a46e3c8adcf8abfeeebc4b7d5901aa WatchSource:0}: Error finding container 97a0f222983bfec5a3e113a7984f9d3396a46e3c8adcf8abfeeebc4b7d5901aa: Status 404 returned error can't find the container with id 97a0f222983bfec5a3e113a7984f9d3396a46e3c8adcf8abfeeebc4b7d5901aa Dec 04 00:56:13.568074 master-0 kubenswrapper[33142]: I1204 00:56:13.567877 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:14.034594 master-0 kubenswrapper[33142]: I1204 00:56:14.034520 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:14.040299 master-0 kubenswrapper[33142]: W1204 00:56:14.040229 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4169a5_a2a7_41b3_adf1_8e48f843ef70.slice/crio-64f750b5e9a36c3680d4d41e5aace080c1b6abb64e95c238e435af36c2b3eb29 WatchSource:0}: Error finding container 64f750b5e9a36c3680d4d41e5aace080c1b6abb64e95c238e435af36c2b3eb29: Status 404 returned error can't find the container with id 64f750b5e9a36c3680d4d41e5aace080c1b6abb64e95c238e435af36c2b3eb29 Dec 04 00:56:14.208319 master-0 kubenswrapper[33142]: I1204 00:56:14.208262 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerStarted","Data":"36e760b854c841a0a09a5db08773886473c581563716c8285f67363baafcabb4"} Dec 04 00:56:14.208685 master-0 kubenswrapper[33142]: I1204 00:56:14.208332 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerStarted","Data":"64f750b5e9a36c3680d4d41e5aace080c1b6abb64e95c238e435af36c2b3eb29"} Dec 04 00:56:14.210042 master-0 kubenswrapper[33142]: I1204 00:56:14.210011 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" event={"ID":"f35e28e5-f865-426e-b4d3-bf8182c64b73","Type":"ContainerStarted","Data":"97a0f222983bfec5a3e113a7984f9d3396a46e3c8adcf8abfeeebc4b7d5901aa"} Dec 04 00:56:15.220784 master-0 kubenswrapper[33142]: I1204 00:56:15.220674 33142 generic.go:334] "Generic (PLEG): container finished" podID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerID="36e760b854c841a0a09a5db08773886473c581563716c8285f67363baafcabb4" exitCode=0 Dec 04 00:56:15.220784 master-0 kubenswrapper[33142]: I1204 00:56:15.220764 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerDied","Data":"36e760b854c841a0a09a5db08773886473c581563716c8285f67363baafcabb4"} Dec 04 00:56:16.075790 master-0 kubenswrapper[33142]: I1204 00:56:16.075621 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh"] Dec 04 00:56:16.078032 master-0 kubenswrapper[33142]: I1204 00:56:16.077954 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.079657 master-0 kubenswrapper[33142]: I1204 00:56:16.079626 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-dnqtf" Dec 04 00:56:16.097105 master-0 kubenswrapper[33142]: I1204 00:56:16.097050 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh"] Dec 04 00:56:16.139591 master-0 kubenswrapper[33142]: I1204 00:56:16.139500 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnrfm\" (UniqueName: \"kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.139591 master-0 kubenswrapper[33142]: I1204 00:56:16.139595 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.139915 master-0 kubenswrapper[33142]: I1204 00:56:16.139684 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.247915 master-0 kubenswrapper[33142]: I1204 00:56:16.247868 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nnrfm\" (UniqueName: \"kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.248392 master-0 kubenswrapper[33142]: I1204 00:56:16.248365 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.248513 master-0 kubenswrapper[33142]: I1204 00:56:16.248500 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.248955 master-0 kubenswrapper[33142]: I1204 00:56:16.248904 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerStarted","Data":"5bd6b5f1791179d95cf989c8a221c2a009711d8caf20e49704925ca1ec058342"} Dec 04 00:56:16.250088 master-0 kubenswrapper[33142]: I1204 00:56:16.249134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.250088 master-0 kubenswrapper[33142]: I1204 00:56:16.249134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.273048 master-0 kubenswrapper[33142]: I1204 00:56:16.272977 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnrfm\" (UniqueName: \"kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.403541 master-0 kubenswrapper[33142]: I1204 00:56:16.403440 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:16.838814 master-0 kubenswrapper[33142]: I1204 00:56:16.838745 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh"] Dec 04 00:56:17.260807 master-0 kubenswrapper[33142]: I1204 00:56:17.260742 33142 generic.go:334] "Generic (PLEG): container finished" podID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerID="5bd6b5f1791179d95cf989c8a221c2a009711d8caf20e49704925ca1ec058342" exitCode=0 Dec 04 00:56:17.261618 master-0 kubenswrapper[33142]: I1204 00:56:17.260850 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerDied","Data":"5bd6b5f1791179d95cf989c8a221c2a009711d8caf20e49704925ca1ec058342"} Dec 04 00:56:19.549806 master-0 kubenswrapper[33142]: I1204 00:56:19.548703 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:19.549806 master-0 kubenswrapper[33142]: I1204 00:56:19.548762 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:19.593920 master-0 kubenswrapper[33142]: I1204 00:56:19.593462 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:20.215006 master-0 kubenswrapper[33142]: W1204 00:56:20.214891 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e39409_6d0d_4df2_99c5_32439acfe8fd.slice/crio-a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98 WatchSource:0}: Error finding container a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98: Status 404 returned error can't find the container with id a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98 Dec 04 00:56:20.289693 master-0 kubenswrapper[33142]: I1204 00:56:20.289600 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" event={"ID":"28e39409-6d0d-4df2-99c5-32439acfe8fd","Type":"ContainerStarted","Data":"a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98"} Dec 04 00:56:20.338415 master-0 kubenswrapper[33142]: I1204 00:56:20.335844 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:21.300820 master-0 kubenswrapper[33142]: I1204 00:56:21.300734 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerStarted","Data":"7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c"} Dec 04 00:56:21.303869 master-0 kubenswrapper[33142]: I1204 00:56:21.303808 33142 generic.go:334] "Generic (PLEG): container finished" podID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerID="cf1261558ce97e90d16306f13a8913c129b039b428111cb28f6f5dfa2f45eb05" exitCode=0 Dec 04 00:56:21.303953 master-0 kubenswrapper[33142]: I1204 00:56:21.303893 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" event={"ID":"28e39409-6d0d-4df2-99c5-32439acfe8fd","Type":"ContainerDied","Data":"cf1261558ce97e90d16306f13a8913c129b039b428111cb28f6f5dfa2f45eb05"} Dec 04 00:56:21.305978 master-0 kubenswrapper[33142]: I1204 00:56:21.305934 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" event={"ID":"f35e28e5-f865-426e-b4d3-bf8182c64b73","Type":"ContainerStarted","Data":"45a18ee7e619e3d0190e3718940659a06d60fb974edf447b37314b80242d8156"} Dec 04 00:56:21.328750 master-0 kubenswrapper[33142]: I1204 00:56:21.328601 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-gssk8" podStartSLOduration=3.251614683 podStartE2EDuration="8.328570189s" podCreationTimestamp="2025-12-04 00:56:13 +0000 UTC" firstStartedPulling="2025-12-04 00:56:15.222287379 +0000 UTC m=+547.624289229" lastFinishedPulling="2025-12-04 00:56:20.299242885 +0000 UTC m=+552.701244735" observedRunningTime="2025-12-04 00:56:21.320948064 +0000 UTC m=+553.722949934" watchObservedRunningTime="2025-12-04 00:56:21.328570189 +0000 UTC m=+553.730572099" Dec 04 00:56:21.347173 master-0 kubenswrapper[33142]: I1204 00:56:21.346845 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-rnfvc" podStartSLOduration=2.543839891 podStartE2EDuration="9.346824556s" podCreationTimestamp="2025-12-04 00:56:12 +0000 UTC" firstStartedPulling="2025-12-04 00:56:13.522893094 +0000 UTC m=+545.924894944" lastFinishedPulling="2025-12-04 00:56:20.325877759 +0000 UTC m=+552.727879609" observedRunningTime="2025-12-04 00:56:21.344401177 +0000 UTC m=+553.746403117" watchObservedRunningTime="2025-12-04 00:56:21.346824556 +0000 UTC m=+553.748826406" Dec 04 00:56:23.333374 master-0 kubenswrapper[33142]: I1204 00:56:23.333307 33142 generic.go:334] "Generic (PLEG): container finished" podID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerID="7473ab8643e3c8aec0be2254432cd6c3431cf4e2dddebf7c1e9c0e04141a41d8" exitCode=0 Dec 04 00:56:23.333963 master-0 kubenswrapper[33142]: I1204 00:56:23.333363 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" event={"ID":"28e39409-6d0d-4df2-99c5-32439acfe8fd","Type":"ContainerDied","Data":"7473ab8643e3c8aec0be2254432cd6c3431cf4e2dddebf7c1e9c0e04141a41d8"} Dec 04 00:56:23.568957 master-0 kubenswrapper[33142]: I1204 00:56:23.568862 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:23.569253 master-0 kubenswrapper[33142]: I1204 00:56:23.568984 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:23.622481 master-0 kubenswrapper[33142]: I1204 00:56:23.622109 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:24.340857 master-0 kubenswrapper[33142]: I1204 00:56:24.340773 33142 generic.go:334] "Generic (PLEG): container finished" podID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerID="58cbc123bd90f22c2025a7a2952f52ec425f8fc88bac4dd8fc399f0fdb331b51" exitCode=0 Dec 04 00:56:24.342077 master-0 kubenswrapper[33142]: I1204 00:56:24.342013 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" event={"ID":"28e39409-6d0d-4df2-99c5-32439acfe8fd","Type":"ContainerDied","Data":"58cbc123bd90f22c2025a7a2952f52ec425f8fc88bac4dd8fc399f0fdb331b51"} Dec 04 00:56:25.661990 master-0 kubenswrapper[33142]: I1204 00:56:25.661918 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:25.718521 master-0 kubenswrapper[33142]: I1204 00:56:25.718378 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnrfm\" (UniqueName: \"kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm\") pod \"28e39409-6d0d-4df2-99c5-32439acfe8fd\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " Dec 04 00:56:25.718521 master-0 kubenswrapper[33142]: I1204 00:56:25.718499 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util\") pod \"28e39409-6d0d-4df2-99c5-32439acfe8fd\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " Dec 04 00:56:25.718785 master-0 kubenswrapper[33142]: I1204 00:56:25.718561 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle\") pod \"28e39409-6d0d-4df2-99c5-32439acfe8fd\" (UID: \"28e39409-6d0d-4df2-99c5-32439acfe8fd\") " Dec 04 00:56:25.721767 master-0 kubenswrapper[33142]: I1204 00:56:25.721694 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm" (OuterVolumeSpecName: "kube-api-access-nnrfm") pod "28e39409-6d0d-4df2-99c5-32439acfe8fd" (UID: "28e39409-6d0d-4df2-99c5-32439acfe8fd"). InnerVolumeSpecName "kube-api-access-nnrfm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:25.722501 master-0 kubenswrapper[33142]: I1204 00:56:25.722445 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle" (OuterVolumeSpecName: "bundle") pod "28e39409-6d0d-4df2-99c5-32439acfe8fd" (UID: "28e39409-6d0d-4df2-99c5-32439acfe8fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:25.821397 master-0 kubenswrapper[33142]: I1204 00:56:25.821297 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nnrfm\" (UniqueName: \"kubernetes.io/projected/28e39409-6d0d-4df2-99c5-32439acfe8fd-kube-api-access-nnrfm\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:25.821397 master-0 kubenswrapper[33142]: I1204 00:56:25.821366 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:26.164740 master-0 kubenswrapper[33142]: I1204 00:56:26.164595 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util" (OuterVolumeSpecName: "util") pod "28e39409-6d0d-4df2-99c5-32439acfe8fd" (UID: "28e39409-6d0d-4df2-99c5-32439acfe8fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:26.229516 master-0 kubenswrapper[33142]: I1204 00:56:26.229402 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e39409-6d0d-4df2-99c5-32439acfe8fd-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:26.382293 master-0 kubenswrapper[33142]: I1204 00:56:26.382185 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" event={"ID":"28e39409-6d0d-4df2-99c5-32439acfe8fd","Type":"ContainerDied","Data":"a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98"} Dec 04 00:56:26.382293 master-0 kubenswrapper[33142]: I1204 00:56:26.382283 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a66831ff2835864ca7db0042220481384e14b885116ceee0e11a21a375432b98" Dec 04 00:56:26.382691 master-0 kubenswrapper[33142]: I1204 00:56:26.382311 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c9210kk6nh" Dec 04 00:56:26.921030 master-0 kubenswrapper[33142]: I1204 00:56:26.920937 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:26.921563 master-0 kubenswrapper[33142]: I1204 00:56:26.921341 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-ghl5v" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="registry-server" containerID="cri-o://0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607" gracePeriod=2 Dec 04 00:56:27.680550 master-0 kubenswrapper[33142]: I1204 00:56:27.680474 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-vmjrs"] Dec 04 00:56:27.680953 master-0 kubenswrapper[33142]: E1204 00:56:27.680906 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="extract" Dec 04 00:56:27.680953 master-0 kubenswrapper[33142]: I1204 00:56:27.680951 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="extract" Dec 04 00:56:27.681081 master-0 kubenswrapper[33142]: E1204 00:56:27.680973 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="pull" Dec 04 00:56:27.681081 master-0 kubenswrapper[33142]: I1204 00:56:27.680983 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="pull" Dec 04 00:56:27.681081 master-0 kubenswrapper[33142]: E1204 00:56:27.681018 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="util" Dec 04 00:56:27.681081 master-0 kubenswrapper[33142]: I1204 00:56:27.681029 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="util" Dec 04 00:56:27.681254 master-0 kubenswrapper[33142]: I1204 00:56:27.681205 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="28e39409-6d0d-4df2-99c5-32439acfe8fd" containerName="extract" Dec 04 00:56:27.681899 master-0 kubenswrapper[33142]: I1204 00:56:27.681868 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:27.683737 master-0 kubenswrapper[33142]: W1204 00:56:27.683466 33142 reflector.go:561] object-"cert-manager"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:master-0" cannot list resource "configmaps" in API group "" in the namespace "cert-manager": no relationship found between node 'master-0' and this object Dec 04 00:56:27.683737 master-0 kubenswrapper[33142]: E1204 00:56:27.683519 33142 reflector.go:158] "Unhandled Error" err="object-\"cert-manager\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:master-0\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'master-0' and this object" logger="UnhandledError" Dec 04 00:56:27.683737 master-0 kubenswrapper[33142]: W1204 00:56:27.683635 33142 reflector.go:561] object-"cert-manager"/"openshift-service-ca.crt": failed to list *v1.ConfigMap: configmaps "openshift-service-ca.crt" is forbidden: User "system:node:master-0" cannot list resource "configmaps" in API group "" in the namespace "cert-manager": no relationship found between node 'master-0' and this object Dec 04 00:56:27.683737 master-0 kubenswrapper[33142]: E1204 00:56:27.683703 33142 reflector.go:158] "Unhandled Error" err="object-\"cert-manager\"/\"openshift-service-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:master-0\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'master-0' and this object" logger="UnhandledError" Dec 04 00:56:27.702529 master-0 kubenswrapper[33142]: I1204 00:56:27.702431 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-vmjrs"] Dec 04 00:56:27.762956 master-0 kubenswrapper[33142]: I1204 00:56:27.762749 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:27.762956 master-0 kubenswrapper[33142]: I1204 00:56:27.762829 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jp9\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-kube-api-access-n7jp9\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:27.868159 master-0 kubenswrapper[33142]: I1204 00:56:27.867538 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:27.868159 master-0 kubenswrapper[33142]: I1204 00:56:27.867628 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jp9\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-kube-api-access-n7jp9\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:27.917086 master-0 kubenswrapper[33142]: I1204 00:56:27.912328 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:28.208584 master-0 kubenswrapper[33142]: I1204 00:56:28.208369 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq"] Dec 04 00:56:28.215105 master-0 kubenswrapper[33142]: I1204 00:56:28.209393 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" Dec 04 00:56:28.215105 master-0 kubenswrapper[33142]: I1204 00:56:28.211371 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"openshift-service-ca.crt" Dec 04 00:56:28.215105 master-0 kubenswrapper[33142]: I1204 00:56:28.213142 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"kube-root-ca.crt" Dec 04 00:56:28.234952 master-0 kubenswrapper[33142]: I1204 00:56:28.226081 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq"] Dec 04 00:56:28.287989 master-0 kubenswrapper[33142]: I1204 00:56:28.287404 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l492\" (UniqueName: \"kubernetes.io/projected/867be82d-8a79-43ca-a1e8-b5b2dfba2952-kube-api-access-9l492\") pod \"nmstate-operator-5b5b58f5c8-bfvsq\" (UID: \"867be82d-8a79-43ca-a1e8-b5b2dfba2952\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" Dec 04 00:56:28.332784 master-0 kubenswrapper[33142]: I1204 00:56:28.331827 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:28.393746 master-0 kubenswrapper[33142]: I1204 00:56:28.389229 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities\") pod \"b7e87f2d-8675-430b-9279-c37d6c2a627c\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " Dec 04 00:56:28.393746 master-0 kubenswrapper[33142]: I1204 00:56:28.389390 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr4jn\" (UniqueName: \"kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn\") pod \"b7e87f2d-8675-430b-9279-c37d6c2a627c\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " Dec 04 00:56:28.393746 master-0 kubenswrapper[33142]: I1204 00:56:28.389440 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content\") pod \"b7e87f2d-8675-430b-9279-c37d6c2a627c\" (UID: \"b7e87f2d-8675-430b-9279-c37d6c2a627c\") " Dec 04 00:56:28.393746 master-0 kubenswrapper[33142]: I1204 00:56:28.389762 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9l492\" (UniqueName: \"kubernetes.io/projected/867be82d-8a79-43ca-a1e8-b5b2dfba2952-kube-api-access-9l492\") pod \"nmstate-operator-5b5b58f5c8-bfvsq\" (UID: \"867be82d-8a79-43ca-a1e8-b5b2dfba2952\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" Dec 04 00:56:28.393746 master-0 kubenswrapper[33142]: I1204 00:56:28.391386 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities" (OuterVolumeSpecName: "utilities") pod "b7e87f2d-8675-430b-9279-c37d6c2a627c" (UID: "b7e87f2d-8675-430b-9279-c37d6c2a627c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:28.397289 master-0 kubenswrapper[33142]: I1204 00:56:28.397186 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn" (OuterVolumeSpecName: "kube-api-access-nr4jn") pod "b7e87f2d-8675-430b-9279-c37d6c2a627c" (UID: "b7e87f2d-8675-430b-9279-c37d6c2a627c"). InnerVolumeSpecName "kube-api-access-nr4jn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:28.406875 master-0 kubenswrapper[33142]: I1204 00:56:28.406810 33142 generic.go:334] "Generic (PLEG): container finished" podID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerID="0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607" exitCode=0 Dec 04 00:56:28.406875 master-0 kubenswrapper[33142]: I1204 00:56:28.406861 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerDied","Data":"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607"} Dec 04 00:56:28.407195 master-0 kubenswrapper[33142]: I1204 00:56:28.406892 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ghl5v" event={"ID":"b7e87f2d-8675-430b-9279-c37d6c2a627c","Type":"ContainerDied","Data":"8c46af993ef9ec838169007b5fe2999a9dc77b8a0a1237ba3c27310a4e491987"} Dec 04 00:56:28.407195 master-0 kubenswrapper[33142]: I1204 00:56:28.406913 33142 scope.go:117] "RemoveContainer" containerID="0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607" Dec 04 00:56:28.407195 master-0 kubenswrapper[33142]: I1204 00:56:28.407040 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ghl5v" Dec 04 00:56:28.425093 master-0 kubenswrapper[33142]: I1204 00:56:28.425035 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b7e87f2d-8675-430b-9279-c37d6c2a627c" (UID: "b7e87f2d-8675-430b-9279-c37d6c2a627c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:28.428041 master-0 kubenswrapper[33142]: I1204 00:56:28.427868 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l492\" (UniqueName: \"kubernetes.io/projected/867be82d-8a79-43ca-a1e8-b5b2dfba2952-kube-api-access-9l492\") pod \"nmstate-operator-5b5b58f5c8-bfvsq\" (UID: \"867be82d-8a79-43ca-a1e8-b5b2dfba2952\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" Dec 04 00:56:28.468840 master-0 kubenswrapper[33142]: I1204 00:56:28.468608 33142 scope.go:117] "RemoveContainer" containerID="e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e" Dec 04 00:56:28.492161 master-0 kubenswrapper[33142]: I1204 00:56:28.490168 33142 scope.go:117] "RemoveContainer" containerID="e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274" Dec 04 00:56:28.492161 master-0 kubenswrapper[33142]: I1204 00:56:28.491520 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:28.492161 master-0 kubenswrapper[33142]: I1204 00:56:28.491543 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nr4jn\" (UniqueName: \"kubernetes.io/projected/b7e87f2d-8675-430b-9279-c37d6c2a627c-kube-api-access-nr4jn\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:28.492161 master-0 kubenswrapper[33142]: I1204 00:56:28.491576 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7e87f2d-8675-430b-9279-c37d6c2a627c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:28.526872 master-0 kubenswrapper[33142]: I1204 00:56:28.526254 33142 scope.go:117] "RemoveContainer" containerID="0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607" Dec 04 00:56:28.528162 master-0 kubenswrapper[33142]: E1204 00:56:28.527173 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607\": container with ID starting with 0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607 not found: ID does not exist" containerID="0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607" Dec 04 00:56:28.528162 master-0 kubenswrapper[33142]: I1204 00:56:28.527215 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607"} err="failed to get container status \"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607\": rpc error: code = NotFound desc = could not find container \"0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607\": container with ID starting with 0aee43787b1b8788aad0c86a90d521e5619d0f3f074d7366e02c0513a8c72607 not found: ID does not exist" Dec 04 00:56:28.528162 master-0 kubenswrapper[33142]: I1204 00:56:28.527241 33142 scope.go:117] "RemoveContainer" containerID="e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e" Dec 04 00:56:28.528162 master-0 kubenswrapper[33142]: E1204 00:56:28.528137 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e\": container with ID starting with e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e not found: ID does not exist" containerID="e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e" Dec 04 00:56:28.528339 master-0 kubenswrapper[33142]: I1204 00:56:28.528186 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e"} err="failed to get container status \"e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e\": rpc error: code = NotFound desc = could not find container \"e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e\": container with ID starting with e75aa678c2bbe96a743e48abdf4fabfbdcfe64909677770a48c495876baab00e not found: ID does not exist" Dec 04 00:56:28.528339 master-0 kubenswrapper[33142]: I1204 00:56:28.528219 33142 scope.go:117] "RemoveContainer" containerID="e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274" Dec 04 00:56:28.528660 master-0 kubenswrapper[33142]: E1204 00:56:28.528627 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274\": container with ID starting with e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274 not found: ID does not exist" containerID="e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274" Dec 04 00:56:28.528660 master-0 kubenswrapper[33142]: I1204 00:56:28.528654 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274"} err="failed to get container status \"e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274\": rpc error: code = NotFound desc = could not find container \"e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274\": container with ID starting with e96da356849e0ee7a68fb2beadb3b7605eb9a895e6d4d72aaa8813fac5df4274 not found: ID does not exist" Dec 04 00:56:28.538054 master-0 kubenswrapper[33142]: I1204 00:56:28.538002 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"kube-root-ca.crt" Dec 04 00:56:28.556385 master-0 kubenswrapper[33142]: I1204 00:56:28.556321 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" Dec 04 00:56:28.793649 master-0 kubenswrapper[33142]: I1204 00:56:28.793564 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:28.822469 master-0 kubenswrapper[33142]: I1204 00:56:28.817914 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-ghl5v"] Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: I1204 00:56:28.823771 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-994774496-r7lg7"] Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: E1204 00:56:28.824158 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="extract-utilities" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: I1204 00:56:28.824178 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="extract-utilities" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: E1204 00:56:28.824210 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="registry-server" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: I1204 00:56:28.824219 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="registry-server" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: E1204 00:56:28.824276 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="extract-content" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: I1204 00:56:28.824287 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="extract-content" Dec 04 00:56:28.824595 master-0 kubenswrapper[33142]: I1204 00:56:28.824517 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" containerName="registry-server" Dec 04 00:56:28.825191 master-0 kubenswrapper[33142]: I1204 00:56:28.825163 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:28.832610 master-0 kubenswrapper[33142]: I1204 00:56:28.830683 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"kube-root-ca.crt" Dec 04 00:56:28.832610 master-0 kubenswrapper[33142]: I1204 00:56:28.830877 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"openshift-service-ca.crt" Dec 04 00:56:28.832610 master-0 kubenswrapper[33142]: I1204 00:56:28.830894 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-controller-manager-service-cert" Dec 04 00:56:28.832610 master-0 kubenswrapper[33142]: I1204 00:56:28.830907 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-994774496-r7lg7"] Dec 04 00:56:28.832610 master-0 kubenswrapper[33142]: I1204 00:56:28.832266 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-cert" Dec 04 00:56:28.926030 master-0 kubenswrapper[33142]: I1204 00:56:28.925921 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-apiservice-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:28.926295 master-0 kubenswrapper[33142]: I1204 00:56:28.926087 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-webhook-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:28.926295 master-0 kubenswrapper[33142]: I1204 00:56:28.926133 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwbf8\" (UniqueName: \"kubernetes.io/projected/41f42803-7859-4025-b301-a5e216834d33-kube-api-access-xwbf8\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.034046 master-0 kubenswrapper[33142]: I1204 00:56:29.031741 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-apiservice-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.034046 master-0 kubenswrapper[33142]: I1204 00:56:29.031878 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-webhook-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.034046 master-0 kubenswrapper[33142]: I1204 00:56:29.031920 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xwbf8\" (UniqueName: \"kubernetes.io/projected/41f42803-7859-4025-b301-a5e216834d33-kube-api-access-xwbf8\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.058152 master-0 kubenswrapper[33142]: I1204 00:56:29.058089 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-apiservice-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.058689 master-0 kubenswrapper[33142]: I1204 00:56:29.058670 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41f42803-7859-4025-b301-a5e216834d33-webhook-cert\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.092155 master-0 kubenswrapper[33142]: I1204 00:56:29.083167 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwbf8\" (UniqueName: \"kubernetes.io/projected/41f42803-7859-4025-b301-a5e216834d33-kube-api-access-xwbf8\") pod \"metallb-operator-controller-manager-994774496-r7lg7\" (UID: \"41f42803-7859-4025-b301-a5e216834d33\") " pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.092155 master-0 kubenswrapper[33142]: I1204 00:56:29.086295 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq"] Dec 04 00:56:29.095213 master-0 kubenswrapper[33142]: W1204 00:56:29.095159 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867be82d_8a79_43ca_a1e8_b5b2dfba2952.slice/crio-150dafbcc54840c88ef5a6f7429c1c963b72391b436964bd8db5c4d20806a8d2 WatchSource:0}: Error finding container 150dafbcc54840c88ef5a6f7429c1c963b72391b436964bd8db5c4d20806a8d2: Status 404 returned error can't find the container with id 150dafbcc54840c88ef5a6f7429c1c963b72391b436964bd8db5c4d20806a8d2 Dec 04 00:56:29.144842 master-0 kubenswrapper[33142]: I1204 00:56:29.144767 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:29.159660 master-0 kubenswrapper[33142]: I1204 00:56:29.159613 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"openshift-service-ca.crt" Dec 04 00:56:29.167598 master-0 kubenswrapper[33142]: I1204 00:56:29.167535 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jp9\" (UniqueName: \"kubernetes.io/projected/cd7b0148-f1f0-4e1b-95dc-11c50f193e88-kube-api-access-n7jp9\") pod \"cert-manager-webhook-f4fb5df64-vmjrs\" (UID: \"cd7b0148-f1f0-4e1b-95dc-11c50f193e88\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:29.202287 master-0 kubenswrapper[33142]: I1204 00:56:29.198062 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:29.229316 master-0 kubenswrapper[33142]: I1204 00:56:29.225165 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-589d959c4f-w2496"] Dec 04 00:56:29.229316 master-0 kubenswrapper[33142]: I1204 00:56:29.228897 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.238623 master-0 kubenswrapper[33142]: I1204 00:56:29.238543 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-service-cert" Dec 04 00:56:29.238879 master-0 kubenswrapper[33142]: I1204 00:56:29.238795 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Dec 04 00:56:29.242573 master-0 kubenswrapper[33142]: I1204 00:56:29.241771 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-589d959c4f-w2496"] Dec 04 00:56:29.340545 master-0 kubenswrapper[33142]: I1204 00:56:29.340479 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftgb\" (UniqueName: \"kubernetes.io/projected/c32dfa8e-1fab-4316-ad2b-67234c573777-kube-api-access-rftgb\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.340662 master-0 kubenswrapper[33142]: I1204 00:56:29.340553 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-webhook-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.340662 master-0 kubenswrapper[33142]: I1204 00:56:29.340586 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-apiservice-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.417059 master-0 kubenswrapper[33142]: I1204 00:56:29.416980 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" event={"ID":"867be82d-8a79-43ca-a1e8-b5b2dfba2952","Type":"ContainerStarted","Data":"150dafbcc54840c88ef5a6f7429c1c963b72391b436964bd8db5c4d20806a8d2"} Dec 04 00:56:29.442410 master-0 kubenswrapper[33142]: I1204 00:56:29.442336 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rftgb\" (UniqueName: \"kubernetes.io/projected/c32dfa8e-1fab-4316-ad2b-67234c573777-kube-api-access-rftgb\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.442410 master-0 kubenswrapper[33142]: I1204 00:56:29.442400 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-webhook-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.442410 master-0 kubenswrapper[33142]: I1204 00:56:29.442422 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-apiservice-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.451495 master-0 kubenswrapper[33142]: I1204 00:56:29.447402 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-apiservice-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.451495 master-0 kubenswrapper[33142]: I1204 00:56:29.450359 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c32dfa8e-1fab-4316-ad2b-67234c573777-webhook-cert\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.461080 master-0 kubenswrapper[33142]: I1204 00:56:29.461020 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftgb\" (UniqueName: \"kubernetes.io/projected/c32dfa8e-1fab-4316-ad2b-67234c573777-kube-api-access-rftgb\") pod \"metallb-operator-webhook-server-589d959c4f-w2496\" (UID: \"c32dfa8e-1fab-4316-ad2b-67234c573777\") " pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.579447 master-0 kubenswrapper[33142]: I1204 00:56:29.579377 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-vmjrs"] Dec 04 00:56:29.580739 master-0 kubenswrapper[33142]: W1204 00:56:29.580680 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd7b0148_f1f0_4e1b_95dc_11c50f193e88.slice/crio-04ba9e5e06ea543168c794ec2be5bc5dd79d1787270c6b0c0aaf89d6d2939361 WatchSource:0}: Error finding container 04ba9e5e06ea543168c794ec2be5bc5dd79d1787270c6b0c0aaf89d6d2939361: Status 404 returned error can't find the container with id 04ba9e5e06ea543168c794ec2be5bc5dd79d1787270c6b0c0aaf89d6d2939361 Dec 04 00:56:29.582751 master-0 kubenswrapper[33142]: I1204 00:56:29.582726 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:29.642822 master-0 kubenswrapper[33142]: I1204 00:56:29.641278 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-994774496-r7lg7"] Dec 04 00:56:29.658364 master-0 kubenswrapper[33142]: W1204 00:56:29.658283 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f42803_7859_4025_b301_a5e216834d33.slice/crio-7df744b106d264cf8ba5a408b088036b37d9902051f33406c522f6edf7cc4b68 WatchSource:0}: Error finding container 7df744b106d264cf8ba5a408b088036b37d9902051f33406c522f6edf7cc4b68: Status 404 returned error can't find the container with id 7df744b106d264cf8ba5a408b088036b37d9902051f33406c522f6edf7cc4b68 Dec 04 00:56:29.906888 master-0 kubenswrapper[33142]: I1204 00:56:29.906789 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7e87f2d-8675-430b-9279-c37d6c2a627c" path="/var/lib/kubelet/pods/b7e87f2d-8675-430b-9279-c37d6c2a627c/volumes" Dec 04 00:56:30.036640 master-0 kubenswrapper[33142]: I1204 00:56:30.036564 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-589d959c4f-w2496"] Dec 04 00:56:30.050072 master-0 kubenswrapper[33142]: W1204 00:56:30.048831 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc32dfa8e_1fab_4316_ad2b_67234c573777.slice/crio-a82ec1616438cdb093f64793d7df939ab26c45dda4f5bc126fc1b1088c2957f3 WatchSource:0}: Error finding container a82ec1616438cdb093f64793d7df939ab26c45dda4f5bc126fc1b1088c2957f3: Status 404 returned error can't find the container with id a82ec1616438cdb093f64793d7df939ab26c45dda4f5bc126fc1b1088c2957f3 Dec 04 00:56:30.436144 master-0 kubenswrapper[33142]: I1204 00:56:30.436036 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" event={"ID":"cd7b0148-f1f0-4e1b-95dc-11c50f193e88","Type":"ContainerStarted","Data":"04ba9e5e06ea543168c794ec2be5bc5dd79d1787270c6b0c0aaf89d6d2939361"} Dec 04 00:56:30.437717 master-0 kubenswrapper[33142]: I1204 00:56:30.437458 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" event={"ID":"c32dfa8e-1fab-4316-ad2b-67234c573777","Type":"ContainerStarted","Data":"a82ec1616438cdb093f64793d7df939ab26c45dda4f5bc126fc1b1088c2957f3"} Dec 04 00:56:30.440104 master-0 kubenswrapper[33142]: I1204 00:56:30.440072 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" event={"ID":"41f42803-7859-4025-b301-a5e216834d33","Type":"ContainerStarted","Data":"7df744b106d264cf8ba5a408b088036b37d9902051f33406c522f6edf7cc4b68"} Dec 04 00:56:32.463616 master-0 kubenswrapper[33142]: I1204 00:56:32.462107 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" event={"ID":"867be82d-8a79-43ca-a1e8-b5b2dfba2952","Type":"ContainerStarted","Data":"587dc07c9456bf757c27ac237851fd2204c21f2c3f6076d06861fee3fa270328"} Dec 04 00:56:32.523001 master-0 kubenswrapper[33142]: I1204 00:56:32.521976 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-bfvsq" podStartSLOduration=1.72990741 podStartE2EDuration="4.521939122s" podCreationTimestamp="2025-12-04 00:56:28 +0000 UTC" firstStartedPulling="2025-12-04 00:56:29.099329697 +0000 UTC m=+561.501331547" lastFinishedPulling="2025-12-04 00:56:31.891361409 +0000 UTC m=+564.293363259" observedRunningTime="2025-12-04 00:56:32.51658881 +0000 UTC m=+564.918590670" watchObservedRunningTime="2025-12-04 00:56:32.521939122 +0000 UTC m=+564.923940982" Dec 04 00:56:32.739036 master-0 kubenswrapper[33142]: I1204 00:56:32.738059 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-zlccx"] Dec 04 00:56:32.743979 master-0 kubenswrapper[33142]: I1204 00:56:32.739542 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.772384 master-0 kubenswrapper[33142]: I1204 00:56:32.771764 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-86cb77c54b-mqgpk"] Dec 04 00:56:32.773809 master-0 kubenswrapper[33142]: I1204 00:56:32.773779 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:32.781304 master-0 kubenswrapper[33142]: I1204 00:56:32.781233 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-mqgpk"] Dec 04 00:56:32.802392 master-0 kubenswrapper[33142]: I1204 00:56:32.800344 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-zlccx"] Dec 04 00:56:32.835981 master-0 kubenswrapper[33142]: I1204 00:56:32.835822 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5sm\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-kube-api-access-qt5sm\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:32.836638 master-0 kubenswrapper[33142]: I1204 00:56:32.836324 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnns4\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-kube-api-access-tnns4\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.836638 master-0 kubenswrapper[33142]: I1204 00:56:32.836380 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-bound-sa-token\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:32.836638 master-0 kubenswrapper[33142]: I1204 00:56:32.836516 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.942955 master-0 kubenswrapper[33142]: I1204 00:56:32.941160 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-bound-sa-token\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:32.942955 master-0 kubenswrapper[33142]: I1204 00:56:32.941276 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.942955 master-0 kubenswrapper[33142]: I1204 00:56:32.941330 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5sm\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-kube-api-access-qt5sm\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:32.942955 master-0 kubenswrapper[33142]: I1204 00:56:32.941387 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tnns4\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-kube-api-access-tnns4\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.994685 master-0 kubenswrapper[33142]: I1204 00:56:32.993361 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.994685 master-0 kubenswrapper[33142]: I1204 00:56:32.994577 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnns4\" (UniqueName: \"kubernetes.io/projected/1f6bcef3-5344-4cd0-a820-6465e29d12af-kube-api-access-tnns4\") pod \"cert-manager-cainjector-855d9ccff4-zlccx\" (UID: \"1f6bcef3-5344-4cd0-a820-6465e29d12af\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:32.995345 master-0 kubenswrapper[33142]: I1204 00:56:32.995302 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-bound-sa-token\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:33.010971 master-0 kubenswrapper[33142]: I1204 00:56:33.010280 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5sm\" (UniqueName: \"kubernetes.io/projected/1717faf9-8e67-4be5-8fd9-6f167d447a36-kube-api-access-qt5sm\") pod \"cert-manager-86cb77c54b-mqgpk\" (UID: \"1717faf9-8e67-4be5-8fd9-6f167d447a36\") " pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:33.119959 master-0 kubenswrapper[33142]: I1204 00:56:33.119743 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" Dec 04 00:56:33.151962 master-0 kubenswrapper[33142]: I1204 00:56:33.149763 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-mqgpk" Dec 04 00:56:33.649493 master-0 kubenswrapper[33142]: I1204 00:56:33.647699 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:33.798645 master-0 kubenswrapper[33142]: I1204 00:56:33.798583 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-zlccx"] Dec 04 00:56:33.963133 master-0 kubenswrapper[33142]: I1204 00:56:33.963076 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-mqgpk"] Dec 04 00:56:34.549959 master-0 kubenswrapper[33142]: I1204 00:56:34.545497 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" event={"ID":"1f6bcef3-5344-4cd0-a820-6465e29d12af","Type":"ContainerStarted","Data":"c879c9d003ba3ea4c193a73035f222d48290652387f8fe8ea5e29355f68a5c3f"} Dec 04 00:56:36.920469 master-0 kubenswrapper[33142]: W1204 00:56:36.920325 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1717faf9_8e67_4be5_8fd9_6f167d447a36.slice/crio-cad6c68075a6f6ad7a7058cc88faeb5069e0790b90450f84bc0a57a9464c116c WatchSource:0}: Error finding container cad6c68075a6f6ad7a7058cc88faeb5069e0790b90450f84bc0a57a9464c116c: Status 404 returned error can't find the container with id cad6c68075a6f6ad7a7058cc88faeb5069e0790b90450f84bc0a57a9464c116c Dec 04 00:56:37.197196 master-0 kubenswrapper[33142]: I1204 00:56:37.197059 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:37.197428 master-0 kubenswrapper[33142]: I1204 00:56:37.197336 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-gssk8" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="registry-server" containerID="cri-o://7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" gracePeriod=2 Dec 04 00:56:37.594425 master-0 kubenswrapper[33142]: I1204 00:56:37.594304 33142 generic.go:334] "Generic (PLEG): container finished" podID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerID="7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" exitCode=0 Dec 04 00:56:37.594731 master-0 kubenswrapper[33142]: I1204 00:56:37.594405 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerDied","Data":"7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c"} Dec 04 00:56:37.597885 master-0 kubenswrapper[33142]: I1204 00:56:37.597840 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-mqgpk" event={"ID":"1717faf9-8e67-4be5-8fd9-6f167d447a36","Type":"ContainerStarted","Data":"cad6c68075a6f6ad7a7058cc88faeb5069e0790b90450f84bc0a57a9464c116c"} Dec 04 00:56:37.600247 master-0 kubenswrapper[33142]: I1204 00:56:37.600213 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" event={"ID":"41f42803-7859-4025-b301-a5e216834d33","Type":"ContainerStarted","Data":"9bc54390c993055cd128b576dd7ee3440fcd1e3949f5309f077c761dea6e2462"} Dec 04 00:56:37.600458 master-0 kubenswrapper[33142]: I1204 00:56:37.600435 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:56:37.631266 master-0 kubenswrapper[33142]: I1204 00:56:37.631176 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" podStartSLOduration=2.277101114 podStartE2EDuration="9.63115386s" podCreationTimestamp="2025-12-04 00:56:28 +0000 UTC" firstStartedPulling="2025-12-04 00:56:29.66239746 +0000 UTC m=+562.064399320" lastFinishedPulling="2025-12-04 00:56:37.016450216 +0000 UTC m=+569.418452066" observedRunningTime="2025-12-04 00:56:37.624746119 +0000 UTC m=+570.026747979" watchObservedRunningTime="2025-12-04 00:56:37.63115386 +0000 UTC m=+570.033155710" Dec 04 00:56:41.826888 master-0 kubenswrapper[33142]: I1204 00:56:41.824171 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv"] Dec 04 00:56:41.826888 master-0 kubenswrapper[33142]: I1204 00:56:41.825836 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" Dec 04 00:56:41.829412 master-0 kubenswrapper[33142]: I1204 00:56:41.829340 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"kube-root-ca.crt" Dec 04 00:56:41.829628 master-0 kubenswrapper[33142]: I1204 00:56:41.829354 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"openshift-service-ca.crt" Dec 04 00:56:41.850312 master-0 kubenswrapper[33142]: I1204 00:56:41.850208 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv"] Dec 04 00:56:41.883054 master-0 kubenswrapper[33142]: I1204 00:56:41.882470 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6mm\" (UniqueName: \"kubernetes.io/projected/a073d832-065f-4366-b169-18f8335dd1aa-kube-api-access-fp6mm\") pod \"obo-prometheus-operator-668cf9dfbb-nq7sv\" (UID: \"a073d832-065f-4366-b169-18f8335dd1aa\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" Dec 04 00:56:41.955193 master-0 kubenswrapper[33142]: I1204 00:56:41.955091 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd"] Dec 04 00:56:41.956599 master-0 kubenswrapper[33142]: I1204 00:56:41.956572 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:41.960547 master-0 kubenswrapper[33142]: I1204 00:56:41.960503 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-service-cert" Dec 04 00:56:41.981108 master-0 kubenswrapper[33142]: I1204 00:56:41.981025 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr"] Dec 04 00:56:41.982377 master-0 kubenswrapper[33142]: I1204 00:56:41.982335 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:41.983954 master-0 kubenswrapper[33142]: I1204 00:56:41.983828 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6mm\" (UniqueName: \"kubernetes.io/projected/a073d832-065f-4366-b169-18f8335dd1aa-kube-api-access-fp6mm\") pod \"obo-prometheus-operator-668cf9dfbb-nq7sv\" (UID: \"a073d832-065f-4366-b169-18f8335dd1aa\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" Dec 04 00:56:41.990815 master-0 kubenswrapper[33142]: I1204 00:56:41.990751 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd"] Dec 04 00:56:42.001374 master-0 kubenswrapper[33142]: I1204 00:56:42.001305 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr"] Dec 04 00:56:42.033451 master-0 kubenswrapper[33142]: I1204 00:56:42.033378 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6mm\" (UniqueName: \"kubernetes.io/projected/a073d832-065f-4366-b169-18f8335dd1aa-kube-api-access-fp6mm\") pod \"obo-prometheus-operator-668cf9dfbb-nq7sv\" (UID: \"a073d832-065f-4366-b169-18f8335dd1aa\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" Dec 04 00:56:42.086802 master-0 kubenswrapper[33142]: I1204 00:56:42.086651 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.086802 master-0 kubenswrapper[33142]: I1204 00:56:42.086729 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.087106 master-0 kubenswrapper[33142]: I1204 00:56:42.086875 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.087106 master-0 kubenswrapper[33142]: I1204 00:56:42.086902 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.147683 master-0 kubenswrapper[33142]: I1204 00:56:42.147591 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-rxq5m"] Dec 04 00:56:42.148645 master-0 kubenswrapper[33142]: I1204 00:56:42.148610 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.150620 master-0 kubenswrapper[33142]: I1204 00:56:42.150581 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-tls" Dec 04 00:56:42.151217 master-0 kubenswrapper[33142]: I1204 00:56:42.151184 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" Dec 04 00:56:42.196956 master-0 kubenswrapper[33142]: I1204 00:56:42.196206 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.196956 master-0 kubenswrapper[33142]: I1204 00:56:42.196262 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.197286 master-0 kubenswrapper[33142]: I1204 00:56:42.197087 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-rxq5m"] Dec 04 00:56:42.197286 master-0 kubenswrapper[33142]: I1204 00:56:42.197115 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twf8x\" (UniqueName: \"kubernetes.io/projected/9e405b9d-3382-43d3-af12-1d9744df1b15-kube-api-access-twf8x\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.197379 master-0 kubenswrapper[33142]: I1204 00:56:42.197314 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e405b9d-3382-43d3-af12-1d9744df1b15-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.197428 master-0 kubenswrapper[33142]: I1204 00:56:42.197388 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.197428 master-0 kubenswrapper[33142]: I1204 00:56:42.197415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.203609 master-0 kubenswrapper[33142]: I1204 00:56:42.201056 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.203609 master-0 kubenswrapper[33142]: I1204 00:56:42.201746 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.203609 master-0 kubenswrapper[33142]: I1204 00:56:42.202032 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7446cc2-57c4-4df8-b0f5-bf218d2f0dca-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd\" (UID: \"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.203609 master-0 kubenswrapper[33142]: I1204 00:56:42.202078 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba4130f4-7c15-4a34-88b3-ecbba6134f8a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr\" (UID: \"ba4130f4-7c15-4a34-88b3-ecbba6134f8a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.300695 master-0 kubenswrapper[33142]: I1204 00:56:42.288835 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" Dec 04 00:56:42.300695 master-0 kubenswrapper[33142]: I1204 00:56:42.299047 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e405b9d-3382-43d3-af12-1d9744df1b15-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.300695 master-0 kubenswrapper[33142]: I1204 00:56:42.299200 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-twf8x\" (UniqueName: \"kubernetes.io/projected/9e405b9d-3382-43d3-af12-1d9744df1b15-kube-api-access-twf8x\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.302583 master-0 kubenswrapper[33142]: I1204 00:56:42.302507 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e405b9d-3382-43d3-af12-1d9744df1b15-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.329955 master-0 kubenswrapper[33142]: I1204 00:56:42.327453 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" Dec 04 00:56:42.333665 master-0 kubenswrapper[33142]: I1204 00:56:42.333412 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-twf8x\" (UniqueName: \"kubernetes.io/projected/9e405b9d-3382-43d3-af12-1d9744df1b15-kube-api-access-twf8x\") pod \"observability-operator-d8bb48f5d-rxq5m\" (UID: \"9e405b9d-3382-43d3-af12-1d9744df1b15\") " pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.339299 master-0 kubenswrapper[33142]: I1204 00:56:42.339158 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-5446b9c989-5tt2c"] Dec 04 00:56:42.340302 master-0 kubenswrapper[33142]: I1204 00:56:42.340263 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.405251 master-0 kubenswrapper[33142]: I1204 00:56:42.405187 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e0aac44-f559-48f5-9157-cb619918e74c-openshift-service-ca\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.405509 master-0 kubenswrapper[33142]: I1204 00:56:42.405308 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrp2g\" (UniqueName: \"kubernetes.io/projected/6e0aac44-f559-48f5-9157-cb619918e74c-kube-api-access-vrp2g\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.410678 master-0 kubenswrapper[33142]: I1204 00:56:42.410598 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-5tt2c"] Dec 04 00:56:42.505535 master-0 kubenswrapper[33142]: I1204 00:56:42.505472 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:42.508661 master-0 kubenswrapper[33142]: I1204 00:56:42.508615 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vrp2g\" (UniqueName: \"kubernetes.io/projected/6e0aac44-f559-48f5-9157-cb619918e74c-kube-api-access-vrp2g\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.508804 master-0 kubenswrapper[33142]: I1204 00:56:42.508781 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e0aac44-f559-48f5-9157-cb619918e74c-openshift-service-ca\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.509781 master-0 kubenswrapper[33142]: I1204 00:56:42.509756 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e0aac44-f559-48f5-9157-cb619918e74c-openshift-service-ca\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.535741 master-0 kubenswrapper[33142]: I1204 00:56:42.535686 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrp2g\" (UniqueName: \"kubernetes.io/projected/6e0aac44-f559-48f5-9157-cb619918e74c-kube-api-access-vrp2g\") pod \"perses-operator-5446b9c989-5tt2c\" (UID: \"6e0aac44-f559-48f5-9157-cb619918e74c\") " pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:42.724954 master-0 kubenswrapper[33142]: I1204 00:56:42.724304 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:43.572041 master-0 kubenswrapper[33142]: E1204 00:56:43.571915 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c is running failed: container process not found" containerID="7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" cmd=["grpc_health_probe","-addr=:50051"] Dec 04 00:56:43.575942 master-0 kubenswrapper[33142]: E1204 00:56:43.572755 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c is running failed: container process not found" containerID="7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" cmd=["grpc_health_probe","-addr=:50051"] Dec 04 00:56:43.575942 master-0 kubenswrapper[33142]: E1204 00:56:43.573244 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c is running failed: container process not found" containerID="7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" cmd=["grpc_health_probe","-addr=:50051"] Dec 04 00:56:43.575942 master-0 kubenswrapper[33142]: E1204 00:56:43.573280 33142 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-gssk8" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="registry-server" Dec 04 00:56:46.395611 master-0 kubenswrapper[33142]: I1204 00:56:46.394529 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:46.443796 master-0 kubenswrapper[33142]: I1204 00:56:46.443734 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities\") pod \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " Dec 04 00:56:46.444059 master-0 kubenswrapper[33142]: I1204 00:56:46.443993 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content\") pod \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " Dec 04 00:56:46.444126 master-0 kubenswrapper[33142]: I1204 00:56:46.444091 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsjh6\" (UniqueName: \"kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6\") pod \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\" (UID: \"ef4169a5-a2a7-41b3-adf1-8e48f843ef70\") " Dec 04 00:56:46.444561 master-0 kubenswrapper[33142]: I1204 00:56:46.444505 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities" (OuterVolumeSpecName: "utilities") pod "ef4169a5-a2a7-41b3-adf1-8e48f843ef70" (UID: "ef4169a5-a2a7-41b3-adf1-8e48f843ef70"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:46.452668 master-0 kubenswrapper[33142]: I1204 00:56:46.452596 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6" (OuterVolumeSpecName: "kube-api-access-tsjh6") pod "ef4169a5-a2a7-41b3-adf1-8e48f843ef70" (UID: "ef4169a5-a2a7-41b3-adf1-8e48f843ef70"). InnerVolumeSpecName "kube-api-access-tsjh6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:56:46.498308 master-0 kubenswrapper[33142]: I1204 00:56:46.496445 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ef4169a5-a2a7-41b3-adf1-8e48f843ef70" (UID: "ef4169a5-a2a7-41b3-adf1-8e48f843ef70"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:56:46.545566 master-0 kubenswrapper[33142]: I1204 00:56:46.545432 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tsjh6\" (UniqueName: \"kubernetes.io/projected/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-kube-api-access-tsjh6\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:46.545566 master-0 kubenswrapper[33142]: I1204 00:56:46.545507 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:46.545566 master-0 kubenswrapper[33142]: I1204 00:56:46.545518 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ef4169a5-a2a7-41b3-adf1-8e48f843ef70-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 00:56:46.744027 master-0 kubenswrapper[33142]: I1204 00:56:46.743973 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gssk8" Dec 04 00:56:46.744185 master-0 kubenswrapper[33142]: I1204 00:56:46.744064 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gssk8" event={"ID":"ef4169a5-a2a7-41b3-adf1-8e48f843ef70","Type":"ContainerDied","Data":"64f750b5e9a36c3680d4d41e5aace080c1b6abb64e95c238e435af36c2b3eb29"} Dec 04 00:56:46.744185 master-0 kubenswrapper[33142]: I1204 00:56:46.744147 33142 scope.go:117] "RemoveContainer" containerID="7af74559748ead661721e00b9a9636e8eab78b74c1a078384eaa108472673d1c" Dec 04 00:56:46.772405 master-0 kubenswrapper[33142]: I1204 00:56:46.772352 33142 scope.go:117] "RemoveContainer" containerID="5bd6b5f1791179d95cf989c8a221c2a009711d8caf20e49704925ca1ec058342" Dec 04 00:56:46.808444 master-0 kubenswrapper[33142]: I1204 00:56:46.808393 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:46.816406 master-0 kubenswrapper[33142]: I1204 00:56:46.816282 33142 scope.go:117] "RemoveContainer" containerID="36e760b854c841a0a09a5db08773886473c581563716c8285f67363baafcabb4" Dec 04 00:56:46.826164 master-0 kubenswrapper[33142]: I1204 00:56:46.825962 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-gssk8"] Dec 04 00:56:47.012135 master-0 kubenswrapper[33142]: I1204 00:56:47.012087 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd"] Dec 04 00:56:47.155499 master-0 kubenswrapper[33142]: I1204 00:56:47.155149 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr"] Dec 04 00:56:47.189919 master-0 kubenswrapper[33142]: I1204 00:56:47.189864 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv"] Dec 04 00:56:47.203029 master-0 kubenswrapper[33142]: I1204 00:56:47.202797 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-5tt2c"] Dec 04 00:56:47.315305 master-0 kubenswrapper[33142]: I1204 00:56:47.315148 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-rxq5m"] Dec 04 00:56:47.760639 master-0 kubenswrapper[33142]: I1204 00:56:47.759274 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" event={"ID":"cd7b0148-f1f0-4e1b-95dc-11c50f193e88","Type":"ContainerStarted","Data":"47cb5a1ebd5ae8501e79811e3c60f850d0a77e3996dcee0d93126b6eed9179eb"} Dec 04 00:56:47.760639 master-0 kubenswrapper[33142]: I1204 00:56:47.760531 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:47.762735 master-0 kubenswrapper[33142]: I1204 00:56:47.762697 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" event={"ID":"ba4130f4-7c15-4a34-88b3-ecbba6134f8a","Type":"ContainerStarted","Data":"a5a544169c343f77f0644245122985415e60b46853f2e6257e4af23649e98161"} Dec 04 00:56:47.768302 master-0 kubenswrapper[33142]: I1204 00:56:47.767482 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" event={"ID":"a073d832-065f-4366-b169-18f8335dd1aa","Type":"ContainerStarted","Data":"96cb4c7199c9029a0e50f1d61d837b411061094d85b714827fbfb3a1f3e2d95f"} Dec 04 00:56:47.779211 master-0 kubenswrapper[33142]: I1204 00:56:47.779142 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" event={"ID":"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca","Type":"ContainerStarted","Data":"cf1782d51cbe943e42f87c4eb6e18b9eec628b2400e39c7893343b55302558dc"} Dec 04 00:56:47.783402 master-0 kubenswrapper[33142]: I1204 00:56:47.783346 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" event={"ID":"6e0aac44-f559-48f5-9157-cb619918e74c","Type":"ContainerStarted","Data":"10f136cd87a57cc2e5a1dae37b3cc177e0ab2dd15fffca850484f14bcc7c30e5"} Dec 04 00:56:47.784664 master-0 kubenswrapper[33142]: I1204 00:56:47.784635 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" event={"ID":"9e405b9d-3382-43d3-af12-1d9744df1b15","Type":"ContainerStarted","Data":"97aeb377fcf19893c8a481ecafd5392993e27016c9679b2e45b2cb72b9e86abe"} Dec 04 00:56:47.788643 master-0 kubenswrapper[33142]: I1204 00:56:47.788574 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" podStartSLOduration=3.891994923 podStartE2EDuration="20.788558119s" podCreationTimestamp="2025-12-04 00:56:27 +0000 UTC" firstStartedPulling="2025-12-04 00:56:29.582987533 +0000 UTC m=+561.984989383" lastFinishedPulling="2025-12-04 00:56:46.479550719 +0000 UTC m=+578.881552579" observedRunningTime="2025-12-04 00:56:47.785242095 +0000 UTC m=+580.187243945" watchObservedRunningTime="2025-12-04 00:56:47.788558119 +0000 UTC m=+580.190559969" Dec 04 00:56:47.789990 master-0 kubenswrapper[33142]: I1204 00:56:47.789914 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" event={"ID":"1f6bcef3-5344-4cd0-a820-6465e29d12af","Type":"ContainerStarted","Data":"ce0e9eeba81e92adbf4a7d6e20f66d4a8f9eebb4c21cd57f8de7ec8ff1699783"} Dec 04 00:56:47.804061 master-0 kubenswrapper[33142]: I1204 00:56:47.802322 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-mqgpk" event={"ID":"1717faf9-8e67-4be5-8fd9-6f167d447a36","Type":"ContainerStarted","Data":"04359b97950e6ff36a1161e2ad930f0331b724d7151507e2afc6e1281d5e72e8"} Dec 04 00:56:47.805611 master-0 kubenswrapper[33142]: I1204 00:56:47.804857 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" event={"ID":"c32dfa8e-1fab-4316-ad2b-67234c573777","Type":"ContainerStarted","Data":"0e3f4de9acbbdfcd9bceb26ee0500d5f68d29350128966c7ffcbb25df64db805"} Dec 04 00:56:47.805611 master-0 kubenswrapper[33142]: I1204 00:56:47.805576 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:56:47.816680 master-0 kubenswrapper[33142]: I1204 00:56:47.816600 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-855d9ccff4-zlccx" podStartSLOduration=3.062384645 podStartE2EDuration="15.816581352s" podCreationTimestamp="2025-12-04 00:56:32 +0000 UTC" firstStartedPulling="2025-12-04 00:56:33.824176069 +0000 UTC m=+566.226177919" lastFinishedPulling="2025-12-04 00:56:46.578372776 +0000 UTC m=+578.980374626" observedRunningTime="2025-12-04 00:56:47.815187392 +0000 UTC m=+580.217189262" watchObservedRunningTime="2025-12-04 00:56:47.816581352 +0000 UTC m=+580.218583202" Dec 04 00:56:47.846582 master-0 kubenswrapper[33142]: I1204 00:56:47.846509 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-86cb77c54b-mqgpk" podStartSLOduration=5.580018144 podStartE2EDuration="15.846481048s" podCreationTimestamp="2025-12-04 00:56:32 +0000 UTC" firstStartedPulling="2025-12-04 00:56:36.92786206 +0000 UTC m=+569.329863920" lastFinishedPulling="2025-12-04 00:56:47.194324974 +0000 UTC m=+579.596326824" observedRunningTime="2025-12-04 00:56:47.838007398 +0000 UTC m=+580.240009268" watchObservedRunningTime="2025-12-04 00:56:47.846481048 +0000 UTC m=+580.248482888" Dec 04 00:56:47.877257 master-0 kubenswrapper[33142]: I1204 00:56:47.877002 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" podStartSLOduration=2.460412777 podStartE2EDuration="18.876974801s" podCreationTimestamp="2025-12-04 00:56:29 +0000 UTC" firstStartedPulling="2025-12-04 00:56:30.058001864 +0000 UTC m=+562.460003724" lastFinishedPulling="2025-12-04 00:56:46.474563908 +0000 UTC m=+578.876565748" observedRunningTime="2025-12-04 00:56:47.8677817 +0000 UTC m=+580.269783570" watchObservedRunningTime="2025-12-04 00:56:47.876974801 +0000 UTC m=+580.278976661" Dec 04 00:56:47.924976 master-0 kubenswrapper[33142]: I1204 00:56:47.924891 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" path="/var/lib/kubelet/pods/ef4169a5-a2a7-41b3-adf1-8e48f843ef70/volumes" Dec 04 00:56:52.869953 master-0 kubenswrapper[33142]: I1204 00:56:52.869598 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" event={"ID":"ba4130f4-7c15-4a34-88b3-ecbba6134f8a","Type":"ContainerStarted","Data":"f306bc668164e36865b0e04a8ed406de76795271b6fcc6d1abd5c1ee80b8daeb"} Dec 04 00:56:52.873509 master-0 kubenswrapper[33142]: I1204 00:56:52.871702 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" event={"ID":"a073d832-065f-4366-b169-18f8335dd1aa","Type":"ContainerStarted","Data":"1cd654459d5a0f8f8c0404286d977ead4aec935d72ea76cfa46fe00151ce30c9"} Dec 04 00:56:52.874833 master-0 kubenswrapper[33142]: I1204 00:56:52.874770 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" event={"ID":"c7446cc2-57c4-4df8-b0f5-bf218d2f0dca","Type":"ContainerStarted","Data":"ae1df9e823d942f4f33bdf097a3eef8b138e9a0f6755ddb4df362ac6ea5e9e07"} Dec 04 00:56:52.877546 master-0 kubenswrapper[33142]: I1204 00:56:52.877506 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" event={"ID":"6e0aac44-f559-48f5-9157-cb619918e74c","Type":"ContainerStarted","Data":"5ca044c96dcdc9142f27197d87617dbead05dc4e4e24c0c5753ba74908e54249"} Dec 04 00:56:52.878021 master-0 kubenswrapper[33142]: I1204 00:56:52.877994 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:56:52.897613 master-0 kubenswrapper[33142]: I1204 00:56:52.897497 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-6jncr" podStartSLOduration=6.9434325690000005 podStartE2EDuration="11.897471427s" podCreationTimestamp="2025-12-04 00:56:41 +0000 UTC" firstStartedPulling="2025-12-04 00:56:47.174702519 +0000 UTC m=+579.576704369" lastFinishedPulling="2025-12-04 00:56:52.128741367 +0000 UTC m=+584.530743227" observedRunningTime="2025-12-04 00:56:52.88873287 +0000 UTC m=+585.290734740" watchObservedRunningTime="2025-12-04 00:56:52.897471427 +0000 UTC m=+585.299473277" Dec 04 00:56:52.974564 master-0 kubenswrapper[33142]: I1204 00:56:52.973532 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-749b9ff6c9-h7gbd" podStartSLOduration=6.872940935 podStartE2EDuration="11.973509659s" podCreationTimestamp="2025-12-04 00:56:41 +0000 UTC" firstStartedPulling="2025-12-04 00:56:47.019984371 +0000 UTC m=+579.421986221" lastFinishedPulling="2025-12-04 00:56:52.120553095 +0000 UTC m=+584.522554945" observedRunningTime="2025-12-04 00:56:52.944471807 +0000 UTC m=+585.346473677" watchObservedRunningTime="2025-12-04 00:56:52.973509659 +0000 UTC m=+585.375511529" Dec 04 00:56:53.011114 master-0 kubenswrapper[33142]: I1204 00:56:53.010973 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-nq7sv" podStartSLOduration=7.057851647 podStartE2EDuration="12.010945138s" podCreationTimestamp="2025-12-04 00:56:41 +0000 UTC" firstStartedPulling="2025-12-04 00:56:47.174992387 +0000 UTC m=+579.576994237" lastFinishedPulling="2025-12-04 00:56:52.128085878 +0000 UTC m=+584.530087728" observedRunningTime="2025-12-04 00:56:52.99440096 +0000 UTC m=+585.396402820" watchObservedRunningTime="2025-12-04 00:56:53.010945138 +0000 UTC m=+585.412947008" Dec 04 00:56:53.012063 master-0 kubenswrapper[33142]: I1204 00:56:53.011554 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" podStartSLOduration=6.074745315 podStartE2EDuration="11.011545135s" podCreationTimestamp="2025-12-04 00:56:42 +0000 UTC" firstStartedPulling="2025-12-04 00:56:47.183824287 +0000 UTC m=+579.585826137" lastFinishedPulling="2025-12-04 00:56:52.120624107 +0000 UTC m=+584.522625957" observedRunningTime="2025-12-04 00:56:52.976459112 +0000 UTC m=+585.378460972" watchObservedRunningTime="2025-12-04 00:56:53.011545135 +0000 UTC m=+585.413546995" Dec 04 00:56:54.203258 master-0 kubenswrapper[33142]: I1204 00:56:54.203166 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-f4fb5df64-vmjrs" Dec 04 00:56:57.937864 master-0 kubenswrapper[33142]: I1204 00:56:57.937798 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" event={"ID":"9e405b9d-3382-43d3-af12-1d9744df1b15","Type":"ContainerStarted","Data":"b35317d72276bb2a3b492157ca2a019da0d913ce126db77af8a38572f4e9845f"} Dec 04 00:56:57.938528 master-0 kubenswrapper[33142]: I1204 00:56:57.938148 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:57.940597 master-0 kubenswrapper[33142]: I1204 00:56:57.940560 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" Dec 04 00:56:57.966491 master-0 kubenswrapper[33142]: I1204 00:56:57.966386 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-d8bb48f5d-rxq5m" podStartSLOduration=6.19537072 podStartE2EDuration="15.966359465s" podCreationTimestamp="2025-12-04 00:56:42 +0000 UTC" firstStartedPulling="2025-12-04 00:56:47.328573203 +0000 UTC m=+579.730575053" lastFinishedPulling="2025-12-04 00:56:57.099561948 +0000 UTC m=+589.501563798" observedRunningTime="2025-12-04 00:56:57.95839461 +0000 UTC m=+590.360396500" watchObservedRunningTime="2025-12-04 00:56:57.966359465 +0000 UTC m=+590.368361325" Dec 04 00:56:59.587040 master-0 kubenswrapper[33142]: I1204 00:56:59.586978 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-589d959c4f-w2496" Dec 04 00:57:02.731983 master-0 kubenswrapper[33142]: I1204 00:57:02.731869 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-5446b9c989-5tt2c" Dec 04 00:57:09.149614 master-0 kubenswrapper[33142]: I1204 00:57:09.149470 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-994774496-r7lg7" Dec 04 00:57:14.083583 master-0 kubenswrapper[33142]: I1204 00:57:14.083470 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx"] Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: E1204 00:57:14.083850 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="extract-content" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: I1204 00:57:14.083865 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="extract-content" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: E1204 00:57:14.083887 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="registry-server" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: I1204 00:57:14.083893 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="registry-server" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: E1204 00:57:14.083902 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="extract-utilities" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: I1204 00:57:14.083909 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="extract-utilities" Dec 04 00:57:14.084331 master-0 kubenswrapper[33142]: I1204 00:57:14.084147 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="ef4169a5-a2a7-41b3-adf1-8e48f843ef70" containerName="registry-server" Dec 04 00:57:14.085385 master-0 kubenswrapper[33142]: I1204 00:57:14.084728 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.088809 master-0 kubenswrapper[33142]: I1204 00:57:14.088757 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-webhook-server-cert" Dec 04 00:57:14.092777 master-0 kubenswrapper[33142]: I1204 00:57:14.092732 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-9pqnp"] Dec 04 00:57:14.135177 master-0 kubenswrapper[33142]: I1204 00:57:14.135117 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.141073 master-0 kubenswrapper[33142]: I1204 00:57:14.141014 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx"] Dec 04 00:57:14.143133 master-0 kubenswrapper[33142]: I1204 00:57:14.143096 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-certs-secret" Dec 04 00:57:14.154647 master-0 kubenswrapper[33142]: I1204 00:57:14.154600 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"frr-startup" Dec 04 00:57:14.191384 master-0 kubenswrapper[33142]: I1204 00:57:14.191329 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-clzsv"] Dec 04 00:57:14.197346 master-0 kubenswrapper[33142]: I1204 00:57:14.197306 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.197992 master-0 kubenswrapper[33142]: I1204 00:57:14.197568 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-reloader\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.198164 master-0 kubenswrapper[33142]: I1204 00:57:14.198145 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.198265 master-0 kubenswrapper[33142]: I1204 00:57:14.198240 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-sockets\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.198394 master-0 kubenswrapper[33142]: I1204 00:57:14.198374 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmkh\" (UniqueName: \"kubernetes.io/projected/cecefec9-7a77-44be-aa90-b8aeacf31584-kube-api-access-zgmkh\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.198646 master-0 kubenswrapper[33142]: I1204 00:57:14.198630 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-conf\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.198760 master-0 kubenswrapper[33142]: I1204 00:57:14.198745 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-startup\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.199033 master-0 kubenswrapper[33142]: I1204 00:57:14.198849 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85bc7143-b1a6-4925-80b0-565ab710415e-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.199143 master-0 kubenswrapper[33142]: I1204 00:57:14.199126 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjsb\" (UniqueName: \"kubernetes.io/projected/85bc7143-b1a6-4925-80b0-565ab710415e-kube-api-access-pqjsb\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.199280 master-0 kubenswrapper[33142]: I1204 00:57:14.199267 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.201562 master-0 kubenswrapper[33142]: I1204 00:57:14.201539 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-certs-secret" Dec 04 00:57:14.201878 master-0 kubenswrapper[33142]: I1204 00:57:14.201678 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"metallb-excludel2" Dec 04 00:57:14.202083 master-0 kubenswrapper[33142]: I1204 00:57:14.201707 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-memberlist" Dec 04 00:57:14.229045 master-0 kubenswrapper[33142]: I1204 00:57:14.223251 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/controller-f8648f98b-x4fnw"] Dec 04 00:57:14.229045 master-0 kubenswrapper[33142]: I1204 00:57:14.225271 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.232966 master-0 kubenswrapper[33142]: I1204 00:57:14.232896 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-certs-secret" Dec 04 00:57:14.234646 master-0 kubenswrapper[33142]: I1204 00:57:14.234566 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-f8648f98b-x4fnw"] Dec 04 00:57:14.301138 master-0 kubenswrapper[33142]: I1204 00:57:14.301050 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.301138 master-0 kubenswrapper[33142]: I1204 00:57:14.301134 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-sockets\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.301386 master-0 kubenswrapper[33142]: I1204 00:57:14.301192 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmkh\" (UniqueName: \"kubernetes.io/projected/cecefec9-7a77-44be-aa90-b8aeacf31584-kube-api-access-zgmkh\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.301386 master-0 kubenswrapper[33142]: I1204 00:57:14.301222 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-metrics-certs\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.301386 master-0 kubenswrapper[33142]: I1204 00:57:14.301259 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.301386 master-0 kubenswrapper[33142]: I1204 00:57:14.301278 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/3fd94a76-7a42-45be-aa70-8b989177c4f6-metallb-excludel2\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.301509 master-0 kubenswrapper[33142]: I1204 00:57:14.301408 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-conf\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.301509 master-0 kubenswrapper[33142]: I1204 00:57:14.301458 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-startup\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.301569 master-0 kubenswrapper[33142]: I1204 00:57:14.301511 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.301569 master-0 kubenswrapper[33142]: I1204 00:57:14.301529 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfc2w\" (UniqueName: \"kubernetes.io/projected/201d2247-e8f9-498e-b990-f9d610a70997-kube-api-access-jfc2w\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.301651 master-0 kubenswrapper[33142]: I1204 00:57:14.301579 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85bc7143-b1a6-4925-80b0-565ab710415e-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.301651 master-0 kubenswrapper[33142]: I1204 00:57:14.301599 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjsb\" (UniqueName: \"kubernetes.io/projected/85bc7143-b1a6-4925-80b0-565ab710415e-kube-api-access-pqjsb\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.302082 master-0 kubenswrapper[33142]: I1204 00:57:14.301693 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.302162 master-0 kubenswrapper[33142]: I1204 00:57:14.302142 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-cert\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.302218 master-0 kubenswrapper[33142]: I1204 00:57:14.302201 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-reloader\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.302259 master-0 kubenswrapper[33142]: I1204 00:57:14.302224 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8zfv\" (UniqueName: \"kubernetes.io/projected/3fd94a76-7a42-45be-aa70-8b989177c4f6-kube-api-access-w8zfv\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.302406 master-0 kubenswrapper[33142]: E1204 00:57:14.302375 33142 secret.go:189] Couldn't get secret metallb-system/frr-k8s-certs-secret: secret "frr-k8s-certs-secret" not found Dec 04 00:57:14.302537 master-0 kubenswrapper[33142]: E1204 00:57:14.302514 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs podName:cecefec9-7a77-44be-aa90-b8aeacf31584 nodeName:}" failed. No retries permitted until 2025-12-04 00:57:14.802454404 +0000 UTC m=+607.204456254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs") pod "frr-k8s-9pqnp" (UID: "cecefec9-7a77-44be-aa90-b8aeacf31584") : secret "frr-k8s-certs-secret" not found Dec 04 00:57:14.303534 master-0 kubenswrapper[33142]: I1204 00:57:14.303479 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-sockets\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.305786 master-0 kubenswrapper[33142]: I1204 00:57:14.305762 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-conf\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.306594 master-0 kubenswrapper[33142]: I1204 00:57:14.306534 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/cecefec9-7a77-44be-aa90-b8aeacf31584-frr-startup\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.306696 master-0 kubenswrapper[33142]: I1204 00:57:14.306661 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.306869 master-0 kubenswrapper[33142]: I1204 00:57:14.306849 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/cecefec9-7a77-44be-aa90-b8aeacf31584-reloader\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.323360 master-0 kubenswrapper[33142]: I1204 00:57:14.322229 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85bc7143-b1a6-4925-80b0-565ab710415e-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.323707 master-0 kubenswrapper[33142]: I1204 00:57:14.323671 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmkh\" (UniqueName: \"kubernetes.io/projected/cecefec9-7a77-44be-aa90-b8aeacf31584-kube-api-access-zgmkh\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.325884 master-0 kubenswrapper[33142]: I1204 00:57:14.325453 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjsb\" (UniqueName: \"kubernetes.io/projected/85bc7143-b1a6-4925-80b0-565ab710415e-kube-api-access-pqjsb\") pod \"frr-k8s-webhook-server-7fcb986d4-t67dx\" (UID: \"85bc7143-b1a6-4925-80b0-565ab710415e\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.403434 master-0 kubenswrapper[33142]: I1204 00:57:14.403240 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-cert\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.403434 master-0 kubenswrapper[33142]: I1204 00:57:14.403319 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w8zfv\" (UniqueName: \"kubernetes.io/projected/3fd94a76-7a42-45be-aa70-8b989177c4f6-kube-api-access-w8zfv\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.403434 master-0 kubenswrapper[33142]: I1204 00:57:14.403377 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-metrics-certs\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.403434 master-0 kubenswrapper[33142]: I1204 00:57:14.403407 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.403434 master-0 kubenswrapper[33142]: I1204 00:57:14.403431 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/3fd94a76-7a42-45be-aa70-8b989177c4f6-metallb-excludel2\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.403912 master-0 kubenswrapper[33142]: I1204 00:57:14.403482 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.403912 master-0 kubenswrapper[33142]: I1204 00:57:14.403501 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jfc2w\" (UniqueName: \"kubernetes.io/projected/201d2247-e8f9-498e-b990-f9d610a70997-kube-api-access-jfc2w\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.404540 master-0 kubenswrapper[33142]: E1204 00:57:14.404456 33142 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Dec 04 00:57:14.404657 master-0 kubenswrapper[33142]: E1204 00:57:14.404569 33142 secret.go:189] Couldn't get secret metallb-system/speaker-certs-secret: secret "speaker-certs-secret" not found Dec 04 00:57:14.404657 master-0 kubenswrapper[33142]: E1204 00:57:14.404580 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist podName:3fd94a76-7a42-45be-aa70-8b989177c4f6 nodeName:}" failed. No retries permitted until 2025-12-04 00:57:14.904554282 +0000 UTC m=+607.306556132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist") pod "speaker-clzsv" (UID: "3fd94a76-7a42-45be-aa70-8b989177c4f6") : secret "metallb-memberlist" not found Dec 04 00:57:14.404657 master-0 kubenswrapper[33142]: E1204 00:57:14.404616 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs podName:3fd94a76-7a42-45be-aa70-8b989177c4f6 nodeName:}" failed. No retries permitted until 2025-12-04 00:57:14.904602733 +0000 UTC m=+607.306604583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs") pod "speaker-clzsv" (UID: "3fd94a76-7a42-45be-aa70-8b989177c4f6") : secret "speaker-certs-secret" not found Dec 04 00:57:14.407299 master-0 kubenswrapper[33142]: I1204 00:57:14.406652 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/3fd94a76-7a42-45be-aa70-8b989177c4f6-metallb-excludel2\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.407299 master-0 kubenswrapper[33142]: I1204 00:57:14.407267 33142 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Dec 04 00:57:14.407674 master-0 kubenswrapper[33142]: I1204 00:57:14.407636 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-metrics-certs\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.412952 master-0 kubenswrapper[33142]: I1204 00:57:14.412874 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:14.417579 master-0 kubenswrapper[33142]: I1204 00:57:14.416994 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201d2247-e8f9-498e-b990-f9d610a70997-cert\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.437597 master-0 kubenswrapper[33142]: I1204 00:57:14.437530 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfc2w\" (UniqueName: \"kubernetes.io/projected/201d2247-e8f9-498e-b990-f9d610a70997-kube-api-access-jfc2w\") pod \"controller-f8648f98b-x4fnw\" (UID: \"201d2247-e8f9-498e-b990-f9d610a70997\") " pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.439209 master-0 kubenswrapper[33142]: I1204 00:57:14.439147 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8zfv\" (UniqueName: \"kubernetes.io/projected/3fd94a76-7a42-45be-aa70-8b989177c4f6-kube-api-access-w8zfv\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.570504 master-0 kubenswrapper[33142]: I1204 00:57:14.570435 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:14.819067 master-0 kubenswrapper[33142]: I1204 00:57:14.810159 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.819067 master-0 kubenswrapper[33142]: I1204 00:57:14.813511 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cecefec9-7a77-44be-aa90-b8aeacf31584-metrics-certs\") pod \"frr-k8s-9pqnp\" (UID: \"cecefec9-7a77-44be-aa90-b8aeacf31584\") " pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:14.891966 master-0 kubenswrapper[33142]: I1204 00:57:14.891868 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx"] Dec 04 00:57:14.908857 master-0 kubenswrapper[33142]: W1204 00:57:14.908812 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85bc7143_b1a6_4925_80b0_565ab710415e.slice/crio-fb86b01a030d06d6685eb5781728913035b099450c134e785951c215755660ed WatchSource:0}: Error finding container fb86b01a030d06d6685eb5781728913035b099450c134e785951c215755660ed: Status 404 returned error can't find the container with id fb86b01a030d06d6685eb5781728913035b099450c134e785951c215755660ed Dec 04 00:57:14.911387 master-0 kubenswrapper[33142]: I1204 00:57:14.911356 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.911518 master-0 kubenswrapper[33142]: I1204 00:57:14.911417 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:14.912842 master-0 kubenswrapper[33142]: E1204 00:57:14.912812 33142 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Dec 04 00:57:14.913040 master-0 kubenswrapper[33142]: E1204 00:57:14.913014 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist podName:3fd94a76-7a42-45be-aa70-8b989177c4f6 nodeName:}" failed. No retries permitted until 2025-12-04 00:57:15.912883556 +0000 UTC m=+608.314885406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist") pod "speaker-clzsv" (UID: "3fd94a76-7a42-45be-aa70-8b989177c4f6") : secret "metallb-memberlist" not found Dec 04 00:57:14.914372 master-0 kubenswrapper[33142]: I1204 00:57:14.914090 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-metrics-certs\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:15.081344 master-0 kubenswrapper[33142]: I1204 00:57:15.078701 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-f8648f98b-x4fnw"] Dec 04 00:57:15.087985 master-0 kubenswrapper[33142]: I1204 00:57:15.087910 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:15.100766 master-0 kubenswrapper[33142]: I1204 00:57:15.100698 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" event={"ID":"85bc7143-b1a6-4925-80b0-565ab710415e","Type":"ContainerStarted","Data":"fb86b01a030d06d6685eb5781728913035b099450c134e785951c215755660ed"} Dec 04 00:57:15.934960 master-0 kubenswrapper[33142]: I1204 00:57:15.931408 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:15.951962 master-0 kubenswrapper[33142]: I1204 00:57:15.943528 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/3fd94a76-7a42-45be-aa70-8b989177c4f6-memberlist\") pod \"speaker-clzsv\" (UID: \"3fd94a76-7a42-45be-aa70-8b989177c4f6\") " pod="metallb-system/speaker-clzsv" Dec 04 00:57:16.060588 master-0 kubenswrapper[33142]: I1204 00:57:16.059902 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-clzsv" Dec 04 00:57:16.114960 master-0 kubenswrapper[33142]: I1204 00:57:16.113552 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-x4fnw" event={"ID":"201d2247-e8f9-498e-b990-f9d610a70997","Type":"ContainerStarted","Data":"b6f675da0ec9fd258ad56a23894b60565f8fa9d680863919942f6930e40b6a23"} Dec 04 00:57:16.114960 master-0 kubenswrapper[33142]: I1204 00:57:16.113610 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-x4fnw" event={"ID":"201d2247-e8f9-498e-b990-f9d610a70997","Type":"ContainerStarted","Data":"99d89d9868a6f010a8000fbb314042909738f1cfdd683a810fa73bb70d0a1bf8"} Dec 04 00:57:16.114960 master-0 kubenswrapper[33142]: W1204 00:57:16.114209 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd94a76_7a42_45be_aa70_8b989177c4f6.slice/crio-b5f429636fd9ad62196d4b66ae8bf238c4af0e46cd223848d5ade1183baca4ef WatchSource:0}: Error finding container b5f429636fd9ad62196d4b66ae8bf238c4af0e46cd223848d5ade1183baca4ef: Status 404 returned error can't find the container with id b5f429636fd9ad62196d4b66ae8bf238c4af0e46cd223848d5ade1183baca4ef Dec 04 00:57:16.115594 master-0 kubenswrapper[33142]: I1204 00:57:16.115170 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"8de091bce6fa56daad4d71f244c12e763872fdffa48b1c69a50975f2dc6b1a55"} Dec 04 00:57:16.442434 master-0 kubenswrapper[33142]: I1204 00:57:16.442105 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs"] Dec 04 00:57:16.443361 master-0 kubenswrapper[33142]: I1204 00:57:16.443332 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" Dec 04 00:57:16.463729 master-0 kubenswrapper[33142]: I1204 00:57:16.463624 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs"] Dec 04 00:57:16.516327 master-0 kubenswrapper[33142]: I1204 00:57:16.513478 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf"] Dec 04 00:57:16.516327 master-0 kubenswrapper[33142]: I1204 00:57:16.514581 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.517574 master-0 kubenswrapper[33142]: I1204 00:57:16.517536 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"openshift-nmstate-webhook" Dec 04 00:57:16.522427 master-0 kubenswrapper[33142]: I1204 00:57:16.520978 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-92pkn"] Dec 04 00:57:16.554013 master-0 kubenswrapper[33142]: I1204 00:57:16.550658 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.554013 master-0 kubenswrapper[33142]: I1204 00:57:16.553716 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4mc\" (UniqueName: \"kubernetes.io/projected/21ad452f-9242-4a85-9ffb-9569b25cb9f5-kube-api-access-bt4mc\") pod \"nmstate-metrics-7f946cbc9-ljqrs\" (UID: \"21ad452f-9242-4a85-9ffb-9569b25cb9f5\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" Dec 04 00:57:16.554013 master-0 kubenswrapper[33142]: I1204 00:57:16.553827 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.554013 master-0 kubenswrapper[33142]: I1204 00:57:16.553901 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjhxb\" (UniqueName: \"kubernetes.io/projected/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-kube-api-access-bjhxb\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.583253 master-0 kubenswrapper[33142]: I1204 00:57:16.582238 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf"] Dec 04 00:57:16.658368 master-0 kubenswrapper[33142]: I1204 00:57:16.658326 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4mc\" (UniqueName: \"kubernetes.io/projected/21ad452f-9242-4a85-9ffb-9569b25cb9f5-kube-api-access-bt4mc\") pod \"nmstate-metrics-7f946cbc9-ljqrs\" (UID: \"21ad452f-9242-4a85-9ffb-9569b25cb9f5\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" Dec 04 00:57:16.658508 master-0 kubenswrapper[33142]: I1204 00:57:16.658395 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5q2p\" (UniqueName: \"kubernetes.io/projected/13a0afa0-9bb4-4676-89c3-bdd08925b127-kube-api-access-r5q2p\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.658508 master-0 kubenswrapper[33142]: I1204 00:57:16.658415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.658508 master-0 kubenswrapper[33142]: I1204 00:57:16.658443 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-nmstate-lock\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.658508 master-0 kubenswrapper[33142]: I1204 00:57:16.658499 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bjhxb\" (UniqueName: \"kubernetes.io/projected/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-kube-api-access-bjhxb\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.658684 master-0 kubenswrapper[33142]: I1204 00:57:16.658525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-ovs-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.658684 master-0 kubenswrapper[33142]: I1204 00:57:16.658561 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-dbus-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.705314 master-0 kubenswrapper[33142]: I1204 00:57:16.697846 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.724962 master-0 kubenswrapper[33142]: I1204 00:57:16.721914 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4mc\" (UniqueName: \"kubernetes.io/projected/21ad452f-9242-4a85-9ffb-9569b25cb9f5-kube-api-access-bt4mc\") pod \"nmstate-metrics-7f946cbc9-ljqrs\" (UID: \"21ad452f-9242-4a85-9ffb-9569b25cb9f5\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" Dec 04 00:57:16.726230 master-0 kubenswrapper[33142]: I1204 00:57:16.726192 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjhxb\" (UniqueName: \"kubernetes.io/projected/0a09a9a0-b512-4054-93c3-af7ccb4d4c87-kube-api-access-bjhxb\") pod \"nmstate-webhook-5f6d4c5ccb-6cndf\" (UID: \"0a09a9a0-b512-4054-93c3-af7ccb4d4c87\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.761052 master-0 kubenswrapper[33142]: I1204 00:57:16.760992 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-ovs-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.761381 master-0 kubenswrapper[33142]: I1204 00:57:16.761358 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-dbus-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.761612 master-0 kubenswrapper[33142]: I1204 00:57:16.761590 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r5q2p\" (UniqueName: \"kubernetes.io/projected/13a0afa0-9bb4-4676-89c3-bdd08925b127-kube-api-access-r5q2p\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.761750 master-0 kubenswrapper[33142]: I1204 00:57:16.761730 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-nmstate-lock\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.761969 master-0 kubenswrapper[33142]: I1204 00:57:16.761950 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-nmstate-lock\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.762550 master-0 kubenswrapper[33142]: I1204 00:57:16.762532 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-ovs-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.762726 master-0 kubenswrapper[33142]: I1204 00:57:16.762667 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/13a0afa0-9bb4-4676-89c3-bdd08925b127-dbus-socket\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.780553 master-0 kubenswrapper[33142]: I1204 00:57:16.780415 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" Dec 04 00:57:16.820958 master-0 kubenswrapper[33142]: I1204 00:57:16.820351 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth"] Dec 04 00:57:16.827203 master-0 kubenswrapper[33142]: I1204 00:57:16.821706 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.837145 master-0 kubenswrapper[33142]: I1204 00:57:16.829546 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5q2p\" (UniqueName: \"kubernetes.io/projected/13a0afa0-9bb4-4676-89c3-bdd08925b127-kube-api-access-r5q2p\") pod \"nmstate-handler-92pkn\" (UID: \"13a0afa0-9bb4-4676-89c3-bdd08925b127\") " pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.837145 master-0 kubenswrapper[33142]: I1204 00:57:16.829975 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"nginx-conf" Dec 04 00:57:16.837145 master-0 kubenswrapper[33142]: I1204 00:57:16.830223 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"plugin-serving-cert" Dec 04 00:57:16.864230 master-0 kubenswrapper[33142]: I1204 00:57:16.863765 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c182ddf-b242-4630-98a3-7cd49905eaa8-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.864230 master-0 kubenswrapper[33142]: I1204 00:57:16.863881 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6ck\" (UniqueName: \"kubernetes.io/projected/9c182ddf-b242-4630-98a3-7cd49905eaa8-kube-api-access-2t6ck\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.864230 master-0 kubenswrapper[33142]: I1204 00:57:16.863914 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.898988 master-0 kubenswrapper[33142]: I1204 00:57:16.893589 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth"] Dec 04 00:57:16.948210 master-0 kubenswrapper[33142]: I1204 00:57:16.947849 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: I1204 00:57:16.963088 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: I1204 00:57:16.965370 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c182ddf-b242-4630-98a3-7cd49905eaa8-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: I1204 00:57:16.965465 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6ck\" (UniqueName: \"kubernetes.io/projected/9c182ddf-b242-4630-98a3-7cd49905eaa8-kube-api-access-2t6ck\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: I1204 00:57:16.965540 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: E1204 00:57:16.966082 33142 secret.go:189] Couldn't get secret openshift-nmstate/plugin-serving-cert: secret "plugin-serving-cert" not found Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: E1204 00:57:16.966147 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert podName:9c182ddf-b242-4630-98a3-7cd49905eaa8 nodeName:}" failed. No retries permitted until 2025-12-04 00:57:17.466128855 +0000 UTC m=+609.868130705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert") pod "nmstate-console-plugin-7fbb5f6569-qncth" (UID: "9c182ddf-b242-4630-98a3-7cd49905eaa8") : secret "plugin-serving-cert" not found Dec 04 00:57:16.969908 master-0 kubenswrapper[33142]: I1204 00:57:16.967417 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c182ddf-b242-4630-98a3-7cd49905eaa8-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:17.024485 master-0 kubenswrapper[33142]: I1204 00:57:17.023059 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6ck\" (UniqueName: \"kubernetes.io/projected/9c182ddf-b242-4630-98a3-7cd49905eaa8-kube-api-access-2t6ck\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:17.144693 master-0 kubenswrapper[33142]: I1204 00:57:17.143109 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-588c8f5cd5-nqpcn"] Dec 04 00:57:17.154119 master-0 kubenswrapper[33142]: I1204 00:57:17.149692 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.154119 master-0 kubenswrapper[33142]: I1204 00:57:17.151123 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-clzsv" event={"ID":"3fd94a76-7a42-45be-aa70-8b989177c4f6","Type":"ContainerStarted","Data":"6ab5944a4cbcc1301475cb76f0da6d81f0601cf777915c35b05f519d2185ba8b"} Dec 04 00:57:17.154119 master-0 kubenswrapper[33142]: I1204 00:57:17.151176 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-clzsv" event={"ID":"3fd94a76-7a42-45be-aa70-8b989177c4f6","Type":"ContainerStarted","Data":"b5f429636fd9ad62196d4b66ae8bf238c4af0e46cd223848d5ade1183baca4ef"} Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168321 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-oauth-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168402 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168451 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-trusted-ca-bundle\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168487 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-service-ca\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168555 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.168646 master-0 kubenswrapper[33142]: I1204 00:57:17.168600 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-oauth-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.169070 master-0 kubenswrapper[33142]: I1204 00:57:17.168700 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgr42\" (UniqueName: \"kubernetes.io/projected/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-kube-api-access-cgr42\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.194807 master-0 kubenswrapper[33142]: I1204 00:57:17.192632 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588c8f5cd5-nqpcn"] Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278325 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278406 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-oauth-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278522 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cgr42\" (UniqueName: \"kubernetes.io/projected/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-kube-api-access-cgr42\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278602 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-oauth-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278630 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278660 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-trusted-ca-bundle\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.278717 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-service-ca\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.279770 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-oauth-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.279826 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-service-ca\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.280074 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.280589 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-trusted-ca-bundle\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.285683 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-oauth-config\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.296169 master-0 kubenswrapper[33142]: I1204 00:57:17.285689 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-console-serving-cert\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.306004 master-0 kubenswrapper[33142]: I1204 00:57:17.304739 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgr42\" (UniqueName: \"kubernetes.io/projected/6f5ab3bb-7099-4809-b946-a7bb6313c2ee-kube-api-access-cgr42\") pod \"console-588c8f5cd5-nqpcn\" (UID: \"6f5ab3bb-7099-4809-b946-a7bb6313c2ee\") " pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.470083 master-0 kubenswrapper[33142]: I1204 00:57:17.470025 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:17.482266 master-0 kubenswrapper[33142]: I1204 00:57:17.482195 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:17.501313 master-0 kubenswrapper[33142]: I1204 00:57:17.499909 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c182ddf-b242-4630-98a3-7cd49905eaa8-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-qncth\" (UID: \"9c182ddf-b242-4630-98a3-7cd49905eaa8\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:17.526053 master-0 kubenswrapper[33142]: I1204 00:57:17.518768 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" Dec 04 00:57:17.575579 master-0 kubenswrapper[33142]: I1204 00:57:17.575524 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs"] Dec 04 00:57:17.710796 master-0 kubenswrapper[33142]: I1204 00:57:17.710720 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf"] Dec 04 00:57:17.993426 master-0 kubenswrapper[33142]: W1204 00:57:17.993375 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5ab3bb_7099_4809_b946_a7bb6313c2ee.slice/crio-b83a2357cdae90e93b294aa90ff6444a4d248c049aa9f28b644807d02a177d1c WatchSource:0}: Error finding container b83a2357cdae90e93b294aa90ff6444a4d248c049aa9f28b644807d02a177d1c: Status 404 returned error can't find the container with id b83a2357cdae90e93b294aa90ff6444a4d248c049aa9f28b644807d02a177d1c Dec 04 00:57:17.994017 master-0 kubenswrapper[33142]: I1204 00:57:17.993890 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588c8f5cd5-nqpcn"] Dec 04 00:57:18.079292 master-0 kubenswrapper[33142]: I1204 00:57:18.079236 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth"] Dec 04 00:57:18.104282 master-0 kubenswrapper[33142]: W1204 00:57:18.104225 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c182ddf_b242_4630_98a3_7cd49905eaa8.slice/crio-f935e003f034f86e0d82a04c7844c0c090192ce320b498d9df25b56f37caf7f0 WatchSource:0}: Error finding container f935e003f034f86e0d82a04c7844c0c090192ce320b498d9df25b56f37caf7f0: Status 404 returned error can't find the container with id f935e003f034f86e0d82a04c7844c0c090192ce320b498d9df25b56f37caf7f0 Dec 04 00:57:18.163397 master-0 kubenswrapper[33142]: I1204 00:57:18.163251 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" event={"ID":"0a09a9a0-b512-4054-93c3-af7ccb4d4c87","Type":"ContainerStarted","Data":"4952849ac1bb192ce5a6b37efe02b4d49d4d89e5200d0ac3a0d1c61f938883c4"} Dec 04 00:57:18.166169 master-0 kubenswrapper[33142]: I1204 00:57:18.166078 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" event={"ID":"21ad452f-9242-4a85-9ffb-9569b25cb9f5","Type":"ContainerStarted","Data":"a72e3ce1029772a66ae2f0d698f8e5567ac0532a79efad9a395e2f780cf62814"} Dec 04 00:57:18.168133 master-0 kubenswrapper[33142]: I1204 00:57:18.168061 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" event={"ID":"9c182ddf-b242-4630-98a3-7cd49905eaa8","Type":"ContainerStarted","Data":"f935e003f034f86e0d82a04c7844c0c090192ce320b498d9df25b56f37caf7f0"} Dec 04 00:57:18.170424 master-0 kubenswrapper[33142]: I1204 00:57:18.170375 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-92pkn" event={"ID":"13a0afa0-9bb4-4676-89c3-bdd08925b127","Type":"ContainerStarted","Data":"5b2bbfb6ce220c538efa39824ef87fd23ff2c5dfa88ac299300f74afb780d223"} Dec 04 00:57:18.172590 master-0 kubenswrapper[33142]: I1204 00:57:18.172537 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588c8f5cd5-nqpcn" event={"ID":"6f5ab3bb-7099-4809-b946-a7bb6313c2ee","Type":"ContainerStarted","Data":"b83a2357cdae90e93b294aa90ff6444a4d248c049aa9f28b644807d02a177d1c"} Dec 04 00:57:19.197607 master-0 kubenswrapper[33142]: I1204 00:57:19.197490 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-x4fnw" event={"ID":"201d2247-e8f9-498e-b990-f9d610a70997","Type":"ContainerStarted","Data":"6779b1933b7f328ef1e3f44a167498d2eeae0cbadec49083f0f342d0e5c8602d"} Dec 04 00:57:19.198179 master-0 kubenswrapper[33142]: I1204 00:57:19.197694 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:19.202399 master-0 kubenswrapper[33142]: I1204 00:57:19.202354 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-clzsv" event={"ID":"3fd94a76-7a42-45be-aa70-8b989177c4f6","Type":"ContainerStarted","Data":"8a5d4827205d18d71428f2ee28bf7455abf1925575a6a417a0fb3d340a0796ac"} Dec 04 00:57:19.203101 master-0 kubenswrapper[33142]: I1204 00:57:19.203065 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/speaker-clzsv" Dec 04 00:57:19.206711 master-0 kubenswrapper[33142]: I1204 00:57:19.206665 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588c8f5cd5-nqpcn" event={"ID":"6f5ab3bb-7099-4809-b946-a7bb6313c2ee","Type":"ContainerStarted","Data":"1a0053dc1d41eaf9d9ca9ca86cc31180088a60058af790c8b8d77d9d5c346c06"} Dec 04 00:57:19.232898 master-0 kubenswrapper[33142]: I1204 00:57:19.232772 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-f8648f98b-x4fnw" podStartSLOduration=1.668552959 podStartE2EDuration="5.232748349s" podCreationTimestamp="2025-12-04 00:57:14 +0000 UTC" firstStartedPulling="2025-12-04 00:57:15.324049161 +0000 UTC m=+607.726051011" lastFinishedPulling="2025-12-04 00:57:18.888244551 +0000 UTC m=+611.290246401" observedRunningTime="2025-12-04 00:57:19.221759218 +0000 UTC m=+611.623761078" watchObservedRunningTime="2025-12-04 00:57:19.232748349 +0000 UTC m=+611.634750199" Dec 04 00:57:19.253114 master-0 kubenswrapper[33142]: I1204 00:57:19.253009 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-588c8f5cd5-nqpcn" podStartSLOduration=2.252985802 podStartE2EDuration="2.252985802s" podCreationTimestamp="2025-12-04 00:57:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:57:19.247335362 +0000 UTC m=+611.649337202" watchObservedRunningTime="2025-12-04 00:57:19.252985802 +0000 UTC m=+611.654987662" Dec 04 00:57:19.273603 master-0 kubenswrapper[33142]: I1204 00:57:19.273495 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-clzsv" podStartSLOduration=2.845189533 podStartE2EDuration="5.273476762s" podCreationTimestamp="2025-12-04 00:57:14 +0000 UTC" firstStartedPulling="2025-12-04 00:57:16.473182116 +0000 UTC m=+608.875183966" lastFinishedPulling="2025-12-04 00:57:18.901469345 +0000 UTC m=+611.303471195" observedRunningTime="2025-12-04 00:57:19.269210791 +0000 UTC m=+611.671212651" watchObservedRunningTime="2025-12-04 00:57:19.273476762 +0000 UTC m=+611.675478622" Dec 04 00:57:24.257825 master-0 kubenswrapper[33142]: I1204 00:57:24.257728 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" event={"ID":"21ad452f-9242-4a85-9ffb-9569b25cb9f5","Type":"ContainerStarted","Data":"baca3dc6088191ea58aae07dbe057ead0de6426409ba3c0358dd89a44af74572"} Dec 04 00:57:24.257825 master-0 kubenswrapper[33142]: I1204 00:57:24.257799 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" event={"ID":"21ad452f-9242-4a85-9ffb-9569b25cb9f5","Type":"ContainerStarted","Data":"9c34338f586ac14c98962a24b74122ec5564ba07f370829df50b4185cd261aa0"} Dec 04 00:57:24.261585 master-0 kubenswrapper[33142]: I1204 00:57:24.261532 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" event={"ID":"9c182ddf-b242-4630-98a3-7cd49905eaa8","Type":"ContainerStarted","Data":"d9273e17f11a6d54ab0c5a76bec75a8d40f036aaf50e586442650ed64b0ca13c"} Dec 04 00:57:24.266776 master-0 kubenswrapper[33142]: I1204 00:57:24.266692 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-92pkn" event={"ID":"13a0afa0-9bb4-4676-89c3-bdd08925b127","Type":"ContainerStarted","Data":"9711307464decfec23658fbd02c85e4c4b47c1f160035d51238d61fbaab737ea"} Dec 04 00:57:24.266877 master-0 kubenswrapper[33142]: I1204 00:57:24.266826 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:24.270631 master-0 kubenswrapper[33142]: I1204 00:57:24.270576 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" event={"ID":"85bc7143-b1a6-4925-80b0-565ab710415e","Type":"ContainerStarted","Data":"b654b6ff3354d14680d6e582674b087fbec4964eab9ee484fa57e740b1a1e45d"} Dec 04 00:57:24.271672 master-0 kubenswrapper[33142]: I1204 00:57:24.271632 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:24.274031 master-0 kubenswrapper[33142]: I1204 00:57:24.273988 33142 generic.go:334] "Generic (PLEG): container finished" podID="cecefec9-7a77-44be-aa90-b8aeacf31584" containerID="e50308f5340eee4e130b0f4f8c7da7c9e85cc399b359921ab3662346e66ce233" exitCode=0 Dec 04 00:57:24.274088 master-0 kubenswrapper[33142]: I1204 00:57:24.274054 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerDied","Data":"e50308f5340eee4e130b0f4f8c7da7c9e85cc399b359921ab3662346e66ce233"} Dec 04 00:57:24.276783 master-0 kubenswrapper[33142]: I1204 00:57:24.276751 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" event={"ID":"0a09a9a0-b512-4054-93c3-af7ccb4d4c87","Type":"ContainerStarted","Data":"e67ef0e8b71d72385ef3db0cc8ceb33473511ee239b65ecd9f94109d75897dc4"} Dec 04 00:57:24.293712 master-0 kubenswrapper[33142]: I1204 00:57:24.293560 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-ljqrs" podStartSLOduration=2.243626022 podStartE2EDuration="8.293526468s" podCreationTimestamp="2025-12-04 00:57:16 +0000 UTC" firstStartedPulling="2025-12-04 00:57:17.601621366 +0000 UTC m=+610.003623216" lastFinishedPulling="2025-12-04 00:57:23.651521772 +0000 UTC m=+616.053523662" observedRunningTime="2025-12-04 00:57:24.284330427 +0000 UTC m=+616.686332297" watchObservedRunningTime="2025-12-04 00:57:24.293526468 +0000 UTC m=+616.695528338" Dec 04 00:57:24.313790 master-0 kubenswrapper[33142]: I1204 00:57:24.312783 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-92pkn" podStartSLOduration=1.803097487 podStartE2EDuration="8.312754712s" podCreationTimestamp="2025-12-04 00:57:16 +0000 UTC" firstStartedPulling="2025-12-04 00:57:17.13844315 +0000 UTC m=+609.540445000" lastFinishedPulling="2025-12-04 00:57:23.648100365 +0000 UTC m=+616.050102225" observedRunningTime="2025-12-04 00:57:24.306488674 +0000 UTC m=+616.708490534" watchObservedRunningTime="2025-12-04 00:57:24.312754712 +0000 UTC m=+616.714756562" Dec 04 00:57:24.342766 master-0 kubenswrapper[33142]: I1204 00:57:24.342144 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" podStartSLOduration=1.5325017189999999 podStartE2EDuration="10.342102482s" podCreationTimestamp="2025-12-04 00:57:14 +0000 UTC" firstStartedPulling="2025-12-04 00:57:14.910357035 +0000 UTC m=+607.312358885" lastFinishedPulling="2025-12-04 00:57:23.719957798 +0000 UTC m=+616.121959648" observedRunningTime="2025-12-04 00:57:24.338615113 +0000 UTC m=+616.740616983" watchObservedRunningTime="2025-12-04 00:57:24.342102482 +0000 UTC m=+616.744104342" Dec 04 00:57:24.362529 master-0 kubenswrapper[33142]: I1204 00:57:24.362406 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-qncth" podStartSLOduration=2.826635939 podStartE2EDuration="8.362370236s" podCreationTimestamp="2025-12-04 00:57:16 +0000 UTC" firstStartedPulling="2025-12-04 00:57:18.113477909 +0000 UTC m=+610.515479759" lastFinishedPulling="2025-12-04 00:57:23.649212206 +0000 UTC m=+616.051214056" observedRunningTime="2025-12-04 00:57:24.360556684 +0000 UTC m=+616.762558534" watchObservedRunningTime="2025-12-04 00:57:24.362370236 +0000 UTC m=+616.764372086" Dec 04 00:57:25.288490 master-0 kubenswrapper[33142]: I1204 00:57:25.288404 33142 generic.go:334] "Generic (PLEG): container finished" podID="cecefec9-7a77-44be-aa90-b8aeacf31584" containerID="d8e20ef235e9817acab1cdaa8e9325e79cf0aecdb756768736783239810fdfbc" exitCode=0 Dec 04 00:57:25.289172 master-0 kubenswrapper[33142]: I1204 00:57:25.288479 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerDied","Data":"d8e20ef235e9817acab1cdaa8e9325e79cf0aecdb756768736783239810fdfbc"} Dec 04 00:57:25.289172 master-0 kubenswrapper[33142]: I1204 00:57:25.288891 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:25.335946 master-0 kubenswrapper[33142]: I1204 00:57:25.335781 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" podStartSLOduration=3.444671445 podStartE2EDuration="9.335755587s" podCreationTimestamp="2025-12-04 00:57:16 +0000 UTC" firstStartedPulling="2025-12-04 00:57:17.756458037 +0000 UTC m=+610.158459887" lastFinishedPulling="2025-12-04 00:57:23.647542169 +0000 UTC m=+616.049544029" observedRunningTime="2025-12-04 00:57:24.429399832 +0000 UTC m=+616.831401702" watchObservedRunningTime="2025-12-04 00:57:25.335755587 +0000 UTC m=+617.737757447" Dec 04 00:57:26.064506 master-0 kubenswrapper[33142]: I1204 00:57:26.064422 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-clzsv" Dec 04 00:57:26.300786 master-0 kubenswrapper[33142]: I1204 00:57:26.300669 33142 generic.go:334] "Generic (PLEG): container finished" podID="cecefec9-7a77-44be-aa90-b8aeacf31584" containerID="1f8b79ac6711ecfd431dbc923e45d0d6763c5a921311794f211a934a3641a312" exitCode=0 Dec 04 00:57:26.301412 master-0 kubenswrapper[33142]: I1204 00:57:26.300781 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerDied","Data":"1f8b79ac6711ecfd431dbc923e45d0d6763c5a921311794f211a934a3641a312"} Dec 04 00:57:27.317187 master-0 kubenswrapper[33142]: I1204 00:57:27.317114 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"b19211adaa19e5f47aaf8a9304980a7a81a841b5ed595f01cc5ef6ce2b39a5f7"} Dec 04 00:57:27.317660 master-0 kubenswrapper[33142]: I1204 00:57:27.317191 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"c81ffce3b1718e52ac5ffac5311eac4f8b6dd0e2abc562ed60d5089d544b75e7"} Dec 04 00:57:27.317660 master-0 kubenswrapper[33142]: I1204 00:57:27.317211 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"8a000a8a7a297be6033716113ae322b1457dc9c53222201790496638eabbf037"} Dec 04 00:57:27.317660 master-0 kubenswrapper[33142]: I1204 00:57:27.317228 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"44d1dcf1e1741900050942723e917ab820d65cdcdfa81caad9be27db92cc9635"} Dec 04 00:57:27.471299 master-0 kubenswrapper[33142]: I1204 00:57:27.471132 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:27.471547 master-0 kubenswrapper[33142]: I1204 00:57:27.471534 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:27.476276 master-0 kubenswrapper[33142]: I1204 00:57:27.476188 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:28.331059 master-0 kubenswrapper[33142]: I1204 00:57:28.330958 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"c7d3ac5de1f17bbe82867cf0a5cca556d3cdac9843cec87998a915433d3d358a"} Dec 04 00:57:28.331059 master-0 kubenswrapper[33142]: I1204 00:57:28.331041 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-9pqnp" event={"ID":"cecefec9-7a77-44be-aa90-b8aeacf31584","Type":"ContainerStarted","Data":"89dfea6f955855c38fce3596d870ab6eefb7f3342da0499ba11290921ec58829"} Dec 04 00:57:28.336687 master-0 kubenswrapper[33142]: I1204 00:57:28.336635 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588c8f5cd5-nqpcn" Dec 04 00:57:28.363968 master-0 kubenswrapper[33142]: I1204 00:57:28.363545 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-9pqnp" podStartSLOduration=6.04281135 podStartE2EDuration="14.36350972s" podCreationTimestamp="2025-12-04 00:57:14 +0000 UTC" firstStartedPulling="2025-12-04 00:57:15.372140601 +0000 UTC m=+607.774142451" lastFinishedPulling="2025-12-04 00:57:23.692838971 +0000 UTC m=+616.094840821" observedRunningTime="2025-12-04 00:57:28.36172983 +0000 UTC m=+620.763731740" watchObservedRunningTime="2025-12-04 00:57:28.36350972 +0000 UTC m=+620.765511610" Dec 04 00:57:28.460636 master-0 kubenswrapper[33142]: I1204 00:57:28.460494 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:57:29.341495 master-0 kubenswrapper[33142]: I1204 00:57:29.341439 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:30.088562 master-0 kubenswrapper[33142]: I1204 00:57:30.088454 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:30.125701 master-0 kubenswrapper[33142]: I1204 00:57:30.125622 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:31.995424 master-0 kubenswrapper[33142]: I1204 00:57:31.995365 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-92pkn" Dec 04 00:57:34.420611 master-0 kubenswrapper[33142]: I1204 00:57:34.418141 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-t67dx" Dec 04 00:57:34.576458 master-0 kubenswrapper[33142]: I1204 00:57:34.576391 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-f8648f98b-x4fnw" Dec 04 00:57:36.958674 master-0 kubenswrapper[33142]: I1204 00:57:36.958553 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-6cndf" Dec 04 00:57:42.459060 master-0 kubenswrapper[33142]: I1204 00:57:42.458974 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/vg-manager-z7mgw"] Dec 04 00:57:42.460250 master-0 kubenswrapper[33142]: I1204 00:57:42.460217 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.464990 master-0 kubenswrapper[33142]: I1204 00:57:42.464886 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"vg-manager-metrics-cert" Dec 04 00:57:42.473578 master-0 kubenswrapper[33142]: I1204 00:57:42.473422 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-z7mgw"] Dec 04 00:57:42.620961 master-0 kubenswrapper[33142]: I1204 00:57:42.620884 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-device-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621202 master-0 kubenswrapper[33142]: I1204 00:57:42.621092 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-file-lock-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621279 master-0 kubenswrapper[33142]: I1204 00:57:42.621202 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-run-udev\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621279 master-0 kubenswrapper[33142]: I1204 00:57:42.621237 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-lvmd-config\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621279 master-0 kubenswrapper[33142]: I1204 00:57:42.621257 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-csi-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621279 master-0 kubenswrapper[33142]: I1204 00:57:42.621277 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-sys\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621425 master-0 kubenswrapper[33142]: I1204 00:57:42.621309 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-node-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621608 master-0 kubenswrapper[33142]: I1204 00:57:42.621532 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-registration-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621664 master-0 kubenswrapper[33142]: I1204 00:57:42.621622 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c339f1-77e8-42e3-8390-bce5431b3e27-metrics-cert\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621868 master-0 kubenswrapper[33142]: I1204 00:57:42.621824 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-pod-volumes-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.621944 master-0 kubenswrapper[33142]: I1204 00:57:42.621902 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp5dp\" (UniqueName: \"kubernetes.io/projected/99c339f1-77e8-42e3-8390-bce5431b3e27-kube-api-access-sp5dp\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723416 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-csi-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723478 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-sys\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723506 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-node-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723542 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-registration-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723563 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c339f1-77e8-42e3-8390-bce5431b3e27-metrics-cert\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.723616 master-0 kubenswrapper[33142]: I1204 00:57:42.723597 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-sys\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723704 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-pod-volumes-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723623 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-pod-volumes-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723754 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sp5dp\" (UniqueName: \"kubernetes.io/projected/99c339f1-77e8-42e3-8390-bce5431b3e27-kube-api-access-sp5dp\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723793 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-device-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723789 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-csi-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723781 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-registration-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723886 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-file-lock-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.724081 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-run-udev\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.724154 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-lvmd-config\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.723901 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-node-plugin-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.724346 master-0 kubenswrapper[33142]: I1204 00:57:42.724326 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-run-udev\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.725219 master-0 kubenswrapper[33142]: I1204 00:57:42.724449 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-lvmd-config\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.725219 master-0 kubenswrapper[33142]: I1204 00:57:42.724719 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-device-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.725641 master-0 kubenswrapper[33142]: I1204 00:57:42.725596 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/99c339f1-77e8-42e3-8390-bce5431b3e27-file-lock-dir\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.728416 master-0 kubenswrapper[33142]: I1204 00:57:42.728366 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99c339f1-77e8-42e3-8390-bce5431b3e27-metrics-cert\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.741190 master-0 kubenswrapper[33142]: I1204 00:57:42.741119 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp5dp\" (UniqueName: \"kubernetes.io/projected/99c339f1-77e8-42e3-8390-bce5431b3e27-kube-api-access-sp5dp\") pod \"vg-manager-z7mgw\" (UID: \"99c339f1-77e8-42e3-8390-bce5431b3e27\") " pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:42.824266 master-0 kubenswrapper[33142]: I1204 00:57:42.824170 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:43.274340 master-0 kubenswrapper[33142]: I1204 00:57:43.274270 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-z7mgw"] Dec 04 00:57:43.531839 master-0 kubenswrapper[33142]: I1204 00:57:43.531672 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-z7mgw" event={"ID":"99c339f1-77e8-42e3-8390-bce5431b3e27","Type":"ContainerStarted","Data":"57979fecdb5c0bf471138ac23ad363ec1f2364f9bcc2ad678ced03b7fefcf8a2"} Dec 04 00:57:44.542392 master-0 kubenswrapper[33142]: I1204 00:57:44.542296 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-z7mgw" event={"ID":"99c339f1-77e8-42e3-8390-bce5431b3e27","Type":"ContainerStarted","Data":"ef8d3d8f778dee5f4b7bed3a6e52a264e9428772d8f9abe29709a3fb28bef2a1"} Dec 04 00:57:44.576190 master-0 kubenswrapper[33142]: I1204 00:57:44.575484 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/vg-manager-z7mgw" podStartSLOduration=2.575463686 podStartE2EDuration="2.575463686s" podCreationTimestamp="2025-12-04 00:57:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:57:44.568352804 +0000 UTC m=+636.970354674" watchObservedRunningTime="2025-12-04 00:57:44.575463686 +0000 UTC m=+636.977465546" Dec 04 00:57:45.092169 master-0 kubenswrapper[33142]: I1204 00:57:45.092078 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-9pqnp" Dec 04 00:57:46.568377 master-0 kubenswrapper[33142]: I1204 00:57:46.568273 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-z7mgw_99c339f1-77e8-42e3-8390-bce5431b3e27/vg-manager/0.log" Dec 04 00:57:46.569129 master-0 kubenswrapper[33142]: I1204 00:57:46.568389 33142 generic.go:334] "Generic (PLEG): container finished" podID="99c339f1-77e8-42e3-8390-bce5431b3e27" containerID="ef8d3d8f778dee5f4b7bed3a6e52a264e9428772d8f9abe29709a3fb28bef2a1" exitCode=1 Dec 04 00:57:46.569129 master-0 kubenswrapper[33142]: I1204 00:57:46.568442 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-z7mgw" event={"ID":"99c339f1-77e8-42e3-8390-bce5431b3e27","Type":"ContainerDied","Data":"ef8d3d8f778dee5f4b7bed3a6e52a264e9428772d8f9abe29709a3fb28bef2a1"} Dec 04 00:57:46.569320 master-0 kubenswrapper[33142]: I1204 00:57:46.569269 33142 scope.go:117] "RemoveContainer" containerID="ef8d3d8f778dee5f4b7bed3a6e52a264e9428772d8f9abe29709a3fb28bef2a1" Dec 04 00:57:46.966432 master-0 kubenswrapper[33142]: I1204 00:57:46.966193 33142 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock" Dec 04 00:57:47.586089 master-0 kubenswrapper[33142]: I1204 00:57:47.586004 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-z7mgw_99c339f1-77e8-42e3-8390-bce5431b3e27/vg-manager/0.log" Dec 04 00:57:47.586089 master-0 kubenswrapper[33142]: I1204 00:57:47.586084 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-z7mgw" event={"ID":"99c339f1-77e8-42e3-8390-bce5431b3e27","Type":"ContainerStarted","Data":"925e7cdb826dfe702fbc64fef38720164bcd6a9cd4da6e7c6f7db0ac59ee4d09"} Dec 04 00:57:47.909333 master-0 kubenswrapper[33142]: I1204 00:57:47.908035 33142 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock","Timestamp":"2025-12-04T00:57:46.966267194Z","Handler":null,"Name":""} Dec 04 00:57:47.911144 master-0 kubenswrapper[33142]: I1204 00:57:47.911100 33142 csi_plugin.go:100] kubernetes.io/csi: Trying to validate a new CSI Driver with name: topolvm.io endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock versions: 1.0.0 Dec 04 00:57:47.911144 master-0 kubenswrapper[33142]: I1204 00:57:47.911137 33142 csi_plugin.go:113] kubernetes.io/csi: Register new plugin with name: topolvm.io at endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock Dec 04 00:57:52.825186 master-0 kubenswrapper[33142]: I1204 00:57:52.825070 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:52.828092 master-0 kubenswrapper[33142]: I1204 00:57:52.828021 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:53.521059 master-0 kubenswrapper[33142]: I1204 00:57:53.520922 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-7d4f88899d-xxj4h" podUID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" containerName="console" containerID="cri-o://9525cb71fa0036f637ba3aa3358140ff68120fe0721cc90c249e3ea3430ad984" gracePeriod=15 Dec 04 00:57:53.682520 master-0 kubenswrapper[33142]: I1204 00:57:53.682439 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d4f88899d-xxj4h_79f11cf6-069f-4890-a61d-1f3c1ae5ad97/console/0.log" Dec 04 00:57:53.682742 master-0 kubenswrapper[33142]: I1204 00:57:53.682533 33142 generic.go:334] "Generic (PLEG): container finished" podID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" containerID="9525cb71fa0036f637ba3aa3358140ff68120fe0721cc90c249e3ea3430ad984" exitCode=2 Dec 04 00:57:53.682742 master-0 kubenswrapper[33142]: I1204 00:57:53.682661 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4f88899d-xxj4h" event={"ID":"79f11cf6-069f-4890-a61d-1f3c1ae5ad97","Type":"ContainerDied","Data":"9525cb71fa0036f637ba3aa3358140ff68120fe0721cc90c249e3ea3430ad984"} Dec 04 00:57:53.683014 master-0 kubenswrapper[33142]: I1204 00:57:53.682973 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:53.684642 master-0 kubenswrapper[33142]: I1204 00:57:53.684600 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/vg-manager-z7mgw" Dec 04 00:57:54.122523 master-0 kubenswrapper[33142]: I1204 00:57:54.122471 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d4f88899d-xxj4h_79f11cf6-069f-4890-a61d-1f3c1ae5ad97/console/0.log" Dec 04 00:57:54.123018 master-0 kubenswrapper[33142]: I1204 00:57:54.122992 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:57:54.299168 master-0 kubenswrapper[33142]: I1204 00:57:54.299050 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.299438 master-0 kubenswrapper[33142]: I1204 00:57:54.299180 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.299871 master-0 kubenswrapper[33142]: I1204 00:57:54.299830 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.299960 master-0 kubenswrapper[33142]: I1204 00:57:54.299895 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.300047 master-0 kubenswrapper[33142]: I1204 00:57:54.300009 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.300100 master-0 kubenswrapper[33142]: I1204 00:57:54.300070 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.300100 master-0 kubenswrapper[33142]: I1204 00:57:54.300092 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca\") pod \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\" (UID: \"79f11cf6-069f-4890-a61d-1f3c1ae5ad97\") " Dec 04 00:57:54.301137 master-0 kubenswrapper[33142]: I1204 00:57:54.301081 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config" (OuterVolumeSpecName: "console-config") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:57:54.301206 master-0 kubenswrapper[33142]: I1204 00:57:54.301121 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca" (OuterVolumeSpecName: "service-ca") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:57:54.301260 master-0 kubenswrapper[33142]: I1204 00:57:54.301207 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:57:54.301417 master-0 kubenswrapper[33142]: I1204 00:57:54.301351 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 00:57:54.304223 master-0 kubenswrapper[33142]: I1204 00:57:54.304114 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:57:54.306953 master-0 kubenswrapper[33142]: I1204 00:57:54.305496 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 00:57:54.306953 master-0 kubenswrapper[33142]: I1204 00:57:54.306085 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq" (OuterVolumeSpecName: "kube-api-access-z9tqq") pod "79f11cf6-069f-4890-a61d-1f3c1ae5ad97" (UID: "79f11cf6-069f-4890-a61d-1f3c1ae5ad97"). InnerVolumeSpecName "kube-api-access-z9tqq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:57:54.403353 master-0 kubenswrapper[33142]: I1204 00:57:54.403273 33142 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.403353 master-0 kubenswrapper[33142]: I1204 00:57:54.403330 33142 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.403353 master-0 kubenswrapper[33142]: I1204 00:57:54.403345 33142 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.403353 master-0 kubenswrapper[33142]: I1204 00:57:54.403362 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-kube-api-access-z9tqq\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.403353 master-0 kubenswrapper[33142]: I1204 00:57:54.403373 33142 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.404010 master-0 kubenswrapper[33142]: I1204 00:57:54.403388 33142 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.404010 master-0 kubenswrapper[33142]: I1204 00:57:54.403400 33142 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79f11cf6-069f-4890-a61d-1f3c1ae5ad97-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 00:57:54.694498 master-0 kubenswrapper[33142]: I1204 00:57:54.694409 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d4f88899d-xxj4h_79f11cf6-069f-4890-a61d-1f3c1ae5ad97/console/0.log" Dec 04 00:57:54.694896 master-0 kubenswrapper[33142]: I1204 00:57:54.694602 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4f88899d-xxj4h" event={"ID":"79f11cf6-069f-4890-a61d-1f3c1ae5ad97","Type":"ContainerDied","Data":"8d65546d635c3ddf4c856a766ee9990190d59cbd9ae928bac29f4f94d9f894e3"} Dec 04 00:57:54.694896 master-0 kubenswrapper[33142]: I1204 00:57:54.694719 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4f88899d-xxj4h" Dec 04 00:57:54.694896 master-0 kubenswrapper[33142]: I1204 00:57:54.694738 33142 scope.go:117] "RemoveContainer" containerID="9525cb71fa0036f637ba3aa3358140ff68120fe0721cc90c249e3ea3430ad984" Dec 04 00:57:54.775885 master-0 kubenswrapper[33142]: I1204 00:57:54.775750 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:57:54.785456 master-0 kubenswrapper[33142]: I1204 00:57:54.785381 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d4f88899d-xxj4h"] Dec 04 00:57:55.913741 master-0 kubenswrapper[33142]: I1204 00:57:55.913620 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" path="/var/lib/kubelet/pods/79f11cf6-069f-4890-a61d-1f3c1ae5ad97/volumes" Dec 04 00:57:56.927211 master-0 kubenswrapper[33142]: I1204 00:57:56.927134 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-kxnrr"] Dec 04 00:57:56.927999 master-0 kubenswrapper[33142]: E1204 00:57:56.927579 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" containerName="console" Dec 04 00:57:56.927999 master-0 kubenswrapper[33142]: I1204 00:57:56.927599 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" containerName="console" Dec 04 00:57:56.927999 master-0 kubenswrapper[33142]: I1204 00:57:56.927791 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="79f11cf6-069f-4890-a61d-1f3c1ae5ad97" containerName="console" Dec 04 00:57:56.928544 master-0 kubenswrapper[33142]: I1204 00:57:56.928501 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:57:56.933109 master-0 kubenswrapper[33142]: I1204 00:57:56.931061 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Dec 04 00:57:56.933109 master-0 kubenswrapper[33142]: I1204 00:57:56.931350 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Dec 04 00:57:56.947423 master-0 kubenswrapper[33142]: I1204 00:57:56.947364 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-kxnrr"] Dec 04 00:57:56.960125 master-0 kubenswrapper[33142]: I1204 00:57:56.960052 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shm26\" (UniqueName: \"kubernetes.io/projected/ef9d36fe-3a75-4a08-9e66-0322d6e3a765-kube-api-access-shm26\") pod \"openstack-operator-index-kxnrr\" (UID: \"ef9d36fe-3a75-4a08-9e66-0322d6e3a765\") " pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:57:57.062864 master-0 kubenswrapper[33142]: I1204 00:57:57.062761 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-shm26\" (UniqueName: \"kubernetes.io/projected/ef9d36fe-3a75-4a08-9e66-0322d6e3a765-kube-api-access-shm26\") pod \"openstack-operator-index-kxnrr\" (UID: \"ef9d36fe-3a75-4a08-9e66-0322d6e3a765\") " pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:57:57.082627 master-0 kubenswrapper[33142]: I1204 00:57:57.082564 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-shm26\" (UniqueName: \"kubernetes.io/projected/ef9d36fe-3a75-4a08-9e66-0322d6e3a765-kube-api-access-shm26\") pod \"openstack-operator-index-kxnrr\" (UID: \"ef9d36fe-3a75-4a08-9e66-0322d6e3a765\") " pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:57:57.245174 master-0 kubenswrapper[33142]: I1204 00:57:57.244990 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:57:57.726658 master-0 kubenswrapper[33142]: W1204 00:57:57.726571 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9d36fe_3a75_4a08_9e66_0322d6e3a765.slice/crio-7e167da8caa6ebe73aee2b9445071e8b15fb2919f6a844ed4f6c6e0c89d7be3b WatchSource:0}: Error finding container 7e167da8caa6ebe73aee2b9445071e8b15fb2919f6a844ed4f6c6e0c89d7be3b: Status 404 returned error can't find the container with id 7e167da8caa6ebe73aee2b9445071e8b15fb2919f6a844ed4f6c6e0c89d7be3b Dec 04 00:57:57.728222 master-0 kubenswrapper[33142]: I1204 00:57:57.728168 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-kxnrr"] Dec 04 00:57:58.739665 master-0 kubenswrapper[33142]: I1204 00:57:58.739573 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-kxnrr" event={"ID":"ef9d36fe-3a75-4a08-9e66-0322d6e3a765","Type":"ContainerStarted","Data":"7e167da8caa6ebe73aee2b9445071e8b15fb2919f6a844ed4f6c6e0c89d7be3b"} Dec 04 00:57:59.753554 master-0 kubenswrapper[33142]: I1204 00:57:59.753463 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-kxnrr" event={"ID":"ef9d36fe-3a75-4a08-9e66-0322d6e3a765","Type":"ContainerStarted","Data":"a7df079c81967c4af1551382fa0294728c07525f2f544afe5ba18ead118b5f5e"} Dec 04 00:58:07.245519 master-0 kubenswrapper[33142]: I1204 00:58:07.245426 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:58:07.245519 master-0 kubenswrapper[33142]: I1204 00:58:07.245533 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:58:07.279761 master-0 kubenswrapper[33142]: I1204 00:58:07.279681 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:58:07.317026 master-0 kubenswrapper[33142]: I1204 00:58:07.316835 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-kxnrr" podStartSLOduration=10.498368789 podStartE2EDuration="11.316803767s" podCreationTimestamp="2025-12-04 00:57:56 +0000 UTC" firstStartedPulling="2025-12-04 00:57:57.729841467 +0000 UTC m=+650.131843347" lastFinishedPulling="2025-12-04 00:57:58.548276465 +0000 UTC m=+650.950278325" observedRunningTime="2025-12-04 00:57:59.775048368 +0000 UTC m=+652.177050288" watchObservedRunningTime="2025-12-04 00:58:07.316803767 +0000 UTC m=+659.718805617" Dec 04 00:58:07.885157 master-0 kubenswrapper[33142]: I1204 00:58:07.885076 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-kxnrr" Dec 04 00:58:12.952570 master-0 kubenswrapper[33142]: I1204 00:58:12.952492 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px"] Dec 04 00:58:12.955098 master-0 kubenswrapper[33142]: I1204 00:58:12.955035 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:12.991588 master-0 kubenswrapper[33142]: I1204 00:58:12.990653 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:12.991588 master-0 kubenswrapper[33142]: I1204 00:58:12.991151 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrn9\" (UniqueName: \"kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:12.991588 master-0 kubenswrapper[33142]: I1204 00:58:12.991224 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:12.995890 master-0 kubenswrapper[33142]: I1204 00:58:12.995327 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px"] Dec 04 00:58:13.093361 master-0 kubenswrapper[33142]: I1204 00:58:13.093216 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrn9\" (UniqueName: \"kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.093361 master-0 kubenswrapper[33142]: I1204 00:58:13.093289 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.093688 master-0 kubenswrapper[33142]: I1204 00:58:13.093387 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.094218 master-0 kubenswrapper[33142]: I1204 00:58:13.094137 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.095229 master-0 kubenswrapper[33142]: I1204 00:58:13.094446 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.113088 master-0 kubenswrapper[33142]: I1204 00:58:13.113018 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrn9\" (UniqueName: \"kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9\") pod \"98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.280889 master-0 kubenswrapper[33142]: I1204 00:58:13.280724 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:13.770067 master-0 kubenswrapper[33142]: I1204 00:58:13.766583 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px"] Dec 04 00:58:13.770067 master-0 kubenswrapper[33142]: W1204 00:58:13.766739 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7b6cd0_ea0b_441a_8867_d021a0cd5cd6.slice/crio-bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6 WatchSource:0}: Error finding container bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6: Status 404 returned error can't find the container with id bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6 Dec 04 00:58:13.915762 master-0 kubenswrapper[33142]: I1204 00:58:13.915670 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" event={"ID":"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6","Type":"ContainerStarted","Data":"bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6"} Dec 04 00:58:14.924624 master-0 kubenswrapper[33142]: I1204 00:58:14.924560 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" event={"ID":"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6","Type":"ContainerDied","Data":"f0336dda3f8c78937698e69a2a3b47c0ddcd38584f1af58aa64e696fa3d778ff"} Dec 04 00:58:14.929451 master-0 kubenswrapper[33142]: I1204 00:58:14.924497 33142 generic.go:334] "Generic (PLEG): container finished" podID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerID="f0336dda3f8c78937698e69a2a3b47c0ddcd38584f1af58aa64e696fa3d778ff" exitCode=0 Dec 04 00:58:15.943525 master-0 kubenswrapper[33142]: I1204 00:58:15.943357 33142 generic.go:334] "Generic (PLEG): container finished" podID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerID="0289a5c54116507ce3eff9acf90858e8bcfce08d7758c1e42351db68bdc6ba68" exitCode=0 Dec 04 00:58:15.943525 master-0 kubenswrapper[33142]: I1204 00:58:15.943439 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" event={"ID":"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6","Type":"ContainerDied","Data":"0289a5c54116507ce3eff9acf90858e8bcfce08d7758c1e42351db68bdc6ba68"} Dec 04 00:58:16.961975 master-0 kubenswrapper[33142]: I1204 00:58:16.961807 33142 generic.go:334] "Generic (PLEG): container finished" podID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerID="33e4751221041a83a7617b3cb66f45761948bd9516a095fc9793c1d53ab8d9c0" exitCode=0 Dec 04 00:58:16.961975 master-0 kubenswrapper[33142]: I1204 00:58:16.961890 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" event={"ID":"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6","Type":"ContainerDied","Data":"33e4751221041a83a7617b3cb66f45761948bd9516a095fc9793c1d53ab8d9c0"} Dec 04 00:58:18.328096 master-0 kubenswrapper[33142]: I1204 00:58:18.328002 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:18.504337 master-0 kubenswrapper[33142]: I1204 00:58:18.504219 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util\") pod \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " Dec 04 00:58:18.504698 master-0 kubenswrapper[33142]: I1204 00:58:18.504484 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrn9\" (UniqueName: \"kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9\") pod \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " Dec 04 00:58:18.504698 master-0 kubenswrapper[33142]: I1204 00:58:18.504649 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle\") pod \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\" (UID: \"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6\") " Dec 04 00:58:18.506138 master-0 kubenswrapper[33142]: I1204 00:58:18.506078 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle" (OuterVolumeSpecName: "bundle") pod "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" (UID: "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:58:18.508046 master-0 kubenswrapper[33142]: I1204 00:58:18.507948 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9" (OuterVolumeSpecName: "kube-api-access-5wrn9") pod "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" (UID: "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6"). InnerVolumeSpecName "kube-api-access-5wrn9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:58:18.535194 master-0 kubenswrapper[33142]: I1204 00:58:18.534902 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util" (OuterVolumeSpecName: "util") pod "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" (UID: "3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 00:58:18.607166 master-0 kubenswrapper[33142]: I1204 00:58:18.607059 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5wrn9\" (UniqueName: \"kubernetes.io/projected/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-kube-api-access-5wrn9\") on node \"master-0\" DevicePath \"\"" Dec 04 00:58:18.607166 master-0 kubenswrapper[33142]: I1204 00:58:18.607148 33142 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 00:58:18.607166 master-0 kubenswrapper[33142]: I1204 00:58:18.607168 33142 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6-util\") on node \"master-0\" DevicePath \"\"" Dec 04 00:58:18.991446 master-0 kubenswrapper[33142]: I1204 00:58:18.991316 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" event={"ID":"3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6","Type":"ContainerDied","Data":"bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6"} Dec 04 00:58:18.991446 master-0 kubenswrapper[33142]: I1204 00:58:18.991388 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb9aa46d3dc698c04100b885cbf10b75c3680a219459fecf8e95a07db35228f6" Dec 04 00:58:18.991446 master-0 kubenswrapper[33142]: I1204 00:58:18.991405 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/98dc3bd0b5c63de8bc52e3558b9d3e72fafafb6fd127fd2510d2206864hl5px" Dec 04 00:58:29.808025 master-0 kubenswrapper[33142]: I1204 00:58:29.807890 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: E1204 00:58:29.808319 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="extract" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: I1204 00:58:29.808341 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="extract" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: E1204 00:58:29.808358 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="pull" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: I1204 00:58:29.808364 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="pull" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: E1204 00:58:29.808380 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="util" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: I1204 00:58:29.808385 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="util" Dec 04 00:58:29.808966 master-0 kubenswrapper[33142]: I1204 00:58:29.808577 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a7b6cd0-ea0b-441a-8867-d021a0cd5cd6" containerName="extract" Dec 04 00:58:29.809189 master-0 kubenswrapper[33142]: I1204 00:58:29.809151 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:29.829808 master-0 kubenswrapper[33142]: I1204 00:58:29.829718 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjq4j\" (UniqueName: \"kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j\") pod \"openstack-operator-controller-operator-7dd5c7bb7c-69wc8\" (UID: \"0b341759-f547-47d2-8e44-2fcb8ecf446e\") " pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:29.848140 master-0 kubenswrapper[33142]: I1204 00:58:29.848046 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:29.931806 master-0 kubenswrapper[33142]: I1204 00:58:29.931716 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjq4j\" (UniqueName: \"kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j\") pod \"openstack-operator-controller-operator-7dd5c7bb7c-69wc8\" (UID: \"0b341759-f547-47d2-8e44-2fcb8ecf446e\") " pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:29.953540 master-0 kubenswrapper[33142]: I1204 00:58:29.953480 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjq4j\" (UniqueName: \"kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j\") pod \"openstack-operator-controller-operator-7dd5c7bb7c-69wc8\" (UID: \"0b341759-f547-47d2-8e44-2fcb8ecf446e\") " pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:30.133503 master-0 kubenswrapper[33142]: I1204 00:58:30.133430 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:30.647429 master-0 kubenswrapper[33142]: W1204 00:58:30.647355 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b341759_f547_47d2_8e44_2fcb8ecf446e.slice/crio-acdf6672badf1812b1553fed0e182759eb3bf13327df13aadb9bf11112ee2ee9 WatchSource:0}: Error finding container acdf6672badf1812b1553fed0e182759eb3bf13327df13aadb9bf11112ee2ee9: Status 404 returned error can't find the container with id acdf6672badf1812b1553fed0e182759eb3bf13327df13aadb9bf11112ee2ee9 Dec 04 00:58:30.655704 master-0 kubenswrapper[33142]: I1204 00:58:30.654808 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:31.115573 master-0 kubenswrapper[33142]: I1204 00:58:31.115475 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" event={"ID":"0b341759-f547-47d2-8e44-2fcb8ecf446e","Type":"ContainerStarted","Data":"acdf6672badf1812b1553fed0e182759eb3bf13327df13aadb9bf11112ee2ee9"} Dec 04 00:58:35.156645 master-0 kubenswrapper[33142]: I1204 00:58:35.156561 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" event={"ID":"0b341759-f547-47d2-8e44-2fcb8ecf446e","Type":"ContainerStarted","Data":"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14"} Dec 04 00:58:35.157869 master-0 kubenswrapper[33142]: I1204 00:58:35.157840 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:35.195630 master-0 kubenswrapper[33142]: I1204 00:58:35.195514 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" podStartSLOduration=2.112474479 podStartE2EDuration="6.19549295s" podCreationTimestamp="2025-12-04 00:58:29 +0000 UTC" firstStartedPulling="2025-12-04 00:58:30.651754962 +0000 UTC m=+683.053756852" lastFinishedPulling="2025-12-04 00:58:34.734773473 +0000 UTC m=+687.136775323" observedRunningTime="2025-12-04 00:58:35.190136968 +0000 UTC m=+687.592138818" watchObservedRunningTime="2025-12-04 00:58:35.19549295 +0000 UTC m=+687.597494790" Dec 04 00:58:40.139184 master-0 kubenswrapper[33142]: I1204 00:58:40.138996 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:45.889550 master-0 kubenswrapper[33142]: I1204 00:58:45.889473 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q"] Dec 04 00:58:45.890880 master-0 kubenswrapper[33142]: I1204 00:58:45.890843 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:45.997671 master-0 kubenswrapper[33142]: I1204 00:58:45.997553 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q"] Dec 04 00:58:46.072074 master-0 kubenswrapper[33142]: I1204 00:58:46.071983 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54c6\" (UniqueName: \"kubernetes.io/projected/0572aaa4-c999-4cd7-96f2-d73681094803-kube-api-access-k54c6\") pod \"openstack-operator-controller-operator-7b84d49558-s8d4q\" (UID: \"0572aaa4-c999-4cd7-96f2-d73681094803\") " pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:46.175244 master-0 kubenswrapper[33142]: I1204 00:58:46.175042 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k54c6\" (UniqueName: \"kubernetes.io/projected/0572aaa4-c999-4cd7-96f2-d73681094803-kube-api-access-k54c6\") pod \"openstack-operator-controller-operator-7b84d49558-s8d4q\" (UID: \"0572aaa4-c999-4cd7-96f2-d73681094803\") " pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:46.197165 master-0 kubenswrapper[33142]: I1204 00:58:46.197088 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54c6\" (UniqueName: \"kubernetes.io/projected/0572aaa4-c999-4cd7-96f2-d73681094803-kube-api-access-k54c6\") pod \"openstack-operator-controller-operator-7b84d49558-s8d4q\" (UID: \"0572aaa4-c999-4cd7-96f2-d73681094803\") " pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:46.221384 master-0 kubenswrapper[33142]: I1204 00:58:46.221241 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:46.746846 master-0 kubenswrapper[33142]: I1204 00:58:46.746725 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q"] Dec 04 00:58:47.315194 master-0 kubenswrapper[33142]: I1204 00:58:47.315105 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" event={"ID":"0572aaa4-c999-4cd7-96f2-d73681094803","Type":"ContainerStarted","Data":"4308308a8cfd74e9ec97bfa248836fd48a67056946fce3121ef4e266eaabdefa"} Dec 04 00:58:47.315732 master-0 kubenswrapper[33142]: I1204 00:58:47.315265 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:47.315732 master-0 kubenswrapper[33142]: I1204 00:58:47.315314 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" event={"ID":"0572aaa4-c999-4cd7-96f2-d73681094803","Type":"ContainerStarted","Data":"e50238eee3f2457c4220a24a2cde4bb4a405cbf76e52996bf1efab44d1b5b6b4"} Dec 04 00:58:47.354800 master-0 kubenswrapper[33142]: I1204 00:58:47.354670 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" podStartSLOduration=2.354618289 podStartE2EDuration="2.354618289s" podCreationTimestamp="2025-12-04 00:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 00:58:47.348480646 +0000 UTC m=+699.750482496" watchObservedRunningTime="2025-12-04 00:58:47.354618289 +0000 UTC m=+699.756620149" Dec 04 00:58:56.228638 master-0 kubenswrapper[33142]: I1204 00:58:56.228561 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-7b84d49558-s8d4q" Dec 04 00:58:56.328265 master-0 kubenswrapper[33142]: I1204 00:58:56.328175 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:56.328528 master-0 kubenswrapper[33142]: I1204 00:58:56.328449 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" podUID="0b341759-f547-47d2-8e44-2fcb8ecf446e" containerName="operator" containerID="cri-o://9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14" gracePeriod=10 Dec 04 00:58:56.793488 master-0 kubenswrapper[33142]: I1204 00:58:56.793372 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:56.899652 master-0 kubenswrapper[33142]: I1204 00:58:56.899577 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjq4j\" (UniqueName: \"kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j\") pod \"0b341759-f547-47d2-8e44-2fcb8ecf446e\" (UID: \"0b341759-f547-47d2-8e44-2fcb8ecf446e\") " Dec 04 00:58:56.905378 master-0 kubenswrapper[33142]: I1204 00:58:56.905126 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j" (OuterVolumeSpecName: "kube-api-access-wjq4j") pod "0b341759-f547-47d2-8e44-2fcb8ecf446e" (UID: "0b341759-f547-47d2-8e44-2fcb8ecf446e"). InnerVolumeSpecName "kube-api-access-wjq4j". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 00:58:57.004068 master-0 kubenswrapper[33142]: I1204 00:58:57.002957 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjq4j\" (UniqueName: \"kubernetes.io/projected/0b341759-f547-47d2-8e44-2fcb8ecf446e-kube-api-access-wjq4j\") on node \"master-0\" DevicePath \"\"" Dec 04 00:58:57.421981 master-0 kubenswrapper[33142]: I1204 00:58:57.421835 33142 generic.go:334] "Generic (PLEG): container finished" podID="0b341759-f547-47d2-8e44-2fcb8ecf446e" containerID="9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14" exitCode=0 Dec 04 00:58:57.421981 master-0 kubenswrapper[33142]: I1204 00:58:57.421911 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" Dec 04 00:58:57.423116 master-0 kubenswrapper[33142]: I1204 00:58:57.421958 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" event={"ID":"0b341759-f547-47d2-8e44-2fcb8ecf446e","Type":"ContainerDied","Data":"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14"} Dec 04 00:58:57.423116 master-0 kubenswrapper[33142]: I1204 00:58:57.422204 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8" event={"ID":"0b341759-f547-47d2-8e44-2fcb8ecf446e","Type":"ContainerDied","Data":"acdf6672badf1812b1553fed0e182759eb3bf13327df13aadb9bf11112ee2ee9"} Dec 04 00:58:57.423116 master-0 kubenswrapper[33142]: I1204 00:58:57.422244 33142 scope.go:117] "RemoveContainer" containerID="9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14" Dec 04 00:58:57.447859 master-0 kubenswrapper[33142]: I1204 00:58:57.445833 33142 scope.go:117] "RemoveContainer" containerID="9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14" Dec 04 00:58:57.447859 master-0 kubenswrapper[33142]: E1204 00:58:57.446432 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14\": container with ID starting with 9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14 not found: ID does not exist" containerID="9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14" Dec 04 00:58:57.447859 master-0 kubenswrapper[33142]: I1204 00:58:57.446510 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14"} err="failed to get container status \"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14\": rpc error: code = NotFound desc = could not find container \"9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14\": container with ID starting with 9b10d731b2953ffb58a8a67660eaec7267a6710dffb671cb9b97795ee0d2dc14 not found: ID does not exist" Dec 04 00:58:57.470412 master-0 kubenswrapper[33142]: I1204 00:58:57.470334 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:57.483266 master-0 kubenswrapper[33142]: I1204 00:58:57.483127 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-7dd5c7bb7c-69wc8"] Dec 04 00:58:57.911400 master-0 kubenswrapper[33142]: I1204 00:58:57.911257 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b341759-f547-47d2-8e44-2fcb8ecf446e" path="/var/lib/kubelet/pods/0b341759-f547-47d2-8e44-2fcb8ecf446e/volumes" Dec 04 00:59:08.644169 master-0 kubenswrapper[33142]: I1204 00:59:08.644114 33142 scope.go:117] "RemoveContainer" containerID="dafec2eef03d87ac491eeba79aebadb73a2644b0bfc16f504f9227d6a66b8866" Dec 04 00:59:54.928374 master-0 kubenswrapper[33142]: I1204 00:59:54.928269 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h"] Dec 04 00:59:54.929109 master-0 kubenswrapper[33142]: E1204 00:59:54.928792 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0b341759-f547-47d2-8e44-2fcb8ecf446e" containerName="operator" Dec 04 00:59:54.929109 master-0 kubenswrapper[33142]: I1204 00:59:54.928813 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b341759-f547-47d2-8e44-2fcb8ecf446e" containerName="operator" Dec 04 00:59:54.929109 master-0 kubenswrapper[33142]: I1204 00:59:54.929060 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="0b341759-f547-47d2-8e44-2fcb8ecf446e" containerName="operator" Dec 04 00:59:54.930174 master-0 kubenswrapper[33142]: I1204 00:59:54.930139 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 00:59:54.955797 master-0 kubenswrapper[33142]: I1204 00:59:54.955713 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz"] Dec 04 00:59:54.958094 master-0 kubenswrapper[33142]: I1204 00:59:54.958041 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 00:59:54.964653 master-0 kubenswrapper[33142]: I1204 00:59:54.964594 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h"] Dec 04 00:59:54.987562 master-0 kubenswrapper[33142]: I1204 00:59:54.987475 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n"] Dec 04 00:59:54.990709 master-0 kubenswrapper[33142]: I1204 00:59:54.989551 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 00:59:55.022532 master-0 kubenswrapper[33142]: I1204 00:59:55.021206 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz"] Dec 04 00:59:55.038995 master-0 kubenswrapper[33142]: I1204 00:59:55.038849 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv79p\" (UniqueName: \"kubernetes.io/projected/c2a33c89-5b90-4544-9198-31d26f2847c2-kube-api-access-bv79p\") pod \"barbican-operator-controller-manager-5cd89994b5-tcq9h\" (UID: \"c2a33c89-5b90-4544-9198-31d26f2847c2\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 00:59:55.067785 master-0 kubenswrapper[33142]: I1204 00:59:55.067688 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n"] Dec 04 00:59:55.073384 master-0 kubenswrapper[33142]: I1204 00:59:55.073250 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l"] Dec 04 00:59:55.075323 master-0 kubenswrapper[33142]: I1204 00:59:55.075293 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 00:59:55.106080 master-0 kubenswrapper[33142]: I1204 00:59:55.101706 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l"] Dec 04 00:59:55.121271 master-0 kubenswrapper[33142]: I1204 00:59:55.121040 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs"] Dec 04 00:59:55.123001 master-0 kubenswrapper[33142]: I1204 00:59:55.122960 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 00:59:55.130223 master-0 kubenswrapper[33142]: I1204 00:59:55.130162 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8"] Dec 04 00:59:55.134852 master-0 kubenswrapper[33142]: I1204 00:59:55.132388 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 00:59:55.138558 master-0 kubenswrapper[33142]: I1204 00:59:55.138511 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs"] Dec 04 00:59:55.148948 master-0 kubenswrapper[33142]: I1204 00:59:55.146520 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bv79p\" (UniqueName: \"kubernetes.io/projected/c2a33c89-5b90-4544-9198-31d26f2847c2-kube-api-access-bv79p\") pod \"barbican-operator-controller-manager-5cd89994b5-tcq9h\" (UID: \"c2a33c89-5b90-4544-9198-31d26f2847c2\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 00:59:55.148948 master-0 kubenswrapper[33142]: I1204 00:59:55.146626 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cs7s\" (UniqueName: \"kubernetes.io/projected/3f5f4c5e-4c55-4167-9159-19cfc8aad88e-kube-api-access-7cs7s\") pod \"cinder-operator-controller-manager-f8856dd79-scqmz\" (UID: \"3f5f4c5e-4c55-4167-9159-19cfc8aad88e\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 00:59:55.148948 master-0 kubenswrapper[33142]: I1204 00:59:55.146669 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4cg\" (UniqueName: \"kubernetes.io/projected/53791b51-aa59-4ba8-a551-d56b2676906d-kube-api-access-dn4cg\") pod \"designate-operator-controller-manager-84bc9f68f5-bgx5n\" (UID: \"53791b51-aa59-4ba8-a551-d56b2676906d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 00:59:55.168312 master-0 kubenswrapper[33142]: I1204 00:59:55.151236 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7"] Dec 04 00:59:55.171306 master-0 kubenswrapper[33142]: I1204 00:59:55.171259 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv79p\" (UniqueName: \"kubernetes.io/projected/c2a33c89-5b90-4544-9198-31d26f2847c2-kube-api-access-bv79p\") pod \"barbican-operator-controller-manager-5cd89994b5-tcq9h\" (UID: \"c2a33c89-5b90-4544-9198-31d26f2847c2\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 00:59:55.171817 master-0 kubenswrapper[33142]: I1204 00:59:55.171786 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.179970 master-0 kubenswrapper[33142]: I1204 00:59:55.179809 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-webhook-server-cert" Dec 04 00:59:55.186236 master-0 kubenswrapper[33142]: I1204 00:59:55.186180 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8"] Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.246493 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7"] Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.247828 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8k8\" (UniqueName: \"kubernetes.io/projected/434dba03-47bc-490d-b591-19a0c9d7d854-kube-api-access-xh8k8\") pod \"glance-operator-controller-manager-78cd4f7769-gbq9l\" (UID: \"434dba03-47bc-490d-b591-19a0c9d7d854\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.247954 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j59m\" (UniqueName: \"kubernetes.io/projected/58438a63-fa86-4e22-8d98-be5cf1c40264-kube-api-access-8j59m\") pod \"heat-operator-controller-manager-7fd96594c7-shzxs\" (UID: \"58438a63-fa86-4e22-8d98-be5cf1c40264\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.248041 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6w7b\" (UniqueName: \"kubernetes.io/projected/cfe2c5a2-44c7-4cbb-8861-984f5666aa62-kube-api-access-x6w7b\") pod \"horizon-operator-controller-manager-f6cc97788-8jjc8\" (UID: \"cfe2c5a2-44c7-4cbb-8861-984f5666aa62\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.248089 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cs7s\" (UniqueName: \"kubernetes.io/projected/3f5f4c5e-4c55-4167-9159-19cfc8aad88e-kube-api-access-7cs7s\") pod \"cinder-operator-controller-manager-f8856dd79-scqmz\" (UID: \"3f5f4c5e-4c55-4167-9159-19cfc8aad88e\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 00:59:55.248479 master-0 kubenswrapper[33142]: I1204 00:59:55.248156 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4cg\" (UniqueName: \"kubernetes.io/projected/53791b51-aa59-4ba8-a551-d56b2676906d-kube-api-access-dn4cg\") pod \"designate-operator-controller-manager-84bc9f68f5-bgx5n\" (UID: \"53791b51-aa59-4ba8-a551-d56b2676906d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 00:59:55.284897 master-0 kubenswrapper[33142]: I1204 00:59:55.283102 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 00:59:55.299673 master-0 kubenswrapper[33142]: I1204 00:59:55.297228 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cs7s\" (UniqueName: \"kubernetes.io/projected/3f5f4c5e-4c55-4167-9159-19cfc8aad88e-kube-api-access-7cs7s\") pod \"cinder-operator-controller-manager-f8856dd79-scqmz\" (UID: \"3f5f4c5e-4c55-4167-9159-19cfc8aad88e\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 00:59:55.307778 master-0 kubenswrapper[33142]: I1204 00:59:55.302405 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4cg\" (UniqueName: \"kubernetes.io/projected/53791b51-aa59-4ba8-a551-d56b2676906d-kube-api-access-dn4cg\") pod \"designate-operator-controller-manager-84bc9f68f5-bgx5n\" (UID: \"53791b51-aa59-4ba8-a551-d56b2676906d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 00:59:55.307778 master-0 kubenswrapper[33142]: I1204 00:59:55.306504 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 00:59:55.310640 master-0 kubenswrapper[33142]: I1204 00:59:55.309074 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd"] Dec 04 00:59:55.311547 master-0 kubenswrapper[33142]: I1204 00:59:55.311485 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 00:59:55.327472 master-0 kubenswrapper[33142]: I1204 00:59:55.327410 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 00:59:55.330013 master-0 kubenswrapper[33142]: I1204 00:59:55.329971 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh"] Dec 04 00:59:55.333388 master-0 kubenswrapper[33142]: I1204 00:59:55.333323 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 00:59:55.363969 master-0 kubenswrapper[33142]: I1204 00:59:55.363875 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbxm\" (UniqueName: \"kubernetes.io/projected/5cc8e00d-68c1-4f43-a992-8e2f26beb79d-kube-api-access-5qbxm\") pod \"keystone-operator-controller-manager-58b8dcc5fb-cspvd\" (UID: \"5cc8e00d-68c1-4f43-a992-8e2f26beb79d\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 00:59:55.364222 master-0 kubenswrapper[33142]: I1204 00:59:55.364002 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w7b\" (UniqueName: \"kubernetes.io/projected/cfe2c5a2-44c7-4cbb-8861-984f5666aa62-kube-api-access-x6w7b\") pod \"horizon-operator-controller-manager-f6cc97788-8jjc8\" (UID: \"cfe2c5a2-44c7-4cbb-8861-984f5666aa62\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 00:59:55.364222 master-0 kubenswrapper[33142]: I1204 00:59:55.364119 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5r6j\" (UniqueName: \"kubernetes.io/projected/5cee34f9-9f29-4f15-ad66-2e35b8aeab07-kube-api-access-f5r6j\") pod \"ironic-operator-controller-manager-7c9bfd6967-f9nxh\" (UID: \"5cee34f9-9f29-4f15-ad66-2e35b8aeab07\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 00:59:55.364292 master-0 kubenswrapper[33142]: I1204 00:59:55.364241 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8k8\" (UniqueName: \"kubernetes.io/projected/434dba03-47bc-490d-b591-19a0c9d7d854-kube-api-access-xh8k8\") pod \"glance-operator-controller-manager-78cd4f7769-gbq9l\" (UID: \"434dba03-47bc-490d-b591-19a0c9d7d854\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 00:59:55.364328 master-0 kubenswrapper[33142]: I1204 00:59:55.364296 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwd9\" (UniqueName: \"kubernetes.io/projected/b2f9076e-1023-47e4-854b-bd4642d1aab0-kube-api-access-mgwd9\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.364328 master-0 kubenswrapper[33142]: I1204 00:59:55.364322 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.369281 master-0 kubenswrapper[33142]: I1204 00:59:55.365033 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8j59m\" (UniqueName: \"kubernetes.io/projected/58438a63-fa86-4e22-8d98-be5cf1c40264-kube-api-access-8j59m\") pod \"heat-operator-controller-manager-7fd96594c7-shzxs\" (UID: \"58438a63-fa86-4e22-8d98-be5cf1c40264\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 00:59:55.423691 master-0 kubenswrapper[33142]: I1204 00:59:55.423596 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8k8\" (UniqueName: \"kubernetes.io/projected/434dba03-47bc-490d-b591-19a0c9d7d854-kube-api-access-xh8k8\") pod \"glance-operator-controller-manager-78cd4f7769-gbq9l\" (UID: \"434dba03-47bc-490d-b591-19a0c9d7d854\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 00:59:55.425580 master-0 kubenswrapper[33142]: I1204 00:59:55.425536 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j59m\" (UniqueName: \"kubernetes.io/projected/58438a63-fa86-4e22-8d98-be5cf1c40264-kube-api-access-8j59m\") pod \"heat-operator-controller-manager-7fd96594c7-shzxs\" (UID: \"58438a63-fa86-4e22-8d98-be5cf1c40264\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 00:59:55.485697 master-0 kubenswrapper[33142]: I1204 00:59:55.445365 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd"] Dec 04 00:59:55.485697 master-0 kubenswrapper[33142]: I1204 00:59:55.467718 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 00:59:55.485697 master-0 kubenswrapper[33142]: I1204 00:59:55.469749 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6w7b\" (UniqueName: \"kubernetes.io/projected/cfe2c5a2-44c7-4cbb-8861-984f5666aa62-kube-api-access-x6w7b\") pod \"horizon-operator-controller-manager-f6cc97788-8jjc8\" (UID: \"cfe2c5a2-44c7-4cbb-8861-984f5666aa62\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: I1204 00:59:55.488067 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbxm\" (UniqueName: \"kubernetes.io/projected/5cc8e00d-68c1-4f43-a992-8e2f26beb79d-kube-api-access-5qbxm\") pod \"keystone-operator-controller-manager-58b8dcc5fb-cspvd\" (UID: \"5cc8e00d-68c1-4f43-a992-8e2f26beb79d\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: I1204 00:59:55.488244 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f5r6j\" (UniqueName: \"kubernetes.io/projected/5cee34f9-9f29-4f15-ad66-2e35b8aeab07-kube-api-access-f5r6j\") pod \"ironic-operator-controller-manager-7c9bfd6967-f9nxh\" (UID: \"5cee34f9-9f29-4f15-ad66-2e35b8aeab07\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: I1204 00:59:55.488722 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwd9\" (UniqueName: \"kubernetes.io/projected/b2f9076e-1023-47e4-854b-bd4642d1aab0-kube-api-access-mgwd9\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: I1204 00:59:55.488768 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: E1204 00:59:55.489262 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:55.492850 master-0 kubenswrapper[33142]: E1204 00:59:55.489364 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:55.989319364 +0000 UTC m=+768.391321214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:55.525128 master-0 kubenswrapper[33142]: I1204 00:59:55.525024 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh"] Dec 04 00:59:55.549956 master-0 kubenswrapper[33142]: I1204 00:59:55.547861 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbxm\" (UniqueName: \"kubernetes.io/projected/5cc8e00d-68c1-4f43-a992-8e2f26beb79d-kube-api-access-5qbxm\") pod \"keystone-operator-controller-manager-58b8dcc5fb-cspvd\" (UID: \"5cc8e00d-68c1-4f43-a992-8e2f26beb79d\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 00:59:55.549956 master-0 kubenswrapper[33142]: I1204 00:59:55.548054 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 00:59:55.555085 master-0 kubenswrapper[33142]: I1204 00:59:55.553671 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5r6j\" (UniqueName: \"kubernetes.io/projected/5cee34f9-9f29-4f15-ad66-2e35b8aeab07-kube-api-access-f5r6j\") pod \"ironic-operator-controller-manager-7c9bfd6967-f9nxh\" (UID: \"5cee34f9-9f29-4f15-ad66-2e35b8aeab07\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 00:59:55.564946 master-0 kubenswrapper[33142]: I1204 00:59:55.557981 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwd9\" (UniqueName: \"kubernetes.io/projected/b2f9076e-1023-47e4-854b-bd4642d1aab0-kube-api-access-mgwd9\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:55.564946 master-0 kubenswrapper[33142]: I1204 00:59:55.558584 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 00:59:55.566295 master-0 kubenswrapper[33142]: I1204 00:59:55.566168 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 00:59:55.584979 master-0 kubenswrapper[33142]: I1204 00:59:55.583696 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv"] Dec 04 00:59:55.616644 master-0 kubenswrapper[33142]: I1204 00:59:55.616561 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 00:59:55.620087 master-0 kubenswrapper[33142]: I1204 00:59:55.620039 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz"] Dec 04 00:59:55.626276 master-0 kubenswrapper[33142]: I1204 00:59:55.626221 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 00:59:55.652358 master-0 kubenswrapper[33142]: I1204 00:59:55.652257 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv"] Dec 04 00:59:55.652358 master-0 kubenswrapper[33142]: I1204 00:59:55.652310 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz"] Dec 04 00:59:55.652358 master-0 kubenswrapper[33142]: I1204 00:59:55.652324 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4"] Dec 04 00:59:55.652605 master-0 kubenswrapper[33142]: I1204 00:59:55.652389 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 00:59:55.691705 master-0 kubenswrapper[33142]: I1204 00:59:55.691644 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg"] Dec 04 00:59:55.693396 master-0 kubenswrapper[33142]: I1204 00:59:55.693360 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4"] Dec 04 00:59:55.693396 master-0 kubenswrapper[33142]: I1204 00:59:55.693395 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l"] Dec 04 00:59:55.694923 master-0 kubenswrapper[33142]: I1204 00:59:55.694865 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 00:59:55.695699 master-0 kubenswrapper[33142]: I1204 00:59:55.695672 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 00:59:55.695827 master-0 kubenswrapper[33142]: I1204 00:59:55.695804 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 00:59:55.698821 master-0 kubenswrapper[33142]: I1204 00:59:55.698679 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqf2r\" (UniqueName: \"kubernetes.io/projected/798f0500-ff95-4efb-af45-96e1e59b8671-kube-api-access-vqf2r\") pod \"mariadb-operator-controller-manager-647d75769b-lvfdv\" (UID: \"798f0500-ff95-4efb-af45-96e1e59b8671\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 00:59:55.698821 master-0 kubenswrapper[33142]: I1204 00:59:55.698806 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fnfn\" (UniqueName: \"kubernetes.io/projected/a393e2a3-e6da-4b0d-8a05-9ded7890d0c0-kube-api-access-5fnfn\") pod \"manila-operator-controller-manager-56f9fbf74b-r69wz\" (UID: \"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 00:59:55.712217 master-0 kubenswrapper[33142]: I1204 00:59:55.712164 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg"] Dec 04 00:59:55.725688 master-0 kubenswrapper[33142]: I1204 00:59:55.725028 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l"] Dec 04 00:59:55.750138 master-0 kubenswrapper[33142]: I1204 00:59:55.744673 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2"] Dec 04 00:59:55.750138 master-0 kubenswrapper[33142]: I1204 00:59:55.748566 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 00:59:55.767366 master-0 kubenswrapper[33142]: I1204 00:59:55.767284 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8"] Dec 04 00:59:55.769108 master-0 kubenswrapper[33142]: I1204 00:59:55.769079 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.786864 master-0 kubenswrapper[33142]: I1204 00:59:55.786722 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2"] Dec 04 00:59:55.789824 master-0 kubenswrapper[33142]: I1204 00:59:55.789777 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-baremetal-operator-webhook-server-cert" Dec 04 00:59:55.801149 master-0 kubenswrapper[33142]: I1204 00:59:55.801093 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5fnfn\" (UniqueName: \"kubernetes.io/projected/a393e2a3-e6da-4b0d-8a05-9ded7890d0c0-kube-api-access-5fnfn\") pod \"manila-operator-controller-manager-56f9fbf74b-r69wz\" (UID: \"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 00:59:55.801341 master-0 kubenswrapper[33142]: I1204 00:59:55.801170 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnh54\" (UniqueName: \"kubernetes.io/projected/69169dc7-8238-4110-9952-a1257aa8a2de-kube-api-access-xnh54\") pod \"neutron-operator-controller-manager-7cdd6b54fb-jx6n4\" (UID: \"69169dc7-8238-4110-9952-a1257aa8a2de\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802064 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802275 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqc9\" (UniqueName: \"kubernetes.io/projected/3439031c-2821-4ca2-8a3a-c7209616626c-kube-api-access-7hqc9\") pod \"nova-operator-controller-manager-865fc86d5b-2zzvg\" (UID: \"3439031c-2821-4ca2-8a3a-c7209616626c\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802430 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vqf2r\" (UniqueName: \"kubernetes.io/projected/798f0500-ff95-4efb-af45-96e1e59b8671-kube-api-access-vqf2r\") pod \"mariadb-operator-controller-manager-647d75769b-lvfdv\" (UID: \"798f0500-ff95-4efb-af45-96e1e59b8671\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802487 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgkd\" (UniqueName: \"kubernetes.io/projected/c5968a76-308f-4959-aa55-422393155bfe-kube-api-access-5xgkd\") pod \"ovn-operator-controller-manager-647f96877-pfgt2\" (UID: \"c5968a76-308f-4959-aa55-422393155bfe\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802520 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcfw\" (UniqueName: \"kubernetes.io/projected/e835d214-54bb-41b3-b7a4-1c0820634411-kube-api-access-rrcfw\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.803651 master-0 kubenswrapper[33142]: I1204 00:59:55.802556 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6dl\" (UniqueName: \"kubernetes.io/projected/1a6c34b6-772e-4b4e-9040-32a82a894bce-kube-api-access-jv6dl\") pod \"octavia-operator-controller-manager-845b79dc4f-z9r4l\" (UID: \"1a6c34b6-772e-4b4e-9040-32a82a894bce\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 00:59:55.811232 master-0 kubenswrapper[33142]: I1204 00:59:55.811163 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8"] Dec 04 00:59:55.833517 master-0 kubenswrapper[33142]: I1204 00:59:55.833450 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqf2r\" (UniqueName: \"kubernetes.io/projected/798f0500-ff95-4efb-af45-96e1e59b8671-kube-api-access-vqf2r\") pod \"mariadb-operator-controller-manager-647d75769b-lvfdv\" (UID: \"798f0500-ff95-4efb-af45-96e1e59b8671\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 00:59:55.841752 master-0 kubenswrapper[33142]: I1204 00:59:55.839824 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8"] Dec 04 00:59:55.841752 master-0 kubenswrapper[33142]: I1204 00:59:55.841302 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 00:59:55.863868 master-0 kubenswrapper[33142]: I1204 00:59:55.863461 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8"] Dec 04 00:59:55.873502 master-0 kubenswrapper[33142]: I1204 00:59:55.872521 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-lbkjq"] Dec 04 00:59:55.874481 master-0 kubenswrapper[33142]: I1204 00:59:55.874446 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fnfn\" (UniqueName: \"kubernetes.io/projected/a393e2a3-e6da-4b0d-8a05-9ded7890d0c0-kube-api-access-5fnfn\") pod \"manila-operator-controller-manager-56f9fbf74b-r69wz\" (UID: \"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 00:59:55.878184 master-0 kubenswrapper[33142]: I1204 00:59:55.878134 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 00:59:55.889049 master-0 kubenswrapper[33142]: I1204 00:59:55.888968 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-lbkjq"] Dec 04 00:59:55.904647 master-0 kubenswrapper[33142]: I1204 00:59:55.904591 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqc9\" (UniqueName: \"kubernetes.io/projected/3439031c-2821-4ca2-8a3a-c7209616626c-kube-api-access-7hqc9\") pod \"nova-operator-controller-manager-865fc86d5b-2zzvg\" (UID: \"3439031c-2821-4ca2-8a3a-c7209616626c\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 00:59:55.904784 master-0 kubenswrapper[33142]: I1204 00:59:55.904682 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5tc\" (UniqueName: \"kubernetes.io/projected/5e899b35-648a-4366-93c5-af7e1bfd3ceb-kube-api-access-2g5tc\") pod \"swift-operator-controller-manager-696b999796-lbkjq\" (UID: \"5e899b35-648a-4366-93c5-af7e1bfd3ceb\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 00:59:55.904784 master-0 kubenswrapper[33142]: I1204 00:59:55.904732 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgkd\" (UniqueName: \"kubernetes.io/projected/c5968a76-308f-4959-aa55-422393155bfe-kube-api-access-5xgkd\") pod \"ovn-operator-controller-manager-647f96877-pfgt2\" (UID: \"c5968a76-308f-4959-aa55-422393155bfe\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 00:59:55.904784 master-0 kubenswrapper[33142]: I1204 00:59:55.904759 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcfw\" (UniqueName: \"kubernetes.io/projected/e835d214-54bb-41b3-b7a4-1c0820634411-kube-api-access-rrcfw\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.904784 master-0 kubenswrapper[33142]: I1204 00:59:55.904781 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6dl\" (UniqueName: \"kubernetes.io/projected/1a6c34b6-772e-4b4e-9040-32a82a894bce-kube-api-access-jv6dl\") pod \"octavia-operator-controller-manager-845b79dc4f-z9r4l\" (UID: \"1a6c34b6-772e-4b4e-9040-32a82a894bce\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 00:59:55.904918 master-0 kubenswrapper[33142]: I1204 00:59:55.904814 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xnh54\" (UniqueName: \"kubernetes.io/projected/69169dc7-8238-4110-9952-a1257aa8a2de-kube-api-access-xnh54\") pod \"neutron-operator-controller-manager-7cdd6b54fb-jx6n4\" (UID: \"69169dc7-8238-4110-9952-a1257aa8a2de\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 00:59:55.904918 master-0 kubenswrapper[33142]: I1204 00:59:55.904896 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.905009 master-0 kubenswrapper[33142]: I1204 00:59:55.904939 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfb8\" (UniqueName: \"kubernetes.io/projected/9bd87940-d718-41fb-8c75-9df5f8d2d533-kube-api-access-lsfb8\") pod \"placement-operator-controller-manager-6b64f6f645-r57k8\" (UID: \"9bd87940-d718-41fb-8c75-9df5f8d2d533\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 00:59:55.905523 master-0 kubenswrapper[33142]: E1204 00:59:55.905500 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:55.905581 master-0 kubenswrapper[33142]: E1204 00:59:55.905552 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:56.405537293 +0000 UTC m=+768.807539143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:55.934248 master-0 kubenswrapper[33142]: I1204 00:59:55.932737 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6dl\" (UniqueName: \"kubernetes.io/projected/1a6c34b6-772e-4b4e-9040-32a82a894bce-kube-api-access-jv6dl\") pod \"octavia-operator-controller-manager-845b79dc4f-z9r4l\" (UID: \"1a6c34b6-772e-4b4e-9040-32a82a894bce\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 00:59:55.936789 master-0 kubenswrapper[33142]: I1204 00:59:55.936727 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4"] Dec 04 00:59:55.937169 master-0 kubenswrapper[33142]: I1204 00:59:55.937108 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcfw\" (UniqueName: \"kubernetes.io/projected/e835d214-54bb-41b3-b7a4-1c0820634411-kube-api-access-rrcfw\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:55.938891 master-0 kubenswrapper[33142]: I1204 00:59:55.938841 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 00:59:55.952310 master-0 kubenswrapper[33142]: I1204 00:59:55.952241 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 00:59:55.954132 master-0 kubenswrapper[33142]: I1204 00:59:55.954068 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz"] Dec 04 00:59:55.955842 master-0 kubenswrapper[33142]: I1204 00:59:55.955816 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 00:59:55.964174 master-0 kubenswrapper[33142]: I1204 00:59:55.964100 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4"] Dec 04 00:59:55.971542 master-0 kubenswrapper[33142]: I1204 00:59:55.971501 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqc9\" (UniqueName: \"kubernetes.io/projected/3439031c-2821-4ca2-8a3a-c7209616626c-kube-api-access-7hqc9\") pod \"nova-operator-controller-manager-865fc86d5b-2zzvg\" (UID: \"3439031c-2821-4ca2-8a3a-c7209616626c\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 00:59:55.972728 master-0 kubenswrapper[33142]: I1204 00:59:55.972668 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnh54\" (UniqueName: \"kubernetes.io/projected/69169dc7-8238-4110-9952-a1257aa8a2de-kube-api-access-xnh54\") pod \"neutron-operator-controller-manager-7cdd6b54fb-jx6n4\" (UID: \"69169dc7-8238-4110-9952-a1257aa8a2de\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 00:59:55.977876 master-0 kubenswrapper[33142]: I1204 00:59:55.977754 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz"] Dec 04 00:59:55.980428 master-0 kubenswrapper[33142]: I1204 00:59:55.980385 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgkd\" (UniqueName: \"kubernetes.io/projected/c5968a76-308f-4959-aa55-422393155bfe-kube-api-access-5xgkd\") pod \"ovn-operator-controller-manager-647f96877-pfgt2\" (UID: \"c5968a76-308f-4959-aa55-422393155bfe\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 00:59:55.989682 master-0 kubenswrapper[33142]: I1204 00:59:55.989576 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 00:59:55.990755 master-0 kubenswrapper[33142]: I1204 00:59:55.990731 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs"] Dec 04 00:59:55.993803 master-0 kubenswrapper[33142]: I1204 00:59:55.992268 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 00:59:55.995151 master-0 kubenswrapper[33142]: I1204 00:59:55.995091 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs"] Dec 04 00:59:56.006894 master-0 kubenswrapper[33142]: I1204 00:59:56.006780 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5tc\" (UniqueName: \"kubernetes.io/projected/5e899b35-648a-4366-93c5-af7e1bfd3ceb-kube-api-access-2g5tc\") pod \"swift-operator-controller-manager-696b999796-lbkjq\" (UID: \"5e899b35-648a-4366-93c5-af7e1bfd3ceb\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: I1204 00:59:56.006943 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ln4\" (UniqueName: \"kubernetes.io/projected/0f0386ac-cfe9-4768-82b2-53e294f7144c-kube-api-access-s2ln4\") pod \"test-operator-controller-manager-57dfcdd5b8-hq5cz\" (UID: \"0f0386ac-cfe9-4768-82b2-53e294f7144c\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: I1204 00:59:56.007023 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqj87\" (UniqueName: \"kubernetes.io/projected/9fb1c436-8ccd-440d-bd05-14ae96f6c566-kube-api-access-vqj87\") pod \"telemetry-operator-controller-manager-7b5867bfc7-jn5j4\" (UID: \"9fb1c436-8ccd-440d-bd05-14ae96f6c566\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: I1204 00:59:56.007093 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: I1204 00:59:56.007141 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hpb\" (UniqueName: \"kubernetes.io/projected/545afb94-f451-4925-a2c5-ae7c523eceac-kube-api-access-g2hpb\") pod \"watcher-operator-controller-manager-6b9b669fdb-fc5zs\" (UID: \"545afb94-f451-4925-a2c5-ae7c523eceac\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: I1204 00:59:56.007178 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfb8\" (UniqueName: \"kubernetes.io/projected/9bd87940-d718-41fb-8c75-9df5f8d2d533-kube-api-access-lsfb8\") pod \"placement-operator-controller-manager-6b64f6f645-r57k8\" (UID: \"9bd87940-d718-41fb-8c75-9df5f8d2d533\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: E1204 00:59:56.007567 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:56.011081 master-0 kubenswrapper[33142]: E1204 00:59:56.007631 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:57.007605989 +0000 UTC m=+769.409607839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:56.030146 master-0 kubenswrapper[33142]: I1204 00:59:56.029661 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 00:59:56.030146 master-0 kubenswrapper[33142]: I1204 00:59:56.029850 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5tc\" (UniqueName: \"kubernetes.io/projected/5e899b35-648a-4366-93c5-af7e1bfd3ceb-kube-api-access-2g5tc\") pod \"swift-operator-controller-manager-696b999796-lbkjq\" (UID: \"5e899b35-648a-4366-93c5-af7e1bfd3ceb\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 00:59:56.036511 master-0 kubenswrapper[33142]: I1204 00:59:56.036346 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfb8\" (UniqueName: \"kubernetes.io/projected/9bd87940-d718-41fb-8c75-9df5f8d2d533-kube-api-access-lsfb8\") pod \"placement-operator-controller-manager-6b64f6f645-r57k8\" (UID: \"9bd87940-d718-41fb-8c75-9df5f8d2d533\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 00:59:56.042906 master-0 kubenswrapper[33142]: I1204 00:59:56.042808 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9"] Dec 04 00:59:56.046109 master-0 kubenswrapper[33142]: I1204 00:59:56.045253 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.047050 master-0 kubenswrapper[33142]: I1204 00:59:56.047000 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"metrics-server-cert" Dec 04 00:59:56.047782 master-0 kubenswrapper[33142]: I1204 00:59:56.047759 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Dec 04 00:59:56.068078 master-0 kubenswrapper[33142]: I1204 00:59:56.067891 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 00:59:56.084863 master-0 kubenswrapper[33142]: I1204 00:59:56.084763 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9"] Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.109889 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hpb\" (UniqueName: \"kubernetes.io/projected/545afb94-f451-4925-a2c5-ae7c523eceac-kube-api-access-g2hpb\") pod \"watcher-operator-controller-manager-6b9b669fdb-fc5zs\" (UID: \"545afb94-f451-4925-a2c5-ae7c523eceac\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.110011 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh8w\" (UniqueName: \"kubernetes.io/projected/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-kube-api-access-2kh8w\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.110049 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.110135 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ln4\" (UniqueName: \"kubernetes.io/projected/0f0386ac-cfe9-4768-82b2-53e294f7144c-kube-api-access-s2ln4\") pod \"test-operator-controller-manager-57dfcdd5b8-hq5cz\" (UID: \"0f0386ac-cfe9-4768-82b2-53e294f7144c\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.110169 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.110195 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vqj87\" (UniqueName: \"kubernetes.io/projected/9fb1c436-8ccd-440d-bd05-14ae96f6c566-kube-api-access-vqj87\") pod \"telemetry-operator-controller-manager-7b5867bfc7-jn5j4\" (UID: \"9fb1c436-8ccd-440d-bd05-14ae96f6c566\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 00:59:56.116519 master-0 kubenswrapper[33142]: I1204 00:59:56.114330 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 00:59:56.125326 master-0 kubenswrapper[33142]: I1204 00:59:56.121481 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 00:59:56.135163 master-0 kubenswrapper[33142]: I1204 00:59:56.135000 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 00:59:56.165256 master-0 kubenswrapper[33142]: I1204 00:59:56.163505 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ln4\" (UniqueName: \"kubernetes.io/projected/0f0386ac-cfe9-4768-82b2-53e294f7144c-kube-api-access-s2ln4\") pod \"test-operator-controller-manager-57dfcdd5b8-hq5cz\" (UID: \"0f0386ac-cfe9-4768-82b2-53e294f7144c\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 00:59:56.170380 master-0 kubenswrapper[33142]: I1204 00:59:56.170344 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hpb\" (UniqueName: \"kubernetes.io/projected/545afb94-f451-4925-a2c5-ae7c523eceac-kube-api-access-g2hpb\") pod \"watcher-operator-controller-manager-6b9b669fdb-fc5zs\" (UID: \"545afb94-f451-4925-a2c5-ae7c523eceac\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 00:59:56.203038 master-0 kubenswrapper[33142]: I1204 00:59:56.202970 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: I1204 00:59:56.213300 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh8w\" (UniqueName: \"kubernetes.io/projected/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-kube-api-access-2kh8w\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: I1204 00:59:56.213416 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: I1204 00:59:56.213630 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: E1204 00:59:56.213917 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: E1204 00:59:56.214011 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:56.713982445 +0000 UTC m=+769.115984295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: E1204 00:59:56.214715 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 00:59:56.223743 master-0 kubenswrapper[33142]: E1204 00:59:56.214760 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:56.714743556 +0000 UTC m=+769.116745406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 00:59:56.238184 master-0 kubenswrapper[33142]: I1204 00:59:56.235918 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk"] Dec 04 00:59:56.242461 master-0 kubenswrapper[33142]: I1204 00:59:56.242327 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" Dec 04 00:59:56.317441 master-0 kubenswrapper[33142]: I1204 00:59:56.313983 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh8w\" (UniqueName: \"kubernetes.io/projected/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-kube-api-access-2kh8w\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.318032 master-0 kubenswrapper[33142]: I1204 00:59:56.317982 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk"] Dec 04 00:59:56.320652 master-0 kubenswrapper[33142]: I1204 00:59:56.320607 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 00:59:56.341098 master-0 kubenswrapper[33142]: I1204 00:59:56.336841 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqj87\" (UniqueName: \"kubernetes.io/projected/9fb1c436-8ccd-440d-bd05-14ae96f6c566-kube-api-access-vqj87\") pod \"telemetry-operator-controller-manager-7b5867bfc7-jn5j4\" (UID: \"9fb1c436-8ccd-440d-bd05-14ae96f6c566\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 00:59:56.426056 master-0 kubenswrapper[33142]: I1204 00:59:56.425994 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 00:59:56.431138 master-0 kubenswrapper[33142]: I1204 00:59:56.430075 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqc4\" (UniqueName: \"kubernetes.io/projected/33a387d7-ebcb-496f-b392-b3e02846371b-kube-api-access-tnqc4\") pod \"rabbitmq-cluster-operator-manager-78955d896f-q8sqk\" (UID: \"33a387d7-ebcb-496f-b392-b3e02846371b\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" Dec 04 00:59:56.431138 master-0 kubenswrapper[33142]: I1204 00:59:56.430330 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:56.431138 master-0 kubenswrapper[33142]: E1204 00:59:56.430572 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:56.431138 master-0 kubenswrapper[33142]: E1204 00:59:56.430763 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:57.430739853 +0000 UTC m=+769.832741703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:56.460707 master-0 kubenswrapper[33142]: I1204 00:59:56.459781 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 00:59:56.505131 master-0 kubenswrapper[33142]: I1204 00:59:56.504959 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h"] Dec 04 00:59:56.533128 master-0 kubenswrapper[33142]: I1204 00:59:56.532744 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqc4\" (UniqueName: \"kubernetes.io/projected/33a387d7-ebcb-496f-b392-b3e02846371b-kube-api-access-tnqc4\") pod \"rabbitmq-cluster-operator-manager-78955d896f-q8sqk\" (UID: \"33a387d7-ebcb-496f-b392-b3e02846371b\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" Dec 04 00:59:56.563084 master-0 kubenswrapper[33142]: I1204 00:59:56.562834 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqc4\" (UniqueName: \"kubernetes.io/projected/33a387d7-ebcb-496f-b392-b3e02846371b-kube-api-access-tnqc4\") pod \"rabbitmq-cluster-operator-manager-78955d896f-q8sqk\" (UID: \"33a387d7-ebcb-496f-b392-b3e02846371b\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: I1204 00:59:56.750816 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: I1204 00:59:56.750972 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: E1204 00:59:56.751130 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: E1204 00:59:56.751188 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:57.751167833 +0000 UTC m=+770.153169683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: E1204 00:59:56.751528 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 00:59:56.761994 master-0 kubenswrapper[33142]: E1204 00:59:56.751560 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:57.751550133 +0000 UTC m=+770.153551973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 00:59:56.775209 master-0 kubenswrapper[33142]: I1204 00:59:56.774446 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" Dec 04 00:59:56.838389 master-0 kubenswrapper[33142]: I1204 00:59:56.838310 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n"] Dec 04 00:59:56.857015 master-0 kubenswrapper[33142]: I1204 00:59:56.856950 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8"] Dec 04 00:59:56.868036 master-0 kubenswrapper[33142]: I1204 00:59:56.866435 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz"] Dec 04 00:59:56.868093 master-0 kubenswrapper[33142]: W1204 00:59:56.867646 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5f4c5e_4c55_4167_9159_19cfc8aad88e.slice/crio-bfb12fb1510d66433a5b1fa1b3d126b0282707b43a142b89aa445928547fe25e WatchSource:0}: Error finding container bfb12fb1510d66433a5b1fa1b3d126b0282707b43a142b89aa445928547fe25e: Status 404 returned error can't find the container with id bfb12fb1510d66433a5b1fa1b3d126b0282707b43a142b89aa445928547fe25e Dec 04 00:59:56.875500 master-0 kubenswrapper[33142]: I1204 00:59:56.875454 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd"] Dec 04 00:59:56.884236 master-0 kubenswrapper[33142]: W1204 00:59:56.884181 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc8e00d_68c1_4f43_a992_8e2f26beb79d.slice/crio-727117ccdf80765cf019941edfa4088b19ca2185c1d94acd6e331f53a638c670 WatchSource:0}: Error finding container 727117ccdf80765cf019941edfa4088b19ca2185c1d94acd6e331f53a638c670: Status 404 returned error can't find the container with id 727117ccdf80765cf019941edfa4088b19ca2185c1d94acd6e331f53a638c670 Dec 04 00:59:56.897374 master-0 kubenswrapper[33142]: W1204 00:59:56.897313 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe2c5a2_44c7_4cbb_8861_984f5666aa62.slice/crio-e39b7a96447eec7d99040aa0d8bb1fd4a97498ed36e26a88dbf185a57c6cafda WatchSource:0}: Error finding container e39b7a96447eec7d99040aa0d8bb1fd4a97498ed36e26a88dbf185a57c6cafda: Status 404 returned error can't find the container with id e39b7a96447eec7d99040aa0d8bb1fd4a97498ed36e26a88dbf185a57c6cafda Dec 04 00:59:56.955234 master-0 kubenswrapper[33142]: I1204 00:59:56.955161 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh"] Dec 04 00:59:57.056468 master-0 kubenswrapper[33142]: I1204 00:59:57.056323 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:57.056691 master-0 kubenswrapper[33142]: E1204 00:59:57.056495 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:57.056691 master-0 kubenswrapper[33142]: E1204 00:59:57.056562 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:59.056542708 +0000 UTC m=+771.458544568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:57.457995 master-0 kubenswrapper[33142]: I1204 00:59:57.457885 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" event={"ID":"c2a33c89-5b90-4544-9198-31d26f2847c2","Type":"ContainerStarted","Data":"f68c2d55065e0ab0aa73a63c16e76bbe675f0affd65cb8c7ef9bb041e0e00a53"} Dec 04 00:59:57.463106 master-0 kubenswrapper[33142]: I1204 00:59:57.463058 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" event={"ID":"3f5f4c5e-4c55-4167-9159-19cfc8aad88e","Type":"ContainerStarted","Data":"bfb12fb1510d66433a5b1fa1b3d126b0282707b43a142b89aa445928547fe25e"} Dec 04 00:59:57.465295 master-0 kubenswrapper[33142]: I1204 00:59:57.465202 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:57.465452 master-0 kubenswrapper[33142]: E1204 00:59:57.465404 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:57.465697 master-0 kubenswrapper[33142]: E1204 00:59:57.465491 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:59.465468871 +0000 UTC m=+771.867470721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:57.468240 master-0 kubenswrapper[33142]: I1204 00:59:57.468173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" event={"ID":"53791b51-aa59-4ba8-a551-d56b2676906d","Type":"ContainerStarted","Data":"3e72cf9f6f1531b028f1a9e5afbb34e6039ea50366d7a00fe39f6e8ea8a9c55e"} Dec 04 00:59:57.476749 master-0 kubenswrapper[33142]: I1204 00:59:57.476666 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" event={"ID":"5cee34f9-9f29-4f15-ad66-2e35b8aeab07","Type":"ContainerStarted","Data":"257923a24f694c3c80dfcdcdb16eb4def09961c7f405f0f15130b0e688dedbd0"} Dec 04 00:59:57.503733 master-0 kubenswrapper[33142]: I1204 00:59:57.502266 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" event={"ID":"5cc8e00d-68c1-4f43-a992-8e2f26beb79d","Type":"ContainerStarted","Data":"727117ccdf80765cf019941edfa4088b19ca2185c1d94acd6e331f53a638c670"} Dec 04 00:59:57.505223 master-0 kubenswrapper[33142]: I1204 00:59:57.505143 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" event={"ID":"cfe2c5a2-44c7-4cbb-8861-984f5666aa62","Type":"ContainerStarted","Data":"e39b7a96447eec7d99040aa0d8bb1fd4a97498ed36e26a88dbf185a57c6cafda"} Dec 04 00:59:57.718093 master-0 kubenswrapper[33142]: I1204 00:59:57.716717 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2"] Dec 04 00:59:57.729896 master-0 kubenswrapper[33142]: I1204 00:59:57.729819 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l"] Dec 04 00:59:57.741228 master-0 kubenswrapper[33142]: I1204 00:59:57.741164 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv"] Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: I1204 00:59:57.774303 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: I1204 00:59:57.774421 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: E1204 00:59:57.774577 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: E1204 00:59:57.774626 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: E1204 00:59:57.774675 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:59.774653684 +0000 UTC m=+772.176655534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: E1204 00:59:57.774696 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 00:59:59.774689105 +0000 UTC m=+772.176690955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 00:59:57.780377 master-0 kubenswrapper[33142]: W1204 00:59:57.777522 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda393e2a3_e6da_4b0d_8a05_9ded7890d0c0.slice/crio-444eb484ba5abe46bca954f3dd6dac9ed00899fc31b78b6e3ea0713afc7f5d9a WatchSource:0}: Error finding container 444eb484ba5abe46bca954f3dd6dac9ed00899fc31b78b6e3ea0713afc7f5d9a: Status 404 returned error can't find the container with id 444eb484ba5abe46bca954f3dd6dac9ed00899fc31b78b6e3ea0713afc7f5d9a Dec 04 00:59:57.788215 master-0 kubenswrapper[33142]: W1204 00:59:57.785518 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434dba03_47bc_490d_b591_19a0c9d7d854.slice/crio-567a4c330c79a5e80a271cf723978ec8263d8b1d66af2400371c982efcecd076 WatchSource:0}: Error finding container 567a4c330c79a5e80a271cf723978ec8263d8b1d66af2400371c982efcecd076: Status 404 returned error can't find the container with id 567a4c330c79a5e80a271cf723978ec8263d8b1d66af2400371c982efcecd076 Dec 04 00:59:57.801479 master-0 kubenswrapper[33142]: I1204 00:59:57.801376 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-lbkjq"] Dec 04 00:59:57.812968 master-0 kubenswrapper[33142]: W1204 00:59:57.812539 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69169dc7_8238_4110_9952_a1257aa8a2de.slice/crio-ac7358293ad437458c301df030af29d7b57a5b3b11e4f5ff0598f5cc05da2126 WatchSource:0}: Error finding container ac7358293ad437458c301df030af29d7b57a5b3b11e4f5ff0598f5cc05da2126: Status 404 returned error can't find the container with id ac7358293ad437458c301df030af29d7b57a5b3b11e4f5ff0598f5cc05da2126 Dec 04 00:59:57.868885 master-0 kubenswrapper[33142]: I1204 00:59:57.868791 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz"] Dec 04 00:59:57.933566 master-0 kubenswrapper[33142]: I1204 00:59:57.933322 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg"] Dec 04 00:59:57.933566 master-0 kubenswrapper[33142]: I1204 00:59:57.933392 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs"] Dec 04 00:59:57.947137 master-0 kubenswrapper[33142]: I1204 00:59:57.947006 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l"] Dec 04 00:59:57.965765 master-0 kubenswrapper[33142]: I1204 00:59:57.964416 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4"] Dec 04 00:59:58.034566 master-0 kubenswrapper[33142]: W1204 00:59:58.034425 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd87940_d718_41fb_8c75_9df5f8d2d533.slice/crio-9504468732eb6262d59747054e5fb1b5cbee02511f49040b0b9f952731868911 WatchSource:0}: Error finding container 9504468732eb6262d59747054e5fb1b5cbee02511f49040b0b9f952731868911: Status 404 returned error can't find the container with id 9504468732eb6262d59747054e5fb1b5cbee02511f49040b0b9f952731868911 Dec 04 00:59:58.038553 master-0 kubenswrapper[33142]: E1204 00:59:58.038460 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-g2hpb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-6b9b669fdb-fc5zs_openstack-operators(545afb94-f451-4925-a2c5-ae7c523eceac): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 00:59:58.040801 master-0 kubenswrapper[33142]: E1204 00:59:58.040751 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-g2hpb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-6b9b669fdb-fc5zs_openstack-operators(545afb94-f451-4925-a2c5-ae7c523eceac): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 00:59:58.042148 master-0 kubenswrapper[33142]: E1204 00:59:58.042103 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" podUID="545afb94-f451-4925-a2c5-ae7c523eceac" Dec 04 00:59:58.067304 master-0 kubenswrapper[33142]: W1204 00:59:58.067128 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb1c436_8ccd_440d_bd05_14ae96f6c566.slice/crio-e29e6bc8591dd9e276664dfd34cbcabd562c6def6d833b0d43b0f2ab28a41b8a WatchSource:0}: Error finding container e29e6bc8591dd9e276664dfd34cbcabd562c6def6d833b0d43b0f2ab28a41b8a: Status 404 returned error can't find the container with id e29e6bc8591dd9e276664dfd34cbcabd562c6def6d833b0d43b0f2ab28a41b8a Dec 04 00:59:58.076096 master-0 kubenswrapper[33142]: E1204 00:59:58.075975 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:operator,Image:quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2,Command:[/manager],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:0,ContainerPort:9782,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:OPERATOR_NAMESPACE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{524288000 0} {} 500Mi BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-tnqc4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000810000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-cluster-operator-manager-78955d896f-q8sqk_openstack-operators(33a387d7-ebcb-496f-b392-b3e02846371b): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 00:59:58.077357 master-0 kubenswrapper[33142]: E1204 00:59:58.077311 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" podUID="33a387d7-ebcb-496f-b392-b3e02846371b" Dec 04 00:59:58.084766 master-0 kubenswrapper[33142]: I1204 00:59:58.084718 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4"] Dec 04 00:59:58.126798 master-0 kubenswrapper[33142]: I1204 00:59:58.126725 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs"] Dec 04 00:59:58.169962 master-0 kubenswrapper[33142]: I1204 00:59:58.165647 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8"] Dec 04 00:59:58.219712 master-0 kubenswrapper[33142]: I1204 00:59:58.218670 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk"] Dec 04 00:59:58.237437 master-0 kubenswrapper[33142]: I1204 00:59:58.237363 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz"] Dec 04 00:59:58.516468 master-0 kubenswrapper[33142]: I1204 00:59:58.516183 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" event={"ID":"c5968a76-308f-4959-aa55-422393155bfe","Type":"ContainerStarted","Data":"808404c946786b75238383e2414d1f7f7eba92f187f64b02e8185ba52f164423"} Dec 04 00:59:58.518563 master-0 kubenswrapper[33142]: I1204 00:59:58.518522 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" event={"ID":"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0","Type":"ContainerStarted","Data":"444eb484ba5abe46bca954f3dd6dac9ed00899fc31b78b6e3ea0713afc7f5d9a"} Dec 04 00:59:58.520371 master-0 kubenswrapper[33142]: I1204 00:59:58.520310 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" event={"ID":"3439031c-2821-4ca2-8a3a-c7209616626c","Type":"ContainerStarted","Data":"4c364db4860c0003a81faa09994326fbb70b84beb1fdc9dfa81aeafee2830881"} Dec 04 00:59:58.522664 master-0 kubenswrapper[33142]: I1204 00:59:58.522630 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" event={"ID":"434dba03-47bc-490d-b591-19a0c9d7d854","Type":"ContainerStarted","Data":"567a4c330c79a5e80a271cf723978ec8263d8b1d66af2400371c982efcecd076"} Dec 04 00:59:58.525059 master-0 kubenswrapper[33142]: I1204 00:59:58.524841 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" event={"ID":"33a387d7-ebcb-496f-b392-b3e02846371b","Type":"ContainerStarted","Data":"025febd7add4b8fb9580a1d1aee7a29cf65456df5432d299aee0bf0b6f71def9"} Dec 04 00:59:58.528031 master-0 kubenswrapper[33142]: I1204 00:59:58.527908 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" event={"ID":"798f0500-ff95-4efb-af45-96e1e59b8671","Type":"ContainerStarted","Data":"f78a9471e1508eb948df3ea3a93604e89414ae55ec048d50883817741c222ab0"} Dec 04 00:59:58.530323 master-0 kubenswrapper[33142]: I1204 00:59:58.530273 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" event={"ID":"9bd87940-d718-41fb-8c75-9df5f8d2d533","Type":"ContainerStarted","Data":"9504468732eb6262d59747054e5fb1b5cbee02511f49040b0b9f952731868911"} Dec 04 00:59:58.532032 master-0 kubenswrapper[33142]: E1204 00:59:58.531730 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\"\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" podUID="33a387d7-ebcb-496f-b392-b3e02846371b" Dec 04 00:59:58.532402 master-0 kubenswrapper[33142]: I1204 00:59:58.532348 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" event={"ID":"58438a63-fa86-4e22-8d98-be5cf1c40264","Type":"ContainerStarted","Data":"e71352f05a0eabecb2b92526b70e8fe2f2a58daf5254e5d0fcccb2ea7ad76a25"} Dec 04 00:59:58.534813 master-0 kubenswrapper[33142]: I1204 00:59:58.534163 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" event={"ID":"545afb94-f451-4925-a2c5-ae7c523eceac","Type":"ContainerStarted","Data":"13c4123ba1d36b5ffd9b2e39b6158ba70f210bb8afa64ad107a2bd59367a8ec5"} Dec 04 00:59:58.536220 master-0 kubenswrapper[33142]: E1204 00:59:58.536164 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" podUID="545afb94-f451-4925-a2c5-ae7c523eceac" Dec 04 00:59:58.536837 master-0 kubenswrapper[33142]: I1204 00:59:58.536783 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" event={"ID":"1a6c34b6-772e-4b4e-9040-32a82a894bce","Type":"ContainerStarted","Data":"a98f665b2dfea06a9b7b9e434422ff4549f94172daa94f4e7953a53b119ea5a2"} Dec 04 00:59:58.538304 master-0 kubenswrapper[33142]: I1204 00:59:58.537947 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" event={"ID":"5e899b35-648a-4366-93c5-af7e1bfd3ceb","Type":"ContainerStarted","Data":"d62769fb87b45b1c40dbe1b5f6aca3c54fa5fe7a11b7fe380b552fdcf70f8b5b"} Dec 04 00:59:58.538943 master-0 kubenswrapper[33142]: I1204 00:59:58.538882 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" event={"ID":"69169dc7-8238-4110-9952-a1257aa8a2de","Type":"ContainerStarted","Data":"ac7358293ad437458c301df030af29d7b57a5b3b11e4f5ff0598f5cc05da2126"} Dec 04 00:59:58.539853 master-0 kubenswrapper[33142]: I1204 00:59:58.539827 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" event={"ID":"9fb1c436-8ccd-440d-bd05-14ae96f6c566","Type":"ContainerStarted","Data":"e29e6bc8591dd9e276664dfd34cbcabd562c6def6d833b0d43b0f2ab28a41b8a"} Dec 04 00:59:59.114494 master-0 kubenswrapper[33142]: I1204 00:59:59.113805 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 00:59:59.114494 master-0 kubenswrapper[33142]: E1204 00:59:59.114083 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:59.114494 master-0 kubenswrapper[33142]: E1204 00:59:59.114153 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:03.114130738 +0000 UTC m=+775.516132588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 00:59:59.524198 master-0 kubenswrapper[33142]: I1204 00:59:59.524134 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 00:59:59.524460 master-0 kubenswrapper[33142]: E1204 00:59:59.524350 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:59.524460 master-0 kubenswrapper[33142]: E1204 00:59:59.524416 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:03.524395559 +0000 UTC m=+775.926397409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 00:59:59.563298 master-0 kubenswrapper[33142]: I1204 00:59:59.562686 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" event={"ID":"0f0386ac-cfe9-4768-82b2-53e294f7144c","Type":"ContainerStarted","Data":"42106eca6f2eff3173f16887b0f3247fdd10affe5d7e44afd3af93c8c940c685"} Dec 04 00:59:59.565545 master-0 kubenswrapper[33142]: E1204 00:59:59.564826 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\"\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" podUID="33a387d7-ebcb-496f-b392-b3e02846371b" Dec 04 00:59:59.567055 master-0 kubenswrapper[33142]: E1204 00:59:59.566895 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" podUID="545afb94-f451-4925-a2c5-ae7c523eceac" Dec 04 00:59:59.831299 master-0 kubenswrapper[33142]: I1204 00:59:59.831175 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:59.831542 master-0 kubenswrapper[33142]: I1204 00:59:59.831329 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 00:59:59.831542 master-0 kubenswrapper[33142]: E1204 00:59:59.831497 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 00:59:59.831616 master-0 kubenswrapper[33142]: E1204 00:59:59.831550 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:03.831535574 +0000 UTC m=+776.233537424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 00:59:59.831655 master-0 kubenswrapper[33142]: E1204 00:59:59.831604 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 00:59:59.831792 master-0 kubenswrapper[33142]: E1204 00:59:59.831756 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:03.83173457 +0000 UTC m=+776.233736420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 01:00:00.225612 master-0 kubenswrapper[33142]: I1204 01:00:00.225492 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt"] Dec 04 01:00:00.239295 master-0 kubenswrapper[33142]: I1204 01:00:00.239210 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt"] Dec 04 01:00:00.239640 master-0 kubenswrapper[33142]: I1204 01:00:00.239382 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.248685 master-0 kubenswrapper[33142]: I1204 01:00:00.248141 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-zx2gd" Dec 04 01:00:00.249071 master-0 kubenswrapper[33142]: I1204 01:00:00.248550 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 01:00:00.355002 master-0 kubenswrapper[33142]: I1204 01:00:00.354917 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j2wv\" (UniqueName: \"kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.355232 master-0 kubenswrapper[33142]: I1204 01:00:00.355046 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.355280 master-0 kubenswrapper[33142]: I1204 01:00:00.355254 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.457830 master-0 kubenswrapper[33142]: I1204 01:00:00.457760 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4j2wv\" (UniqueName: \"kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.458081 master-0 kubenswrapper[33142]: I1204 01:00:00.457862 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.458081 master-0 kubenswrapper[33142]: I1204 01:00:00.458006 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.459035 master-0 kubenswrapper[33142]: I1204 01:00:00.458994 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.462184 master-0 kubenswrapper[33142]: I1204 01:00:00.462096 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.479950 master-0 kubenswrapper[33142]: I1204 01:00:00.479887 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j2wv\" (UniqueName: \"kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv\") pod \"collect-profiles-29413500-zrplt\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:00.573183 master-0 kubenswrapper[33142]: I1204 01:00:00.573102 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:03.213064 master-0 kubenswrapper[33142]: I1204 01:00:03.212995 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:03.213609 master-0 kubenswrapper[33142]: E1204 01:00:03.213210 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 01:00:03.213609 master-0 kubenswrapper[33142]: E1204 01:00:03.213272 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:11.213253268 +0000 UTC m=+783.615255118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 01:00:03.623170 master-0 kubenswrapper[33142]: I1204 01:00:03.623064 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:03.623514 master-0 kubenswrapper[33142]: E1204 01:00:03.623251 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 01:00:03.623514 master-0 kubenswrapper[33142]: E1204 01:00:03.623305 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:11.623289432 +0000 UTC m=+784.025291282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 01:00:03.931474 master-0 kubenswrapper[33142]: I1204 01:00:03.931235 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:03.931700 master-0 kubenswrapper[33142]: E1204 01:00:03.931473 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 01:00:03.931700 master-0 kubenswrapper[33142]: E1204 01:00:03.931584 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:11.931553319 +0000 UTC m=+784.333555219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 01:00:03.931700 master-0 kubenswrapper[33142]: I1204 01:00:03.931636 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:03.932004 master-0 kubenswrapper[33142]: E1204 01:00:03.931976 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 01:00:03.932059 master-0 kubenswrapper[33142]: E1204 01:00:03.932035 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:11.932019612 +0000 UTC m=+784.334021502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 01:00:11.313571 master-0 kubenswrapper[33142]: I1204 01:00:11.313423 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:11.314496 master-0 kubenswrapper[33142]: E1204 01:00:11.313682 33142 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 01:00:11.314496 master-0 kubenswrapper[33142]: E1204 01:00:11.313798 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert podName:b2f9076e-1023-47e4-854b-bd4642d1aab0 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:27.313767293 +0000 UTC m=+799.715769203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-ckrg7" (UID: "b2f9076e-1023-47e4-854b-bd4642d1aab0") : secret "infra-operator-webhook-server-cert" not found Dec 04 01:00:11.722955 master-0 kubenswrapper[33142]: I1204 01:00:11.722866 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:11.723224 master-0 kubenswrapper[33142]: E1204 01:00:11.723104 33142 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 01:00:11.723266 master-0 kubenswrapper[33142]: E1204 01:00:11.723231 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert podName:e835d214-54bb-41b3-b7a4-1c0820634411 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:27.723203231 +0000 UTC m=+800.125205091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert") pod "openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" (UID: "e835d214-54bb-41b3-b7a4-1c0820634411") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 01:00:12.027719 master-0 kubenswrapper[33142]: I1204 01:00:12.027631 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:12.028008 master-0 kubenswrapper[33142]: I1204 01:00:12.027792 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:12.028008 master-0 kubenswrapper[33142]: E1204 01:00:12.027869 33142 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 01:00:12.028008 master-0 kubenswrapper[33142]: E1204 01:00:12.027979 33142 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 01:00:12.028008 master-0 kubenswrapper[33142]: E1204 01:00:12.027991 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:28.027967888 +0000 UTC m=+800.429969738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "metrics-server-cert" not found Dec 04 01:00:12.028290 master-0 kubenswrapper[33142]: E1204 01:00:12.028043 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs podName:9d72fbbd-fa51-41a1-a06a-fd3e56f48196 nodeName:}" failed. No retries permitted until 2025-12-04 01:00:28.02802368 +0000 UTC m=+800.430025520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs") pod "openstack-operator-controller-manager-57d98476c4-46jc9" (UID: "9d72fbbd-fa51-41a1-a06a-fd3e56f48196") : secret "webhook-server-cert" not found Dec 04 01:00:14.296901 master-0 kubenswrapper[33142]: I1204 01:00:14.296832 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt"] Dec 04 01:00:14.755378 master-0 kubenswrapper[33142]: I1204 01:00:14.755271 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" event={"ID":"5cee34f9-9f29-4f15-ad66-2e35b8aeab07","Type":"ContainerStarted","Data":"d2beff9b886a64e07be63e11bd671e9865ed9d6586ce9a0adf529c264ab4a88b"} Dec 04 01:00:14.759624 master-0 kubenswrapper[33142]: I1204 01:00:14.759239 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" event={"ID":"cfe2c5a2-44c7-4cbb-8861-984f5666aa62","Type":"ContainerStarted","Data":"437c2f154ae50006d9c2e41115ef4bfcc630b1ed90fba73a31f142aa677df981"} Dec 04 01:00:14.764502 master-0 kubenswrapper[33142]: I1204 01:00:14.762403 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" event={"ID":"c2a33c89-5b90-4544-9198-31d26f2847c2","Type":"ContainerStarted","Data":"c24a815c27a718f6e6a715b1a58b464c6a21530d010dbdce6ac075356fbb271c"} Dec 04 01:00:14.767039 master-0 kubenswrapper[33142]: I1204 01:00:14.766990 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" event={"ID":"c5968a76-308f-4959-aa55-422393155bfe","Type":"ContainerStarted","Data":"fedb4e130d051c0f3571f47bd5529c5b077e1da1aee93a8640ca0b629b3443fd"} Dec 04 01:00:14.768768 master-0 kubenswrapper[33142]: I1204 01:00:14.768732 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" event={"ID":"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0","Type":"ContainerStarted","Data":"73b8b803e6fc301414ca81826e41519e47ef8b528612d2ba74dab7e1a457befd"} Dec 04 01:00:14.771573 master-0 kubenswrapper[33142]: I1204 01:00:14.771531 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" event={"ID":"53791b51-aa59-4ba8-a551-d56b2676906d","Type":"ContainerStarted","Data":"bdb639ea0fce13196661f286c995e08372332f7fc5b607d2ccc49ec83ec8f1d8"} Dec 04 01:00:14.773013 master-0 kubenswrapper[33142]: I1204 01:00:14.772977 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" event={"ID":"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8","Type":"ContainerStarted","Data":"354db7b87b450526a0deecb8140b3c1a4bde3c2f49fb9004f0f1fe6fd962d865"} Dec 04 01:00:14.775664 master-0 kubenswrapper[33142]: I1204 01:00:14.775600 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" event={"ID":"0f0386ac-cfe9-4768-82b2-53e294f7144c","Type":"ContainerStarted","Data":"867b498fefbf57486529fd46db710ac7ad985c9b6131f24efceefb0046b6515d"} Dec 04 01:00:14.778101 master-0 kubenswrapper[33142]: I1204 01:00:14.778058 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" event={"ID":"69169dc7-8238-4110-9952-a1257aa8a2de","Type":"ContainerStarted","Data":"b72a538b482a73ac4844d659a8b5770804315357b95636a82cfa9f0f58f2b99f"} Dec 04 01:00:15.065135 master-0 kubenswrapper[33142]: E1204 01:00:15.064698 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-2g5tc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000810000,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod swift-operator-controller-manager-696b999796-lbkjq_openstack-operators(5e899b35-648a-4366-93c5-af7e1bfd3ceb): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 01:00:15.066889 master-0 kubenswrapper[33142]: E1204 01:00:15.066635 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" podUID="5e899b35-648a-4366-93c5-af7e1bfd3ceb" Dec 04 01:00:15.336512 master-0 kubenswrapper[33142]: E1204 01:00:15.331326 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-8j59m,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod heat-operator-controller-manager-7fd96594c7-shzxs_openstack-operators(58438a63-fa86-4e22-8d98-be5cf1c40264): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 01:00:15.336512 master-0 kubenswrapper[33142]: E1204 01:00:15.333731 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" podUID="58438a63-fa86-4e22-8d98-be5cf1c40264" Dec 04 01:00:15.383741 master-0 kubenswrapper[33142]: E1204 01:00:15.373102 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-lsfb8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-6b64f6f645-r57k8_openstack-operators(9bd87940-d718-41fb-8c75-9df5f8d2d533): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 01:00:15.383741 master-0 kubenswrapper[33142]: E1204 01:00:15.374420 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" podUID="9bd87940-d718-41fb-8c75-9df5f8d2d533" Dec 04 01:00:15.459822 master-0 kubenswrapper[33142]: E1204 01:00:15.424604 33142 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-7cs7s,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod cinder-operator-controller-manager-f8856dd79-scqmz_openstack-operators(3f5f4c5e-4c55-4167-9159-19cfc8aad88e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 01:00:15.459822 master-0 kubenswrapper[33142]: E1204 01:00:15.425809 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" podUID="3f5f4c5e-4c55-4167-9159-19cfc8aad88e" Dec 04 01:00:15.835026 master-0 kubenswrapper[33142]: I1204 01:00:15.834848 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" event={"ID":"798f0500-ff95-4efb-af45-96e1e59b8671","Type":"ContainerStarted","Data":"17c322c79564153cf21882b3eab4152cb64d93b025469a4196fc6c8833276e3f"} Dec 04 01:00:15.856650 master-0 kubenswrapper[33142]: I1204 01:00:15.855852 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" event={"ID":"9bd87940-d718-41fb-8c75-9df5f8d2d533","Type":"ContainerStarted","Data":"42f2a0568f5dfa9333fc67033287dd069090f0f0361f3e1c68e764bda26a8de0"} Dec 04 01:00:15.866311 master-0 kubenswrapper[33142]: E1204 01:00:15.865859 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" podUID="9bd87940-d718-41fb-8c75-9df5f8d2d533" Dec 04 01:00:15.867260 master-0 kubenswrapper[33142]: I1204 01:00:15.866763 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" event={"ID":"5cc8e00d-68c1-4f43-a992-8e2f26beb79d","Type":"ContainerStarted","Data":"053cd05da07a683c1c40267cc31cf5952267b8ce0dd04a091f298fefff882c76"} Dec 04 01:00:15.870286 master-0 kubenswrapper[33142]: I1204 01:00:15.869309 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" event={"ID":"3f5f4c5e-4c55-4167-9159-19cfc8aad88e","Type":"ContainerStarted","Data":"7c7373e1542932884adac48d8be260228fb3c047d2a02358e92f1961b3f335a4"} Dec 04 01:00:15.870286 master-0 kubenswrapper[33142]: I1204 01:00:15.870108 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 01:00:15.892677 master-0 kubenswrapper[33142]: E1204 01:00:15.884652 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" podUID="3f5f4c5e-4c55-4167-9159-19cfc8aad88e" Dec 04 01:00:15.907484 master-0 kubenswrapper[33142]: E1204 01:00:15.905853 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" podUID="5e899b35-648a-4366-93c5-af7e1bfd3ceb" Dec 04 01:00:16.013955 master-0 kubenswrapper[33142]: I1204 01:00:16.012283 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" event={"ID":"5e899b35-648a-4366-93c5-af7e1bfd3ceb","Type":"ContainerStarted","Data":"90c706dc2461c0e7a985c70a6077dbbc50efe5ababc7424727073bfb8c5c10cf"} Dec 04 01:00:16.013955 master-0 kubenswrapper[33142]: I1204 01:00:16.012380 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 01:00:16.013955 master-0 kubenswrapper[33142]: I1204 01:00:16.012401 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" event={"ID":"434dba03-47bc-490d-b591-19a0c9d7d854","Type":"ContainerStarted","Data":"6576d4a52cd039ba1fe54f978400459a2144cabbaab590360c3e8bead41d3de6"} Dec 04 01:00:16.017270 master-0 kubenswrapper[33142]: I1204 01:00:16.016496 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" event={"ID":"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8","Type":"ContainerStarted","Data":"b2e834933522a0f3fdf6616281b8aa8b1444761b363b78cc4d8315b7e6668b23"} Dec 04 01:00:16.026048 master-0 kubenswrapper[33142]: I1204 01:00:16.025989 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" event={"ID":"3439031c-2821-4ca2-8a3a-c7209616626c","Type":"ContainerStarted","Data":"2ce183fdb1c0fbe072f1021f3f1eff291190404e080c17eef2fd420293e4d2a2"} Dec 04 01:00:16.030953 master-0 kubenswrapper[33142]: I1204 01:00:16.030822 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" event={"ID":"1a6c34b6-772e-4b4e-9040-32a82a894bce","Type":"ContainerStarted","Data":"199cc220f49a78ddfe33505ccda20a2d21692dc999730ead7c7f71487fff64ba"} Dec 04 01:00:16.033325 master-0 kubenswrapper[33142]: I1204 01:00:16.033291 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" event={"ID":"9fb1c436-8ccd-440d-bd05-14ae96f6c566","Type":"ContainerStarted","Data":"8e3cc90c1bcd9771cc0ae9c8a57ad66168f2e6102f402a2feed3b327830f1047"} Dec 04 01:00:16.039269 master-0 kubenswrapper[33142]: I1204 01:00:16.039229 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" event={"ID":"58438a63-fa86-4e22-8d98-be5cf1c40264","Type":"ContainerStarted","Data":"23e42bcc1f51da3168b1589839e76dd6a6d443f39dbaf7ce280b5620f5823446"} Dec 04 01:00:16.040077 master-0 kubenswrapper[33142]: I1204 01:00:16.040049 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 01:00:16.040698 master-0 kubenswrapper[33142]: E1204 01:00:16.040671 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" podUID="58438a63-fa86-4e22-8d98-be5cf1c40264" Dec 04 01:00:16.208233 master-0 kubenswrapper[33142]: I1204 01:00:16.207558 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 01:00:17.061580 master-0 kubenswrapper[33142]: I1204 01:00:17.061505 33142 generic.go:334] "Generic (PLEG): container finished" podID="3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" containerID="b2e834933522a0f3fdf6616281b8aa8b1444761b363b78cc4d8315b7e6668b23" exitCode=0 Dec 04 01:00:17.062144 master-0 kubenswrapper[33142]: I1204 01:00:17.061591 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" event={"ID":"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8","Type":"ContainerDied","Data":"b2e834933522a0f3fdf6616281b8aa8b1444761b363b78cc4d8315b7e6668b23"} Dec 04 01:00:17.065648 master-0 kubenswrapper[33142]: E1204 01:00:17.064009 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" podUID="9bd87940-d718-41fb-8c75-9df5f8d2d533" Dec 04 01:00:17.065648 master-0 kubenswrapper[33142]: E1204 01:00:17.063991 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" podUID="3f5f4c5e-4c55-4167-9159-19cfc8aad88e" Dec 04 01:00:17.065648 master-0 kubenswrapper[33142]: E1204 01:00:17.064252 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" podUID="58438a63-fa86-4e22-8d98-be5cf1c40264" Dec 04 01:00:17.065648 master-0 kubenswrapper[33142]: E1204 01:00:17.065102 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" podUID="5e899b35-648a-4366-93c5-af7e1bfd3ceb" Dec 04 01:00:18.105127 master-0 kubenswrapper[33142]: E1204 01:00:18.098132 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" podUID="9bd87940-d718-41fb-8c75-9df5f8d2d533" Dec 04 01:00:18.271302 master-0 kubenswrapper[33142]: I1204 01:00:18.271229 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:18.277497 master-0 kubenswrapper[33142]: I1204 01:00:18.277347 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j2wv\" (UniqueName: \"kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv\") pod \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " Dec 04 01:00:18.277497 master-0 kubenswrapper[33142]: I1204 01:00:18.277431 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume\") pod \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " Dec 04 01:00:18.277497 master-0 kubenswrapper[33142]: I1204 01:00:18.277497 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume\") pod \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\" (UID: \"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8\") " Dec 04 01:00:18.279095 master-0 kubenswrapper[33142]: I1204 01:00:18.278880 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume" (OuterVolumeSpecName: "config-volume") pod "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" (UID: "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:00:18.307660 master-0 kubenswrapper[33142]: I1204 01:00:18.307519 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" (UID: "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:00:18.313980 master-0 kubenswrapper[33142]: I1204 01:00:18.313769 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv" (OuterVolumeSpecName: "kube-api-access-4j2wv") pod "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" (UID: "3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8"). InnerVolumeSpecName "kube-api-access-4j2wv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:00:18.379153 master-0 kubenswrapper[33142]: I1204 01:00:18.378864 33142 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:00:18.379153 master-0 kubenswrapper[33142]: I1204 01:00:18.378910 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4j2wv\" (UniqueName: \"kubernetes.io/projected/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-kube-api-access-4j2wv\") on node \"master-0\" DevicePath \"\"" Dec 04 01:00:18.379153 master-0 kubenswrapper[33142]: I1204 01:00:18.378937 33142 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:00:19.093791 master-0 kubenswrapper[33142]: I1204 01:00:19.093709 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" event={"ID":"3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8","Type":"ContainerDied","Data":"354db7b87b450526a0deecb8140b3c1a4bde3c2f49fb9004f0f1fe6fd962d865"} Dec 04 01:00:19.093791 master-0 kubenswrapper[33142]: I1204 01:00:19.093763 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413500-zrplt" Dec 04 01:00:19.094149 master-0 kubenswrapper[33142]: I1204 01:00:19.093769 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="354db7b87b450526a0deecb8140b3c1a4bde3c2f49fb9004f0f1fe6fd962d865" Dec 04 01:00:24.172128 master-0 kubenswrapper[33142]: I1204 01:00:24.172049 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" event={"ID":"53791b51-aa59-4ba8-a551-d56b2676906d","Type":"ContainerStarted","Data":"84728a31a8e4bb3dc738e6d6ed69777eceb340741b7f4768aa153ee600eeda32"} Dec 04 01:00:24.172806 master-0 kubenswrapper[33142]: I1204 01:00:24.172404 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 01:00:24.174426 master-0 kubenswrapper[33142]: I1204 01:00:24.174395 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" event={"ID":"434dba03-47bc-490d-b591-19a0c9d7d854","Type":"ContainerStarted","Data":"535bdf81d5b74ad4e05b3def123f349216ae6a8da883c50b77664e238d2da2c0"} Dec 04 01:00:24.174581 master-0 kubenswrapper[33142]: I1204 01:00:24.174556 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 01:00:24.175168 master-0 kubenswrapper[33142]: I1204 01:00:24.175125 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" Dec 04 01:00:24.176093 master-0 kubenswrapper[33142]: I1204 01:00:24.176066 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" Dec 04 01:00:24.177450 master-0 kubenswrapper[33142]: I1204 01:00:24.177404 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" event={"ID":"9fb1c436-8ccd-440d-bd05-14ae96f6c566","Type":"ContainerStarted","Data":"5b122fb40ade0e748fb260ce0fe6628cab383a716e95ec2a77e5da7d6b1f7b82"} Dec 04 01:00:24.177587 master-0 kubenswrapper[33142]: I1204 01:00:24.177565 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 01:00:24.182974 master-0 kubenswrapper[33142]: I1204 01:00:24.179434 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" Dec 04 01:00:24.182974 master-0 kubenswrapper[33142]: I1204 01:00:24.179780 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" event={"ID":"798f0500-ff95-4efb-af45-96e1e59b8671","Type":"ContainerStarted","Data":"c753695c1329818714b123ad8e0dea43b3ac3a93c8b7da1b35dc575ef54a4f9a"} Dec 04 01:00:24.182974 master-0 kubenswrapper[33142]: I1204 01:00:24.181332 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 01:00:24.182974 master-0 kubenswrapper[33142]: I1204 01:00:24.181867 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" Dec 04 01:00:24.191275 master-0 kubenswrapper[33142]: I1204 01:00:24.191232 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" event={"ID":"0f0386ac-cfe9-4768-82b2-53e294f7144c","Type":"ContainerStarted","Data":"0d3622f5ed4527c1133bcf7ad010b14c50dc9182fa1d64f5875c2443462d8d87"} Dec 04 01:00:24.192159 master-0 kubenswrapper[33142]: I1204 01:00:24.192128 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 01:00:24.194118 master-0 kubenswrapper[33142]: I1204 01:00:24.194086 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" Dec 04 01:00:24.205835 master-0 kubenswrapper[33142]: I1204 01:00:24.205761 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" event={"ID":"a393e2a3-e6da-4b0d-8a05-9ded7890d0c0","Type":"ContainerStarted","Data":"70c3e98dab87053501bbc8926ff68bb3002793e034c7fca43bc920cadf41476a"} Dec 04 01:00:24.208199 master-0 kubenswrapper[33142]: I1204 01:00:24.208171 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 01:00:24.212293 master-0 kubenswrapper[33142]: I1204 01:00:24.212196 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" event={"ID":"33a387d7-ebcb-496f-b392-b3e02846371b","Type":"ContainerStarted","Data":"91f423b6fce996bca6effcf9fcc6e54437421317a5a41dbe67d4569623027879"} Dec 04 01:00:24.213284 master-0 kubenswrapper[33142]: I1204 01:00:24.213204 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" Dec 04 01:00:24.230979 master-0 kubenswrapper[33142]: I1204 01:00:24.227770 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" event={"ID":"c2a33c89-5b90-4544-9198-31d26f2847c2","Type":"ContainerStarted","Data":"0a449f382ccb42ebf65d57d08d7badebda45fce54558b7a912c9b65e4d3692bb"} Dec 04 01:00:24.230979 master-0 kubenswrapper[33142]: I1204 01:00:24.230678 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 01:00:24.234987 master-0 kubenswrapper[33142]: I1204 01:00:24.231257 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" Dec 04 01:00:24.238293 master-0 kubenswrapper[33142]: I1204 01:00:24.238183 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" event={"ID":"c5968a76-308f-4959-aa55-422393155bfe","Type":"ContainerStarted","Data":"ea4a85284cb175cd1b166d23e93b9c40017521a264a11b75c499bbb52c68479b"} Dec 04 01:00:24.239401 master-0 kubenswrapper[33142]: I1204 01:00:24.239376 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 01:00:24.242597 master-0 kubenswrapper[33142]: I1204 01:00:24.242557 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" Dec 04 01:00:24.244609 master-0 kubenswrapper[33142]: I1204 01:00:24.244554 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-r69wz" podStartSLOduration=3.2920967340000002 podStartE2EDuration="29.24454266s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.790600203 +0000 UTC m=+770.192602053" lastFinishedPulling="2025-12-04 01:00:23.743046139 +0000 UTC m=+796.145047979" observedRunningTime="2025-12-04 01:00:24.239709664 +0000 UTC m=+796.641711514" watchObservedRunningTime="2025-12-04 01:00:24.24454266 +0000 UTC m=+796.646544510" Dec 04 01:00:24.245218 master-0 kubenswrapper[33142]: I1204 01:00:24.245181 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-bgx5n" podStartSLOduration=4.078822584 podStartE2EDuration="30.245176688s" podCreationTimestamp="2025-12-04 00:59:54 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.868253382 +0000 UTC m=+769.270255242" lastFinishedPulling="2025-12-04 01:00:23.034607496 +0000 UTC m=+795.436609346" observedRunningTime="2025-12-04 01:00:24.20871105 +0000 UTC m=+796.610712920" watchObservedRunningTime="2025-12-04 01:00:24.245176688 +0000 UTC m=+796.647178528" Dec 04 01:00:24.246507 master-0 kubenswrapper[33142]: I1204 01:00:24.246454 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" event={"ID":"545afb94-f451-4925-a2c5-ae7c523eceac","Type":"ContainerStarted","Data":"5e373166c6184c811fba317006566efd684b4006e2da66558429b43d671057dc"} Dec 04 01:00:24.246576 master-0 kubenswrapper[33142]: I1204 01:00:24.246521 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" event={"ID":"545afb94-f451-4925-a2c5-ae7c523eceac","Type":"ContainerStarted","Data":"d20f06f61639d9ad686514ef7c7e7b916ad77246b62b48132e1310caaeccc794"} Dec 04 01:00:24.247630 master-0 kubenswrapper[33142]: I1204 01:00:24.247585 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 01:00:24.250209 master-0 kubenswrapper[33142]: I1204 01:00:24.250158 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" event={"ID":"3439031c-2821-4ca2-8a3a-c7209616626c","Type":"ContainerStarted","Data":"b58170f6874fa4622dfd959557109cc9669277db84d0bd68c216a80bd0cda063"} Dec 04 01:00:24.250382 master-0 kubenswrapper[33142]: I1204 01:00:24.250355 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 01:00:24.252015 master-0 kubenswrapper[33142]: I1204 01:00:24.251987 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" Dec 04 01:00:24.252587 master-0 kubenswrapper[33142]: I1204 01:00:24.252544 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" event={"ID":"1a6c34b6-772e-4b4e-9040-32a82a894bce","Type":"ContainerStarted","Data":"097aecca8dce1295b14e2f00d39fbd3fb30f18a2941e9ad30a416c1f2020d32d"} Dec 04 01:00:24.254202 master-0 kubenswrapper[33142]: I1204 01:00:24.254166 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 01:00:24.254768 master-0 kubenswrapper[33142]: I1204 01:00:24.254722 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" Dec 04 01:00:24.256220 master-0 kubenswrapper[33142]: I1204 01:00:24.256183 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" event={"ID":"69169dc7-8238-4110-9952-a1257aa8a2de","Type":"ContainerStarted","Data":"e90199fe7a0905e8b46bc9938084ff01a29cb2ed389df3b3278618eae0abd8b8"} Dec 04 01:00:24.256357 master-0 kubenswrapper[33142]: I1204 01:00:24.256332 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 01:00:24.257623 master-0 kubenswrapper[33142]: I1204 01:00:24.257587 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" Dec 04 01:00:24.258341 master-0 kubenswrapper[33142]: I1204 01:00:24.258296 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" event={"ID":"5cee34f9-9f29-4f15-ad66-2e35b8aeab07","Type":"ContainerStarted","Data":"48327e92b942b3f777d8404777a6ee17025cbc4acd5c8838997be0c4e1fa0d93"} Dec 04 01:00:24.259717 master-0 kubenswrapper[33142]: I1204 01:00:24.259682 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 01:00:24.260260 master-0 kubenswrapper[33142]: I1204 01:00:24.260229 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" Dec 04 01:00:24.264347 master-0 kubenswrapper[33142]: I1204 01:00:24.261608 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" event={"ID":"5cc8e00d-68c1-4f43-a992-8e2f26beb79d","Type":"ContainerStarted","Data":"01bc35e529d107ac8083006db6d093730a9ce96e7d6a45285447c5f827b12f04"} Dec 04 01:00:24.264347 master-0 kubenswrapper[33142]: I1204 01:00:24.264095 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 01:00:24.271997 master-0 kubenswrapper[33142]: I1204 01:00:24.268655 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" Dec 04 01:00:24.275168 master-0 kubenswrapper[33142]: I1204 01:00:24.275075 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-lvfdv" podStartSLOduration=3.781162295 podStartE2EDuration="29.27504864s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.758427256 +0000 UTC m=+770.160429106" lastFinishedPulling="2025-12-04 01:00:23.252313581 +0000 UTC m=+795.654315451" observedRunningTime="2025-12-04 01:00:24.265224323 +0000 UTC m=+796.667226193" watchObservedRunningTime="2025-12-04 01:00:24.27504864 +0000 UTC m=+796.677050490" Dec 04 01:00:24.276667 master-0 kubenswrapper[33142]: I1204 01:00:24.275126 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" event={"ID":"cfe2c5a2-44c7-4cbb-8861-984f5666aa62","Type":"ContainerStarted","Data":"f8fddbb7c599129900ab7bd1f1d1ddb8a565dca6329a39d950cb42dc73255da7"} Dec 04 01:00:24.276753 master-0 kubenswrapper[33142]: I1204 01:00:24.276684 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 01:00:24.279194 master-0 kubenswrapper[33142]: I1204 01:00:24.279154 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" Dec 04 01:00:24.329968 master-0 kubenswrapper[33142]: I1204 01:00:24.329251 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-gbq9l" podStartSLOduration=5.104535417 podStartE2EDuration="30.329230456s" podCreationTimestamp="2025-12-04 00:59:54 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.790898341 +0000 UTC m=+770.192900191" lastFinishedPulling="2025-12-04 01:00:23.01559337 +0000 UTC m=+795.417595230" observedRunningTime="2025-12-04 01:00:24.325404829 +0000 UTC m=+796.727406689" watchObservedRunningTime="2025-12-04 01:00:24.329230456 +0000 UTC m=+796.731232306" Dec 04 01:00:24.442360 master-0 kubenswrapper[33142]: I1204 01:00:24.442242 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-jn5j4" podStartSLOduration=4.352529376 podStartE2EDuration="29.44221416s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:58.075348497 +0000 UTC m=+770.477350347" lastFinishedPulling="2025-12-04 01:00:23.165033271 +0000 UTC m=+795.567035131" observedRunningTime="2025-12-04 01:00:24.418276056 +0000 UTC m=+796.820277916" watchObservedRunningTime="2025-12-04 01:00:24.44221416 +0000 UTC m=+796.844216010" Dec 04 01:00:24.451907 master-0 kubenswrapper[33142]: I1204 01:00:24.449822 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-hq5cz" podStartSLOduration=5.320100712 podStartE2EDuration="29.449796964s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:58.905712096 +0000 UTC m=+771.307713946" lastFinishedPulling="2025-12-04 01:00:23.035408338 +0000 UTC m=+795.437410198" observedRunningTime="2025-12-04 01:00:24.444301619 +0000 UTC m=+796.846303469" watchObservedRunningTime="2025-12-04 01:00:24.449796964 +0000 UTC m=+796.851798834" Dec 04 01:00:24.508121 master-0 kubenswrapper[33142]: I1204 01:00:24.505783 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-tcq9h" podStartSLOduration=3.807356505 podStartE2EDuration="30.505754411s" podCreationTimestamp="2025-12-04 00:59:54 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.438467241 +0000 UTC m=+768.840469091" lastFinishedPulling="2025-12-04 01:00:23.136865137 +0000 UTC m=+795.538866997" observedRunningTime="2025-12-04 01:00:24.471388712 +0000 UTC m=+796.873390602" watchObservedRunningTime="2025-12-04 01:00:24.505754411 +0000 UTC m=+796.907756271" Dec 04 01:00:24.514443 master-0 kubenswrapper[33142]: I1204 01:00:24.514368 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-q8sqk" podStartSLOduration=5.324523666 podStartE2EDuration="29.514349913s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:58.07582471 +0000 UTC m=+770.477826560" lastFinishedPulling="2025-12-04 01:00:22.265650957 +0000 UTC m=+794.667652807" observedRunningTime="2025-12-04 01:00:24.512394728 +0000 UTC m=+796.914396598" watchObservedRunningTime="2025-12-04 01:00:24.514349913 +0000 UTC m=+796.916351773" Dec 04 01:00:24.564964 master-0 kubenswrapper[33142]: I1204 01:00:24.562787 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-cspvd" podStartSLOduration=2.840450426 podStartE2EDuration="29.562768577s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.888164253 +0000 UTC m=+769.290166113" lastFinishedPulling="2025-12-04 01:00:23.610482414 +0000 UTC m=+796.012484264" observedRunningTime="2025-12-04 01:00:24.55860592 +0000 UTC m=+796.960607770" watchObservedRunningTime="2025-12-04 01:00:24.562768577 +0000 UTC m=+796.964770427" Dec 04 01:00:24.602964 master-0 kubenswrapper[33142]: I1204 01:00:24.601074 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-f9nxh" podStartSLOduration=2.992846392 podStartE2EDuration="29.601007845s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.972614713 +0000 UTC m=+769.374616563" lastFinishedPulling="2025-12-04 01:00:23.580776166 +0000 UTC m=+795.982778016" observedRunningTime="2025-12-04 01:00:24.580566489 +0000 UTC m=+796.982568369" watchObservedRunningTime="2025-12-04 01:00:24.601007845 +0000 UTC m=+797.003009685" Dec 04 01:00:24.715862 master-0 kubenswrapper[33142]: I1204 01:00:24.715751 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ovn-operator-controller-manager-647f96877-pfgt2" podStartSLOduration=4.33667206 podStartE2EDuration="29.715724418s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.756846322 +0000 UTC m=+770.158848172" lastFinishedPulling="2025-12-04 01:00:23.13589867 +0000 UTC m=+795.537900530" observedRunningTime="2025-12-04 01:00:24.636399242 +0000 UTC m=+797.038401102" watchObservedRunningTime="2025-12-04 01:00:24.715724418 +0000 UTC m=+797.117726288" Dec 04 01:00:24.725960 master-0 kubenswrapper[33142]: I1204 01:00:24.725090 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-jx6n4" podStartSLOduration=4.487531631 podStartE2EDuration="29.725070281s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.816498593 +0000 UTC m=+770.218500443" lastFinishedPulling="2025-12-04 01:00:23.054037243 +0000 UTC m=+795.456039093" observedRunningTime="2025-12-04 01:00:24.655601713 +0000 UTC m=+797.057603573" watchObservedRunningTime="2025-12-04 01:00:24.725070281 +0000 UTC m=+797.127072141" Dec 04 01:00:24.730353 master-0 kubenswrapper[33142]: I1204 01:00:24.730285 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-2zzvg" podStartSLOduration=4.099920508 podStartE2EDuration="29.730271077s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.785691195 +0000 UTC m=+770.187693045" lastFinishedPulling="2025-12-04 01:00:23.416041764 +0000 UTC m=+795.818043614" observedRunningTime="2025-12-04 01:00:24.691831234 +0000 UTC m=+797.093833114" watchObservedRunningTime="2025-12-04 01:00:24.730271077 +0000 UTC m=+797.132272937" Dec 04 01:00:24.836326 master-0 kubenswrapper[33142]: I1204 01:00:24.835023 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-8jjc8" podStartSLOduration=3.424759753 podStartE2EDuration="29.834904076s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.906707356 +0000 UTC m=+769.308709206" lastFinishedPulling="2025-12-04 01:00:23.316851679 +0000 UTC m=+795.718853529" observedRunningTime="2025-12-04 01:00:24.831717376 +0000 UTC m=+797.233719246" watchObservedRunningTime="2025-12-04 01:00:24.834904076 +0000 UTC m=+797.236905936" Dec 04 01:00:24.913373 master-0 kubenswrapper[33142]: I1204 01:00:24.913228 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-z9r4l" podStartSLOduration=4.024321597 podStartE2EDuration="29.913189972s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.758309583 +0000 UTC m=+770.160311423" lastFinishedPulling="2025-12-04 01:00:23.647177948 +0000 UTC m=+796.049179798" observedRunningTime="2025-12-04 01:00:24.868697058 +0000 UTC m=+797.270698948" watchObservedRunningTime="2025-12-04 01:00:24.913189972 +0000 UTC m=+797.315191812" Dec 04 01:00:24.955546 master-0 kubenswrapper[33142]: I1204 01:00:24.955433 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" podStartSLOduration=5.728279824 podStartE2EDuration="29.955407682s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:58.038158819 +0000 UTC m=+770.440160669" lastFinishedPulling="2025-12-04 01:00:22.265286677 +0000 UTC m=+794.667288527" observedRunningTime="2025-12-04 01:00:24.897474209 +0000 UTC m=+797.299476089" watchObservedRunningTime="2025-12-04 01:00:24.955407682 +0000 UTC m=+797.357409542" Dec 04 01:00:25.313328 master-0 kubenswrapper[33142]: I1204 01:00:25.313180 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" Dec 04 01:00:25.553340 master-0 kubenswrapper[33142]: I1204 01:00:25.553274 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" Dec 04 01:00:26.072369 master-0 kubenswrapper[33142]: I1204 01:00:26.072296 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" Dec 04 01:00:26.208200 master-0 kubenswrapper[33142]: I1204 01:00:26.208090 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" Dec 04 01:00:26.301164 master-0 kubenswrapper[33142]: I1204 01:00:26.300857 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" event={"ID":"58438a63-fa86-4e22-8d98-be5cf1c40264","Type":"ContainerStarted","Data":"cc5b50e2b2eb8eb7ef5c8504fdad649e17946944fb9ebcc4874af2c4f80997da"} Dec 04 01:00:26.306522 master-0 kubenswrapper[33142]: I1204 01:00:26.305251 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" event={"ID":"3f5f4c5e-4c55-4167-9159-19cfc8aad88e","Type":"ContainerStarted","Data":"2eb2a0fc9be6afef94dfbc52ed3afe4aebc19c9ff3f4c393194e84f3f8be9b10"} Dec 04 01:00:26.307972 master-0 kubenswrapper[33142]: I1204 01:00:26.307891 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" event={"ID":"5e899b35-648a-4366-93c5-af7e1bfd3ceb","Type":"ContainerStarted","Data":"042d70ba8e6ea1b71c324762e2271099d16153ccdee63a7029205bf8a8c95aae"} Dec 04 01:00:26.325118 master-0 kubenswrapper[33142]: I1204 01:00:26.324889 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-shzxs" podStartSLOduration=15.116122825 podStartE2EDuration="31.324866872s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.780076406 +0000 UTC m=+770.182078246" lastFinishedPulling="2025-12-04 01:00:13.988820443 +0000 UTC m=+786.390822293" observedRunningTime="2025-12-04 01:00:26.3226799 +0000 UTC m=+798.724681770" watchObservedRunningTime="2025-12-04 01:00:26.324866872 +0000 UTC m=+798.726868722" Dec 04 01:00:26.364780 master-0 kubenswrapper[33142]: I1204 01:00:26.364665 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-scqmz" podStartSLOduration=15.286750744 podStartE2EDuration="32.364611102s" podCreationTimestamp="2025-12-04 00:59:54 +0000 UTC" firstStartedPulling="2025-12-04 00:59:56.87031296 +0000 UTC m=+769.272314810" lastFinishedPulling="2025-12-04 01:00:13.948173328 +0000 UTC m=+786.350175168" observedRunningTime="2025-12-04 01:00:26.357328147 +0000 UTC m=+798.759330007" watchObservedRunningTime="2025-12-04 01:00:26.364611102 +0000 UTC m=+798.766612952" Dec 04 01:00:26.398312 master-0 kubenswrapper[33142]: I1204 01:00:26.398199 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-696b999796-lbkjq" podStartSLOduration=15.165640181 podStartE2EDuration="31.398167908s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:57.756611645 +0000 UTC m=+770.158613495" lastFinishedPulling="2025-12-04 01:00:13.989139372 +0000 UTC m=+786.391141222" observedRunningTime="2025-12-04 01:00:26.377973739 +0000 UTC m=+798.779975609" watchObservedRunningTime="2025-12-04 01:00:26.398167908 +0000 UTC m=+798.800169788" Dec 04 01:00:27.324514 master-0 kubenswrapper[33142]: I1204 01:00:27.324398 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:27.326631 master-0 kubenswrapper[33142]: I1204 01:00:27.326571 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" event={"ID":"9bd87940-d718-41fb-8c75-9df5f8d2d533","Type":"ContainerStarted","Data":"d6e7b84976c1b253facd7d3a30a1d220d0e2286cd62f0af17cca50257d3de2f1"} Dec 04 01:00:27.328186 master-0 kubenswrapper[33142]: I1204 01:00:27.328140 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2f9076e-1023-47e4-854b-bd4642d1aab0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-ckrg7\" (UID: \"b2f9076e-1023-47e4-854b-bd4642d1aab0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:27.343871 master-0 kubenswrapper[33142]: I1204 01:00:27.343748 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:27.379578 master-0 kubenswrapper[33142]: I1204 01:00:27.379416 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-r57k8" podStartSLOduration=16.428122156 podStartE2EDuration="32.379372147s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 00:59:58.037764878 +0000 UTC m=+770.439766728" lastFinishedPulling="2025-12-04 01:00:13.989014869 +0000 UTC m=+786.391016719" observedRunningTime="2025-12-04 01:00:27.367967486 +0000 UTC m=+799.769969426" watchObservedRunningTime="2025-12-04 01:00:27.379372147 +0000 UTC m=+799.781374077" Dec 04 01:00:27.734681 master-0 kubenswrapper[33142]: I1204 01:00:27.734576 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:27.743116 master-0 kubenswrapper[33142]: I1204 01:00:27.743048 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e835d214-54bb-41b3-b7a4-1c0820634411-cert\") pod \"openstack-baremetal-operator-controller-manager-6cb6d6b947mths8\" (UID: \"e835d214-54bb-41b3-b7a4-1c0820634411\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:27.967343 master-0 kubenswrapper[33142]: I1204 01:00:27.967149 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:28.018384 master-0 kubenswrapper[33142]: I1204 01:00:28.018319 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7"] Dec 04 01:00:28.018817 master-0 kubenswrapper[33142]: W1204 01:00:28.018758 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f9076e_1023_47e4_854b_bd4642d1aab0.slice/crio-f539d2c0981fc366c2680ae6f3db0041b9c16e7fd6c22484b66cab8c9dc64cfd WatchSource:0}: Error finding container f539d2c0981fc366c2680ae6f3db0041b9c16e7fd6c22484b66cab8c9dc64cfd: Status 404 returned error can't find the container with id f539d2c0981fc366c2680ae6f3db0041b9c16e7fd6c22484b66cab8c9dc64cfd Dec 04 01:00:28.040441 master-0 kubenswrapper[33142]: I1204 01:00:28.040365 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:28.040719 master-0 kubenswrapper[33142]: I1204 01:00:28.040515 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:28.043809 master-0 kubenswrapper[33142]: I1204 01:00:28.043773 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-webhook-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:28.043961 master-0 kubenswrapper[33142]: I1204 01:00:28.043908 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d72fbbd-fa51-41a1-a06a-fd3e56f48196-metrics-certs\") pod \"openstack-operator-controller-manager-57d98476c4-46jc9\" (UID: \"9d72fbbd-fa51-41a1-a06a-fd3e56f48196\") " pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:28.265660 master-0 kubenswrapper[33142]: I1204 01:00:28.265507 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:28.341662 master-0 kubenswrapper[33142]: I1204 01:00:28.341531 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" event={"ID":"b2f9076e-1023-47e4-854b-bd4642d1aab0","Type":"ContainerStarted","Data":"f539d2c0981fc366c2680ae6f3db0041b9c16e7fd6c22484b66cab8c9dc64cfd"} Dec 04 01:00:28.454891 master-0 kubenswrapper[33142]: W1204 01:00:28.454828 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode835d214_54bb_41b3_b7a4_1c0820634411.slice/crio-e59c4f8cb3cd0a71f356a0963c192520613053112f7fcf7db0c98abc9112b6fc WatchSource:0}: Error finding container e59c4f8cb3cd0a71f356a0963c192520613053112f7fcf7db0c98abc9112b6fc: Status 404 returned error can't find the container with id e59c4f8cb3cd0a71f356a0963c192520613053112f7fcf7db0c98abc9112b6fc Dec 04 01:00:28.462425 master-0 kubenswrapper[33142]: I1204 01:00:28.462342 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8"] Dec 04 01:00:28.865260 master-0 kubenswrapper[33142]: W1204 01:00:28.865193 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d72fbbd_fa51_41a1_a06a_fd3e56f48196.slice/crio-613165fc251ab223fc4b9c2ddb6d9162cda52c577743abed022c8fcf5071e57b WatchSource:0}: Error finding container 613165fc251ab223fc4b9c2ddb6d9162cda52c577743abed022c8fcf5071e57b: Status 404 returned error can't find the container with id 613165fc251ab223fc4b9c2ddb6d9162cda52c577743abed022c8fcf5071e57b Dec 04 01:00:28.868225 master-0 kubenswrapper[33142]: I1204 01:00:28.868150 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9"] Dec 04 01:00:29.354552 master-0 kubenswrapper[33142]: I1204 01:00:29.354468 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" event={"ID":"9d72fbbd-fa51-41a1-a06a-fd3e56f48196","Type":"ContainerStarted","Data":"ba008eb0acccdd0d86828cfa4fc8a50fa7f5f3e7f14aa39db1ab51719cfcbc79"} Dec 04 01:00:29.354552 master-0 kubenswrapper[33142]: I1204 01:00:29.354555 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" event={"ID":"9d72fbbd-fa51-41a1-a06a-fd3e56f48196","Type":"ContainerStarted","Data":"613165fc251ab223fc4b9c2ddb6d9162cda52c577743abed022c8fcf5071e57b"} Dec 04 01:00:29.355131 master-0 kubenswrapper[33142]: I1204 01:00:29.355063 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:00:29.358011 master-0 kubenswrapper[33142]: I1204 01:00:29.357945 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" event={"ID":"e835d214-54bb-41b3-b7a4-1c0820634411","Type":"ContainerStarted","Data":"e59c4f8cb3cd0a71f356a0963c192520613053112f7fcf7db0c98abc9112b6fc"} Dec 04 01:00:29.399278 master-0 kubenswrapper[33142]: I1204 01:00:29.399158 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" podStartSLOduration=34.399104191 podStartE2EDuration="34.399104191s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:00:29.394328046 +0000 UTC m=+801.796329906" watchObservedRunningTime="2025-12-04 01:00:29.399104191 +0000 UTC m=+801.801106041" Dec 04 01:00:31.386418 master-0 kubenswrapper[33142]: I1204 01:00:31.386327 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" event={"ID":"e835d214-54bb-41b3-b7a4-1c0820634411","Type":"ContainerStarted","Data":"eb4812f84ff3c2ec6c67d1e5c48bad161def46000da5c2b0578ccbe3f5e7a89c"} Dec 04 01:00:31.390031 master-0 kubenswrapper[33142]: I1204 01:00:31.389944 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" event={"ID":"b2f9076e-1023-47e4-854b-bd4642d1aab0","Type":"ContainerStarted","Data":"accc1cce9e45a492f474947e3f3642c1a6715ecc60c5dee5e70465dd43c64fb5"} Dec 04 01:00:31.390031 master-0 kubenswrapper[33142]: I1204 01:00:31.389992 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" event={"ID":"b2f9076e-1023-47e4-854b-bd4642d1aab0","Type":"ContainerStarted","Data":"c3ebfeb4961370ca5de7b0366b6b97400ba6055a0803bb18c96961ce6033780e"} Dec 04 01:00:31.391797 master-0 kubenswrapper[33142]: I1204 01:00:31.391466 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:31.428392 master-0 kubenswrapper[33142]: I1204 01:00:31.428224 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" podStartSLOduration=33.695573025 podStartE2EDuration="36.428181258s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 01:00:28.021676176 +0000 UTC m=+800.423678026" lastFinishedPulling="2025-12-04 01:00:30.754284409 +0000 UTC m=+803.156286259" observedRunningTime="2025-12-04 01:00:31.413437283 +0000 UTC m=+803.815439173" watchObservedRunningTime="2025-12-04 01:00:31.428181258 +0000 UTC m=+803.830183158" Dec 04 01:00:32.409678 master-0 kubenswrapper[33142]: I1204 01:00:32.409570 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" event={"ID":"e835d214-54bb-41b3-b7a4-1c0820634411","Type":"ContainerStarted","Data":"58d0f4136edea47ae734e7be42784cb8a747ad2de841c579dd0ace462f279df7"} Dec 04 01:00:32.410496 master-0 kubenswrapper[33142]: I1204 01:00:32.409710 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:32.447846 master-0 kubenswrapper[33142]: I1204 01:00:32.447711 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" podStartSLOduration=35.133192466 podStartE2EDuration="37.447673607s" podCreationTimestamp="2025-12-04 00:59:55 +0000 UTC" firstStartedPulling="2025-12-04 01:00:28.457821786 +0000 UTC m=+800.859823636" lastFinishedPulling="2025-12-04 01:00:30.772302927 +0000 UTC m=+803.174304777" observedRunningTime="2025-12-04 01:00:32.444663552 +0000 UTC m=+804.846665472" watchObservedRunningTime="2025-12-04 01:00:32.447673607 +0000 UTC m=+804.849675467" Dec 04 01:00:36.326041 master-0 kubenswrapper[33142]: I1204 01:00:36.325967 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-fc5zs" Dec 04 01:00:37.350829 master-0 kubenswrapper[33142]: I1204 01:00:37.350686 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-ckrg7" Dec 04 01:00:37.975534 master-0 kubenswrapper[33142]: I1204 01:00:37.975285 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6cb6d6b947mths8" Dec 04 01:00:38.279663 master-0 kubenswrapper[33142]: I1204 01:00:38.279473 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-manager-57d98476c4-46jc9" Dec 04 01:01:17.215084 master-0 kubenswrapper[33142]: E1204 01:01:17.215023 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/NetworkManager-dispatcher.service\": RecentStats: unable to find data in memory cache]" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.078544 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: E1204 01:01:24.079322 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" containerName="collect-profiles" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.080768 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" containerName="collect-profiles" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.081093 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a5dbf15-ddfa-41a9-90a4-07f12d17c0a8" containerName="collect-profiles" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.084071 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.089502 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openshift-service-ca.crt" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.089868 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Dec 04 01:01:24.091972 master-0 kubenswrapper[33142]: I1204 01:01:24.089879 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"kube-root-ca.crt" Dec 04 01:01:24.113850 master-0 kubenswrapper[33142]: I1204 01:01:24.111322 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:24.136898 master-0 kubenswrapper[33142]: I1204 01:01:24.136805 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x74\" (UniqueName: \"kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.136898 master-0 kubenswrapper[33142]: I1204 01:01:24.136899 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.187099 master-0 kubenswrapper[33142]: I1204 01:01:24.187006 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:01:24.189165 master-0 kubenswrapper[33142]: I1204 01:01:24.189101 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.205157 master-0 kubenswrapper[33142]: I1204 01:01:24.194895 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Dec 04 01:01:24.205157 master-0 kubenswrapper[33142]: I1204 01:01:24.198375 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:01:24.241795 master-0 kubenswrapper[33142]: I1204 01:01:24.241688 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4f8x\" (UniqueName: \"kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.243682 master-0 kubenswrapper[33142]: I1204 01:01:24.243600 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-94x74\" (UniqueName: \"kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.243751 master-0 kubenswrapper[33142]: I1204 01:01:24.243737 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.244261 master-0 kubenswrapper[33142]: I1204 01:01:24.244192 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.244522 master-0 kubenswrapper[33142]: I1204 01:01:24.244506 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.261447 master-0 kubenswrapper[33142]: I1204 01:01:24.261365 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.278083 master-0 kubenswrapper[33142]: I1204 01:01:24.278021 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x74\" (UniqueName: \"kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74\") pod \"dnsmasq-dns-5dbfd7c4bf-kbpk4\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.348513 master-0 kubenswrapper[33142]: I1204 01:01:24.348104 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.348513 master-0 kubenswrapper[33142]: I1204 01:01:24.348229 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.348513 master-0 kubenswrapper[33142]: I1204 01:01:24.348308 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l4f8x\" (UniqueName: \"kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.350196 master-0 kubenswrapper[33142]: I1204 01:01:24.350145 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.350367 master-0 kubenswrapper[33142]: I1204 01:01:24.350325 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.374288 master-0 kubenswrapper[33142]: I1204 01:01:24.373920 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4f8x\" (UniqueName: \"kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x\") pod \"dnsmasq-dns-75d7c5dbd7-j4d5q\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.447789 master-0 kubenswrapper[33142]: I1204 01:01:24.447720 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:24.534852 master-0 kubenswrapper[33142]: I1204 01:01:24.534748 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:24.886257 master-0 kubenswrapper[33142]: I1204 01:01:24.885816 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:24.926041 master-0 kubenswrapper[33142]: I1204 01:01:24.925973 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:24.928880 master-0 kubenswrapper[33142]: I1204 01:01:24.928845 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:24.936078 master-0 kubenswrapper[33142]: I1204 01:01:24.936004 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:25.085302 master-0 kubenswrapper[33142]: I1204 01:01:25.085219 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.085302 master-0 kubenswrapper[33142]: I1204 01:01:25.085311 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.085779 master-0 kubenswrapper[33142]: I1204 01:01:25.085569 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8sc\" (UniqueName: \"kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.187914 master-0 kubenswrapper[33142]: I1204 01:01:25.187702 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8sc\" (UniqueName: \"kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.188535 master-0 kubenswrapper[33142]: I1204 01:01:25.188366 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.188535 master-0 kubenswrapper[33142]: I1204 01:01:25.188399 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.192957 master-0 kubenswrapper[33142]: I1204 01:01:25.189534 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.192957 master-0 kubenswrapper[33142]: I1204 01:01:25.190325 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.232908 master-0 kubenswrapper[33142]: I1204 01:01:25.226209 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:25.232908 master-0 kubenswrapper[33142]: I1204 01:01:25.226222 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8sc\" (UniqueName: \"kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc\") pod \"dnsmasq-dns-6f856ff86c-j7vfz\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.244984 master-0 kubenswrapper[33142]: I1204 01:01:25.243253 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 01:01:25.283989 master-0 kubenswrapper[33142]: I1204 01:01:25.281356 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:01:25.288129 master-0 kubenswrapper[33142]: I1204 01:01:25.286422 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:25.687730 master-0 kubenswrapper[33142]: I1204 01:01:25.687284 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:25.759095 master-0 kubenswrapper[33142]: I1204 01:01:25.758986 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:01:25.766006 master-0 kubenswrapper[33142]: I1204 01:01:25.764128 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.773144 master-0 kubenswrapper[33142]: I1204 01:01:25.773067 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:01:25.843183 master-0 kubenswrapper[33142]: I1204 01:01:25.842901 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrd48\" (UniqueName: \"kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.843183 master-0 kubenswrapper[33142]: I1204 01:01:25.843067 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.843183 master-0 kubenswrapper[33142]: I1204 01:01:25.843103 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.959890 master-0 kubenswrapper[33142]: I1204 01:01:25.959721 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.959890 master-0 kubenswrapper[33142]: I1204 01:01:25.959840 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.962106 master-0 kubenswrapper[33142]: I1204 01:01:25.962083 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.963495 master-0 kubenswrapper[33142]: I1204 01:01:25.963466 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lrd48\" (UniqueName: \"kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.966751 master-0 kubenswrapper[33142]: I1204 01:01:25.966704 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:25.988755 master-0 kubenswrapper[33142]: I1204 01:01:25.988697 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrd48\" (UniqueName: \"kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48\") pod \"dnsmasq-dns-658bb5765c-92v9d\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:26.073539 master-0 kubenswrapper[33142]: I1204 01:01:26.072746 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:26.204815 master-0 kubenswrapper[33142]: I1204 01:01:26.204389 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:26.278186 master-0 kubenswrapper[33142]: I1204 01:01:26.278101 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" event={"ID":"6afe080c-046d-409a-b00e-29bb8176cb4c","Type":"ContainerStarted","Data":"10b4b544daef413ac85b95bf6b05ea481feb2d94d903206f6552515f67f47ac8"} Dec 04 01:01:26.281593 master-0 kubenswrapper[33142]: I1204 01:01:26.280864 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" event={"ID":"f65e347e-5f35-4964-b087-d00d7087493a","Type":"ContainerStarted","Data":"3c641708fddd2d03b24286a83030a41d12a8bd1b034948da8fafc030112faad5"} Dec 04 01:01:26.283324 master-0 kubenswrapper[33142]: I1204 01:01:26.283275 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" event={"ID":"6a8f6791-d8d8-4c35-81e0-527ce3232f70","Type":"ContainerStarted","Data":"ed56ddba34a8105bb8261eba0cc06dff4a320364322369bf2c28102fa1d27bfe"} Dec 04 01:01:27.278040 master-0 kubenswrapper[33142]: I1204 01:01:27.277987 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:01:27.354288 master-0 kubenswrapper[33142]: I1204 01:01:27.354215 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" event={"ID":"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68","Type":"ContainerStarted","Data":"427a4f00773ba785dbe97ac62ab11b8a7c07d7effd5b44cbf99d376b2ebd4312"} Dec 04 01:01:29.419772 master-0 kubenswrapper[33142]: I1204 01:01:29.419701 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 01:01:29.426241 master-0 kubenswrapper[33142]: I1204 01:01:29.426008 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.432029 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-erlang-cookie" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.432317 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-config-data" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.432489 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-plugins-conf" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.432874 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-svc" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.433657 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-server-conf" Dec 04 01:01:29.434832 master-0 kubenswrapper[33142]: I1204 01:01:29.433790 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-default-user" Dec 04 01:01:29.455010 master-0 kubenswrapper[33142]: I1204 01:01:29.449668 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.462979 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8c9c\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-kube-api-access-s8c9c\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463043 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-config-data\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463065 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463085 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463122 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463152 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-7b62fa04-bfe3-4167-8ec3-a8210e8722e0\" (UniqueName: \"kubernetes.io/csi/topolvm.io^556eb694-7255-4b59-8a19-ce1c402c0fb0\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463179 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463203 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463223 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463244 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/fba01013-8dd9-433e-8c42-887c0423c58f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.468661 master-0 kubenswrapper[33142]: I1204 01:01:29.463280 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/fba01013-8dd9-433e-8c42-887c0423c58f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569167 master-0 kubenswrapper[33142]: I1204 01:01:29.569100 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569442 master-0 kubenswrapper[33142]: I1204 01:01:29.569238 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-7b62fa04-bfe3-4167-8ec3-a8210e8722e0\" (UniqueName: \"kubernetes.io/csi/topolvm.io^556eb694-7255-4b59-8a19-ce1c402c0fb0\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569442 master-0 kubenswrapper[33142]: I1204 01:01:29.569315 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569442 master-0 kubenswrapper[33142]: I1204 01:01:29.569361 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569442 master-0 kubenswrapper[33142]: I1204 01:01:29.569402 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569663 master-0 kubenswrapper[33142]: I1204 01:01:29.569594 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/fba01013-8dd9-433e-8c42-887c0423c58f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569788 master-0 kubenswrapper[33142]: I1204 01:01:29.569710 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/fba01013-8dd9-433e-8c42-887c0423c58f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569847 master-0 kubenswrapper[33142]: I1204 01:01:29.569808 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s8c9c\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-kube-api-access-s8c9c\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569903 master-0 kubenswrapper[33142]: I1204 01:01:29.569844 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-config-data\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.569903 master-0 kubenswrapper[33142]: I1204 01:01:29.569877 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.570018 master-0 kubenswrapper[33142]: I1204 01:01:29.569909 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.570754 master-0 kubenswrapper[33142]: I1204 01:01:29.570724 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.571303 master-0 kubenswrapper[33142]: I1204 01:01:29.571270 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.571754 master-0 kubenswrapper[33142]: I1204 01:01:29.571716 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-config-data\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.574490 master-0 kubenswrapper[33142]: I1204 01:01:29.574448 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/fba01013-8dd9-433e-8c42-887c0423c58f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.574717 master-0 kubenswrapper[33142]: I1204 01:01:29.574672 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.576622 master-0 kubenswrapper[33142]: I1204 01:01:29.576561 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/fba01013-8dd9-433e-8c42-887c0423c58f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.583029 master-0 kubenswrapper[33142]: I1204 01:01:29.581995 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/fba01013-8dd9-433e-8c42-887c0423c58f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.598236 master-0 kubenswrapper[33142]: I1204 01:01:29.595027 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.598236 master-0 kubenswrapper[33142]: I1204 01:01:29.595087 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.600007 master-0 kubenswrapper[33142]: I1204 01:01:29.598617 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:29.600007 master-0 kubenswrapper[33142]: I1204 01:01:29.598714 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-7b62fa04-bfe3-4167-8ec3-a8210e8722e0\" (UniqueName: \"kubernetes.io/csi/topolvm.io^556eb694-7255-4b59-8a19-ce1c402c0fb0\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/f727b2f44461fb7f80943ee839f1a133a2f3b773389a8d59fac156bc71ec9057/globalmount\"" pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.616895 master-0 kubenswrapper[33142]: I1204 01:01:29.616832 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8c9c\" (UniqueName: \"kubernetes.io/projected/fba01013-8dd9-433e-8c42-887c0423c58f-kube-api-access-s8c9c\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:29.718521 master-0 kubenswrapper[33142]: I1204 01:01:29.717649 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/memcached-0"] Dec 04 01:01:29.723705 master-0 kubenswrapper[33142]: I1204 01:01:29.723604 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Dec 04 01:01:29.737003 master-0 kubenswrapper[33142]: I1204 01:01:29.736752 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-memcached-svc" Dec 04 01:01:29.737003 master-0 kubenswrapper[33142]: I1204 01:01:29.736789 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"memcached-config-data" Dec 04 01:01:29.751304 master-0 kubenswrapper[33142]: I1204 01:01:29.751188 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"combined-ca-bundle" Dec 04 01:01:29.760451 master-0 kubenswrapper[33142]: I1204 01:01:29.760339 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Dec 04 01:01:29.889385 master-0 kubenswrapper[33142]: I1204 01:01:29.889175 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.889656 master-0 kubenswrapper[33142]: I1204 01:01:29.889562 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-config-data\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.890035 master-0 kubenswrapper[33142]: I1204 01:01:29.889961 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmm6g\" (UniqueName: \"kubernetes.io/projected/ea67d9c3-0854-49f4-adec-331db6ed81eb-kube-api-access-dmm6g\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.890274 master-0 kubenswrapper[33142]: I1204 01:01:29.890244 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-kolla-config\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.890380 master-0 kubenswrapper[33142]: I1204 01:01:29.890354 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.993713 master-0 kubenswrapper[33142]: I1204 01:01:29.993545 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-kolla-config\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.993713 master-0 kubenswrapper[33142]: I1204 01:01:29.993633 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.993713 master-0 kubenswrapper[33142]: I1204 01:01:29.993668 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.994073 master-0 kubenswrapper[33142]: I1204 01:01:29.993750 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-config-data\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.994073 master-0 kubenswrapper[33142]: I1204 01:01:29.993815 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dmm6g\" (UniqueName: \"kubernetes.io/projected/ea67d9c3-0854-49f4-adec-331db6ed81eb-kube-api-access-dmm6g\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.998676 master-0 kubenswrapper[33142]: I1204 01:01:29.995391 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-kolla-config\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:29.998905 master-0 kubenswrapper[33142]: I1204 01:01:29.998839 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ea67d9c3-0854-49f4-adec-331db6ed81eb-config-data\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:30.002416 master-0 kubenswrapper[33142]: I1204 01:01:30.000975 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:30.021212 master-0 kubenswrapper[33142]: I1204 01:01:30.012530 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67d9c3-0854-49f4-adec-331db6ed81eb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:30.032687 master-0 kubenswrapper[33142]: I1204 01:01:30.030006 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmm6g\" (UniqueName: \"kubernetes.io/projected/ea67d9c3-0854-49f4-adec-331db6ed81eb-kube-api-access-dmm6g\") pod \"memcached-0\" (UID: \"ea67d9c3-0854-49f4-adec-331db6ed81eb\") " pod="openstack/memcached-0" Dec 04 01:01:30.032687 master-0 kubenswrapper[33142]: I1204 01:01:30.032595 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 01:01:30.051663 master-0 kubenswrapper[33142]: I1204 01:01:30.047784 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.051663 master-0 kubenswrapper[33142]: I1204 01:01:30.051477 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-erlang-cookie" Dec 04 01:01:30.060400 master-0 kubenswrapper[33142]: I1204 01:01:30.054164 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-plugins-conf" Dec 04 01:01:30.060400 master-0 kubenswrapper[33142]: I1204 01:01:30.054309 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-cell1-svc" Dec 04 01:01:30.060400 master-0 kubenswrapper[33142]: I1204 01:01:30.054423 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-config-data" Dec 04 01:01:30.060400 master-0 kubenswrapper[33142]: I1204 01:01:30.055179 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-server-conf" Dec 04 01:01:30.071990 master-0 kubenswrapper[33142]: I1204 01:01:30.063797 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-default-user" Dec 04 01:01:30.071990 master-0 kubenswrapper[33142]: I1204 01:01:30.070038 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Dec 04 01:01:30.091293 master-0 kubenswrapper[33142]: I1204 01:01:30.091204 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 01:01:30.200148 master-0 kubenswrapper[33142]: I1204 01:01:30.200069 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.200148 master-0 kubenswrapper[33142]: I1204 01:01:30.200149 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-3ac7d279-59b9-49fd-b3fc-3dcb8f9b3e1c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4debb234-4f3c-4d2c-9c67-7e8323df2447\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.200431 master-0 kubenswrapper[33142]: I1204 01:01:30.200215 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.200431 master-0 kubenswrapper[33142]: I1204 01:01:30.200262 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.200431 master-0 kubenswrapper[33142]: I1204 01:01:30.200284 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.204539 master-0 kubenswrapper[33142]: I1204 01:01:30.204488 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmv4g\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-kube-api-access-gmv4g\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.204754 master-0 kubenswrapper[33142]: I1204 01:01:30.204705 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.208658 master-0 kubenswrapper[33142]: I1204 01:01:30.208601 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.208778 master-0 kubenswrapper[33142]: I1204 01:01:30.208673 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.208778 master-0 kubenswrapper[33142]: I1204 01:01:30.208719 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.208854 master-0 kubenswrapper[33142]: I1204 01:01:30.208834 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316568 master-0 kubenswrapper[33142]: I1204 01:01:30.316448 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316568 master-0 kubenswrapper[33142]: I1204 01:01:30.316570 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316603 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316631 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316675 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316724 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316758 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-3ac7d279-59b9-49fd-b3fc-3dcb8f9b3e1c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4debb234-4f3c-4d2c-9c67-7e8323df2447\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316813 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.316871 master-0 kubenswrapper[33142]: I1204 01:01:30.316872 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.317499 master-0 kubenswrapper[33142]: I1204 01:01:30.316905 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.317499 master-0 kubenswrapper[33142]: I1204 01:01:30.316965 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmv4g\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-kube-api-access-gmv4g\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.322030 master-0 kubenswrapper[33142]: I1204 01:01:30.321972 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.350596 master-0 kubenswrapper[33142]: I1204 01:01:30.350484 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.352478 master-0 kubenswrapper[33142]: I1204 01:01:30.352042 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.352478 master-0 kubenswrapper[33142]: I1204 01:01:30.352465 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.356200 master-0 kubenswrapper[33142]: I1204 01:01:30.355875 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.360662 master-0 kubenswrapper[33142]: I1204 01:01:30.360595 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.361163 master-0 kubenswrapper[33142]: I1204 01:01:30.361109 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.362141 master-0 kubenswrapper[33142]: I1204 01:01:30.362087 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:30.362141 master-0 kubenswrapper[33142]: I1204 01:01:30.362126 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-3ac7d279-59b9-49fd-b3fc-3dcb8f9b3e1c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4debb234-4f3c-4d2c-9c67-7e8323df2447\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/cfd6d3c8cedae259d89609acbb447ec5211678e434e10deff3f3c7f2871054a9/globalmount\"" pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.380805 master-0 kubenswrapper[33142]: I1204 01:01:30.379820 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.385216 master-0 kubenswrapper[33142]: I1204 01:01:30.385139 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.430056 master-0 kubenswrapper[33142]: I1204 01:01:30.429985 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmv4g\" (UniqueName: \"kubernetes.io/projected/c7fe0d53-7d39-4272-add3-ad3cc75b82d7-kube-api-access-gmv4g\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:30.852093 master-0 kubenswrapper[33142]: I1204 01:01:30.848792 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Dec 04 01:01:31.005676 master-0 kubenswrapper[33142]: I1204 01:01:31.005539 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-galera-0"] Dec 04 01:01:31.008028 master-0 kubenswrapper[33142]: I1204 01:01:31.007993 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Dec 04 01:01:31.033315 master-0 kubenswrapper[33142]: I1204 01:01:31.033236 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Dec 04 01:01:31.035556 master-0 kubenswrapper[33142]: I1204 01:01:31.035520 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-config-data" Dec 04 01:01:31.038682 master-0 kubenswrapper[33142]: I1204 01:01:31.035789 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-scripts" Dec 04 01:01:31.038967 master-0 kubenswrapper[33142]: I1204 01:01:31.035831 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-svc" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.150666 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.163734 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.164664 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gtz\" (UniqueName: \"kubernetes.io/projected/1093df42-0d18-468f-88e8-4476ca7f3712-kube-api-access-h4gtz\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.164754 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-kolla-config\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.164896 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.164958 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-default\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.164977 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-d1fa591c-8047-4a83-9303-da80bf324a22\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c737103b-d8d0-4143-8805-c42160bcd505\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.166283 master-0 kubenswrapper[33142]: I1204 01:01:31.165164 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.272835 master-0 kubenswrapper[33142]: I1204 01:01:31.272763 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.272835 master-0 kubenswrapper[33142]: I1204 01:01:31.272851 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273232 master-0 kubenswrapper[33142]: I1204 01:01:31.273121 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273232 master-0 kubenswrapper[33142]: I1204 01:01:31.273164 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gtz\" (UniqueName: \"kubernetes.io/projected/1093df42-0d18-468f-88e8-4476ca7f3712-kube-api-access-h4gtz\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273232 master-0 kubenswrapper[33142]: I1204 01:01:31.273201 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-kolla-config\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273362 master-0 kubenswrapper[33142]: I1204 01:01:31.273269 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273362 master-0 kubenswrapper[33142]: I1204 01:01:31.273301 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-d1fa591c-8047-4a83-9303-da80bf324a22\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c737103b-d8d0-4143-8805-c42160bcd505\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.273362 master-0 kubenswrapper[33142]: I1204 01:01:31.273324 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-default\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.278291 master-0 kubenswrapper[33142]: I1204 01:01:31.278224 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.283975 master-0 kubenswrapper[33142]: I1204 01:01:31.283915 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.285060 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-config-data-default\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.288592 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1093df42-0d18-468f-88e8-4476ca7f3712-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.290879 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-kolla-config\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.293891 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.293939 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-d1fa591c-8047-4a83-9303-da80bf324a22\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c737103b-d8d0-4143-8805-c42160bcd505\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/387fe8750cbd9e3ace71bbb50f5924202f24c3f3bb52e6396051a531e3b2defc/globalmount\"" pod="openstack/openstack-galera-0" Dec 04 01:01:31.300337 master-0 kubenswrapper[33142]: I1204 01:01:31.296416 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1093df42-0d18-468f-88e8-4476ca7f3712-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.313662 master-0 kubenswrapper[33142]: I1204 01:01:31.310774 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gtz\" (UniqueName: \"kubernetes.io/projected/1093df42-0d18-468f-88e8-4476ca7f3712-kube-api-access-h4gtz\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:31.334725 master-0 kubenswrapper[33142]: I1204 01:01:31.331120 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-7b62fa04-bfe3-4167-8ec3-a8210e8722e0\" (UniqueName: \"kubernetes.io/csi/topolvm.io^556eb694-7255-4b59-8a19-ce1c402c0fb0\") pod \"rabbitmq-server-0\" (UID: \"fba01013-8dd9-433e-8c42-887c0423c58f\") " pod="openstack/rabbitmq-server-0" Dec 04 01:01:31.460320 master-0 kubenswrapper[33142]: I1204 01:01:31.460164 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"ea67d9c3-0854-49f4-adec-331db6ed81eb","Type":"ContainerStarted","Data":"071da4f5d45aa58399bfcf7e4a18dc4a658314434a82f2f9341e905a367160a8"} Dec 04 01:01:31.587970 master-0 kubenswrapper[33142]: I1204 01:01:31.583117 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Dec 04 01:01:32.192253 master-0 kubenswrapper[33142]: I1204 01:01:32.192172 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 01:01:32.208127 master-0 kubenswrapper[33142]: I1204 01:01:32.203020 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.208127 master-0 kubenswrapper[33142]: I1204 01:01:32.203522 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 01:01:32.208127 master-0 kubenswrapper[33142]: I1204 01:01:32.206187 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-scripts" Dec 04 01:01:32.208127 master-0 kubenswrapper[33142]: I1204 01:01:32.206551 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-config-data" Dec 04 01:01:32.208127 master-0 kubenswrapper[33142]: I1204 01:01:32.207411 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-cell1-svc" Dec 04 01:01:32.311114 master-0 kubenswrapper[33142]: I1204 01:01:32.310606 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmqxl\" (UniqueName: \"kubernetes.io/projected/bab681a7-5fd3-4071-b8ba-7f07a5923507-kube-api-access-rmqxl\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311114 master-0 kubenswrapper[33142]: I1204 01:01:32.310746 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311114 master-0 kubenswrapper[33142]: I1204 01:01:32.310844 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311114 master-0 kubenswrapper[33142]: I1204 01:01:32.310919 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-0c1c734e-c934-4160-a3f7-0b0acaf7e48a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b985505c-d72a-4d86-8dce-66eba4e82b66\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311114 master-0 kubenswrapper[33142]: I1204 01:01:32.310984 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311692 master-0 kubenswrapper[33142]: I1204 01:01:32.311548 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.311692 master-0 kubenswrapper[33142]: I1204 01:01:32.311649 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.312101 master-0 kubenswrapper[33142]: I1204 01:01:32.311780 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.414564 master-0 kubenswrapper[33142]: I1204 01:01:32.414366 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.414564 master-0 kubenswrapper[33142]: I1204 01:01:32.414486 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.414564 master-0 kubenswrapper[33142]: I1204 01:01:32.414509 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.414564 master-0 kubenswrapper[33142]: I1204 01:01:32.414546 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.414564 master-0 kubenswrapper[33142]: I1204 01:01:32.414585 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rmqxl\" (UniqueName: \"kubernetes.io/projected/bab681a7-5fd3-4071-b8ba-7f07a5923507-kube-api-access-rmqxl\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.414615 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.414695 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.414727 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-0c1c734e-c934-4160-a3f7-0b0acaf7e48a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b985505c-d72a-4d86-8dce-66eba4e82b66\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.415829 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.415999 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.417756 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.417781 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-0c1c734e-c934-4160-a3f7-0b0acaf7e48a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b985505c-d72a-4d86-8dce-66eba4e82b66\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/4825b1b6f71a712500b78059c43f444ec6a8e445b3d94d83ddca9991291d82cd/globalmount\"" pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.420561 master-0 kubenswrapper[33142]: I1204 01:01:32.419734 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.421564 master-0 kubenswrapper[33142]: I1204 01:01:32.421486 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bab681a7-5fd3-4071-b8ba-7f07a5923507-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.421564 master-0 kubenswrapper[33142]: I1204 01:01:32.421536 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.423820 master-0 kubenswrapper[33142]: I1204 01:01:32.423776 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bab681a7-5fd3-4071-b8ba-7f07a5923507-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.437578 master-0 kubenswrapper[33142]: I1204 01:01:32.437508 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmqxl\" (UniqueName: \"kubernetes.io/projected/bab681a7-5fd3-4071-b8ba-7f07a5923507-kube-api-access-rmqxl\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:32.619987 master-0 kubenswrapper[33142]: I1204 01:01:32.619892 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 01:01:32.690252 master-0 kubenswrapper[33142]: I1204 01:01:32.689655 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-3ac7d279-59b9-49fd-b3fc-3dcb8f9b3e1c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4debb234-4f3c-4d2c-9c67-7e8323df2447\") pod \"rabbitmq-cell1-server-0\" (UID: \"c7fe0d53-7d39-4272-add3-ad3cc75b82d7\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:32.812742 master-0 kubenswrapper[33142]: I1204 01:01:32.812615 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:01:33.499954 master-0 kubenswrapper[33142]: I1204 01:01:33.495152 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"fba01013-8dd9-433e-8c42-887c0423c58f","Type":"ContainerStarted","Data":"3aea1d17dddc5fc07ade55bc78901937b7de8b588af497e4b8141952da3514c7"} Dec 04 01:01:33.729115 master-0 kubenswrapper[33142]: I1204 01:01:33.729045 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-d1fa591c-8047-4a83-9303-da80bf324a22\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c737103b-d8d0-4143-8805-c42160bcd505\") pod \"openstack-galera-0\" (UID: \"1093df42-0d18-468f-88e8-4476ca7f3712\") " pod="openstack/openstack-galera-0" Dec 04 01:01:33.823998 master-0 kubenswrapper[33142]: I1204 01:01:33.823578 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Dec 04 01:01:34.910960 master-0 kubenswrapper[33142]: I1204 01:01:34.910870 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-0c1c734e-c934-4160-a3f7-0b0acaf7e48a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b985505c-d72a-4d86-8dce-66eba4e82b66\") pod \"openstack-cell1-galera-0\" (UID: \"bab681a7-5fd3-4071-b8ba-7f07a5923507\") " pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:35.551682 master-0 kubenswrapper[33142]: I1204 01:01:35.551575 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Dec 04 01:01:37.961818 master-0 kubenswrapper[33142]: I1204 01:01:37.961760 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-b4m9d"] Dec 04 01:01:37.965964 master-0 kubenswrapper[33142]: I1204 01:01:37.963197 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:37.976502 master-0 kubenswrapper[33142]: I1204 01:01:37.967968 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovncontroller-ovndbs" Dec 04 01:01:37.976502 master-0 kubenswrapper[33142]: I1204 01:01:37.974739 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-scripts" Dec 04 01:01:37.996206 master-0 kubenswrapper[33142]: I1204 01:01:37.992365 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-ovs-q8gcl"] Dec 04 01:01:37.998337 master-0 kubenswrapper[33142]: I1204 01:01:37.998239 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.005773 master-0 kubenswrapper[33142]: I1204 01:01:38.005698 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d"] Dec 04 01:01:38.018488 master-0 kubenswrapper[33142]: I1204 01:01:38.014118 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-q8gcl"] Dec 04 01:01:38.081016 master-0 kubenswrapper[33142]: I1204 01:01:38.080899 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-ovn-controller-tls-certs\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.081016 master-0 kubenswrapper[33142]: I1204 01:01:38.081023 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-log-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.081270 master-0 kubenswrapper[33142]: I1204 01:01:38.081065 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstsw\" (UniqueName: \"kubernetes.io/projected/84149f95-d7bd-478d-88fe-f1f582ec4929-kube-api-access-fstsw\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.081270 master-0 kubenswrapper[33142]: I1204 01:01:38.081095 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-run\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.081270 master-0 kubenswrapper[33142]: I1204 01:01:38.081122 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.081389 master-0 kubenswrapper[33142]: I1204 01:01:38.081267 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-combined-ca-bundle\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.081389 master-0 kubenswrapper[33142]: I1204 01:01:38.081379 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-log\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.081508 master-0 kubenswrapper[33142]: I1204 01:01:38.081450 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84149f95-d7bd-478d-88fe-f1f582ec4929-scripts\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.081609 master-0 kubenswrapper[33142]: I1204 01:01:38.081589 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-etc-ovs\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.082284 master-0 kubenswrapper[33142]: I1204 01:01:38.081705 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-lib\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.082284 master-0 kubenswrapper[33142]: I1204 01:01:38.081799 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.082284 master-0 kubenswrapper[33142]: I1204 01:01:38.081976 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-scripts\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.082284 master-0 kubenswrapper[33142]: I1204 01:01:38.082125 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rlj\" (UniqueName: \"kubernetes.io/projected/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-kube-api-access-w9rlj\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.184446 master-0 kubenswrapper[33142]: I1204 01:01:38.184377 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-etc-ovs\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.186089 master-0 kubenswrapper[33142]: I1204 01:01:38.186072 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-lib\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.186533 master-0 kubenswrapper[33142]: I1204 01:01:38.185950 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-etc-ovs\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.186657 master-0 kubenswrapper[33142]: I1204 01:01:38.186404 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-lib\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.186801 master-0 kubenswrapper[33142]: I1204 01:01:38.186785 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.186973 master-0 kubenswrapper[33142]: I1204 01:01:38.186918 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-scripts\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.187129 master-0 kubenswrapper[33142]: I1204 01:01:38.187109 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rlj\" (UniqueName: \"kubernetes.io/projected/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-kube-api-access-w9rlj\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.187764 master-0 kubenswrapper[33142]: I1204 01:01:38.186986 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.187955 master-0 kubenswrapper[33142]: I1204 01:01:38.187915 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-ovn-controller-tls-certs\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.188594 master-0 kubenswrapper[33142]: I1204 01:01:38.188574 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-log-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.188744 master-0 kubenswrapper[33142]: I1204 01:01:38.188727 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fstsw\" (UniqueName: \"kubernetes.io/projected/84149f95-d7bd-478d-88fe-f1f582ec4929-kube-api-access-fstsw\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.188996 master-0 kubenswrapper[33142]: I1204 01:01:38.188976 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-run\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.189114 master-0 kubenswrapper[33142]: I1204 01:01:38.189090 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-run\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.189236 master-0 kubenswrapper[33142]: I1204 01:01:38.189218 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.189413 master-0 kubenswrapper[33142]: I1204 01:01:38.189382 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-run-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.189475 master-0 kubenswrapper[33142]: I1204 01:01:38.189027 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-var-log-ovn\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.189475 master-0 kubenswrapper[33142]: I1204 01:01:38.189436 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-scripts\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.189597 master-0 kubenswrapper[33142]: I1204 01:01:38.189575 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-combined-ca-bundle\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.189718 master-0 kubenswrapper[33142]: I1204 01:01:38.189702 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-log\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.189837 master-0 kubenswrapper[33142]: I1204 01:01:38.189820 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84149f95-d7bd-478d-88fe-f1f582ec4929-scripts\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.189969 master-0 kubenswrapper[33142]: I1204 01:01:38.189870 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/84149f95-d7bd-478d-88fe-f1f582ec4929-var-log\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.192186 master-0 kubenswrapper[33142]: I1204 01:01:38.192147 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-ovn-controller-tls-certs\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.193540 master-0 kubenswrapper[33142]: I1204 01:01:38.193478 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84149f95-d7bd-478d-88fe-f1f582ec4929-scripts\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.194394 master-0 kubenswrapper[33142]: I1204 01:01:38.194368 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-combined-ca-bundle\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.211010 master-0 kubenswrapper[33142]: I1204 01:01:38.210936 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rlj\" (UniqueName: \"kubernetes.io/projected/bf7dac9a-11f8-42a9-90f8-51eb463e30a9-kube-api-access-w9rlj\") pod \"ovn-controller-b4m9d\" (UID: \"bf7dac9a-11f8-42a9-90f8-51eb463e30a9\") " pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.213572 master-0 kubenswrapper[33142]: I1204 01:01:38.213472 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstsw\" (UniqueName: \"kubernetes.io/projected/84149f95-d7bd-478d-88fe-f1f582ec4929-kube-api-access-fstsw\") pod \"ovn-controller-ovs-q8gcl\" (UID: \"84149f95-d7bd-478d-88fe-f1f582ec4929\") " pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.331358 master-0 kubenswrapper[33142]: I1204 01:01:38.331018 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d" Dec 04 01:01:38.339187 master-0 kubenswrapper[33142]: I1204 01:01:38.339129 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:01:38.545224 master-0 kubenswrapper[33142]: I1204 01:01:38.545039 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 01:01:38.548872 master-0 kubenswrapper[33142]: I1204 01:01:38.548825 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.552092 master-0 kubenswrapper[33142]: I1204 01:01:38.551713 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-scripts" Dec 04 01:01:38.552092 master-0 kubenswrapper[33142]: I1204 01:01:38.551991 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovn-metrics" Dec 04 01:01:38.552893 master-0 kubenswrapper[33142]: I1204 01:01:38.552582 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-config" Dec 04 01:01:38.553560 master-0 kubenswrapper[33142]: I1204 01:01:38.553532 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-nb-ovndbs" Dec 04 01:01:38.575118 master-0 kubenswrapper[33142]: I1204 01:01:38.571223 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 01:01:38.600751 master-0 kubenswrapper[33142]: I1204 01:01:38.600686 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qqb\" (UniqueName: \"kubernetes.io/projected/906b75fe-8760-47f2-af0b-44fe551598c3-kube-api-access-l4qqb\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.600969 master-0 kubenswrapper[33142]: I1204 01:01:38.600761 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.600969 master-0 kubenswrapper[33142]: I1204 01:01:38.600799 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-config\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.600969 master-0 kubenswrapper[33142]: I1204 01:01:38.600830 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-54c6178a-e926-4e16-8421-58d923892d34\" (UniqueName: \"kubernetes.io/csi/topolvm.io^6cfde227-2c6b-4119-94dd-32d4618ece91\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.600969 master-0 kubenswrapper[33142]: I1204 01:01:38.600868 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.600969 master-0 kubenswrapper[33142]: I1204 01:01:38.600920 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.606777 master-0 kubenswrapper[33142]: I1204 01:01:38.600996 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.606777 master-0 kubenswrapper[33142]: I1204 01:01:38.601185 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704558 master-0 kubenswrapper[33142]: I1204 01:01:38.704473 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qqb\" (UniqueName: \"kubernetes.io/projected/906b75fe-8760-47f2-af0b-44fe551598c3-kube-api-access-l4qqb\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704558 master-0 kubenswrapper[33142]: I1204 01:01:38.704540 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704558 master-0 kubenswrapper[33142]: I1204 01:01:38.704565 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-config\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704873 master-0 kubenswrapper[33142]: I1204 01:01:38.704582 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-54c6178a-e926-4e16-8421-58d923892d34\" (UniqueName: \"kubernetes.io/csi/topolvm.io^6cfde227-2c6b-4119-94dd-32d4618ece91\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704873 master-0 kubenswrapper[33142]: I1204 01:01:38.704622 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704873 master-0 kubenswrapper[33142]: I1204 01:01:38.704669 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704873 master-0 kubenswrapper[33142]: I1204 01:01:38.704697 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.704873 master-0 kubenswrapper[33142]: I1204 01:01:38.704790 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.706036 master-0 kubenswrapper[33142]: I1204 01:01:38.705983 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.706374 master-0 kubenswrapper[33142]: I1204 01:01:38.706333 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.706660 master-0 kubenswrapper[33142]: I1204 01:01:38.706632 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:38.706718 master-0 kubenswrapper[33142]: I1204 01:01:38.706669 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-54c6178a-e926-4e16-8421-58d923892d34\" (UniqueName: \"kubernetes.io/csi/topolvm.io^6cfde227-2c6b-4119-94dd-32d4618ece91\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/388d5a35324a1b73fd3d41ff78a72668bd6b00dc02d193af31b9a51fc5b0a6ec/globalmount\"" pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.707332 master-0 kubenswrapper[33142]: I1204 01:01:38.707287 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/906b75fe-8760-47f2-af0b-44fe551598c3-config\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.709186 master-0 kubenswrapper[33142]: I1204 01:01:38.709146 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.710901 master-0 kubenswrapper[33142]: I1204 01:01:38.710867 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.718163 master-0 kubenswrapper[33142]: I1204 01:01:38.718097 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/906b75fe-8760-47f2-af0b-44fe551598c3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:38.729779 master-0 kubenswrapper[33142]: I1204 01:01:38.729708 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qqb\" (UniqueName: \"kubernetes.io/projected/906b75fe-8760-47f2-af0b-44fe551598c3-kube-api-access-l4qqb\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:39.843798 master-0 kubenswrapper[33142]: I1204 01:01:39.840338 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 01:01:39.843798 master-0 kubenswrapper[33142]: I1204 01:01:39.842342 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:39.853230 master-0 kubenswrapper[33142]: I1204 01:01:39.853183 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-config" Dec 04 01:01:39.853505 master-0 kubenswrapper[33142]: I1204 01:01:39.853488 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-sb-ovndbs" Dec 04 01:01:39.854020 master-0 kubenswrapper[33142]: I1204 01:01:39.853952 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-scripts" Dec 04 01:01:39.864864 master-0 kubenswrapper[33142]: I1204 01:01:39.864736 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 01:01:40.013844 master-0 kubenswrapper[33142]: I1204 01:01:40.013713 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.014299 master-0 kubenswrapper[33142]: I1204 01:01:40.014266 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.014472 master-0 kubenswrapper[33142]: I1204 01:01:40.014454 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.014577 master-0 kubenswrapper[33142]: I1204 01:01:40.014561 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9b348c16-a54b-42d4-9312-f55cdfab4ae3\" (UniqueName: \"kubernetes.io/csi/topolvm.io^835b4b32-aba4-43f8-8297-f7b956526ad9\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.014696 master-0 kubenswrapper[33142]: I1204 01:01:40.014680 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-config\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.014868 master-0 kubenswrapper[33142]: I1204 01:01:40.014847 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2df22\" (UniqueName: \"kubernetes.io/projected/92a89491-dea3-4ede-b420-8629c8ed34e4-kube-api-access-2df22\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.015014 master-0 kubenswrapper[33142]: I1204 01:01:40.014993 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.015203 master-0 kubenswrapper[33142]: I1204 01:01:40.015182 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116635 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2df22\" (UniqueName: \"kubernetes.io/projected/92a89491-dea3-4ede-b420-8629c8ed34e4-kube-api-access-2df22\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116705 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116746 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116810 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116833 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116888 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.116919 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-9b348c16-a54b-42d4-9312-f55cdfab4ae3\" (UniqueName: \"kubernetes.io/csi/topolvm.io^835b4b32-aba4-43f8-8297-f7b956526ad9\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.118994 master-0 kubenswrapper[33142]: I1204 01:01:40.117041 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-config\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.119492 master-0 kubenswrapper[33142]: I1204 01:01:40.119032 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.119585 master-0 kubenswrapper[33142]: I1204 01:01:40.119541 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-config\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.119759 master-0 kubenswrapper[33142]: I1204 01:01:40.119701 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/92a89491-dea3-4ede-b420-8629c8ed34e4-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.126234 master-0 kubenswrapper[33142]: I1204 01:01:40.125354 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:01:40.126234 master-0 kubenswrapper[33142]: I1204 01:01:40.125439 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-9b348c16-a54b-42d4-9312-f55cdfab4ae3\" (UniqueName: \"kubernetes.io/csi/topolvm.io^835b4b32-aba4-43f8-8297-f7b956526ad9\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/b58e0a1d8af2047a79e9eee8137f03c4773457f3529528f76a7f0bf8e71c62b1/globalmount\"" pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.126768 master-0 kubenswrapper[33142]: I1204 01:01:40.126493 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.128992 master-0 kubenswrapper[33142]: I1204 01:01:40.128744 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.130948 master-0 kubenswrapper[33142]: I1204 01:01:40.130878 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92a89491-dea3-4ede-b420-8629c8ed34e4-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.143807 master-0 kubenswrapper[33142]: I1204 01:01:40.139677 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2df22\" (UniqueName: \"kubernetes.io/projected/92a89491-dea3-4ede-b420-8629c8ed34e4-kube-api-access-2df22\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:40.829803 master-0 kubenswrapper[33142]: I1204 01:01:40.829735 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-54c6178a-e926-4e16-8421-58d923892d34\" (UniqueName: \"kubernetes.io/csi/topolvm.io^6cfde227-2c6b-4119-94dd-32d4618ece91\") pod \"ovsdbserver-nb-0\" (UID: \"906b75fe-8760-47f2-af0b-44fe551598c3\") " pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:40.991672 master-0 kubenswrapper[33142]: I1204 01:01:40.991536 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Dec 04 01:01:42.265551 master-0 kubenswrapper[33142]: I1204 01:01:42.265462 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-9b348c16-a54b-42d4-9312-f55cdfab4ae3\" (UniqueName: \"kubernetes.io/csi/topolvm.io^835b4b32-aba4-43f8-8297-f7b956526ad9\") pod \"ovsdbserver-sb-0\" (UID: \"92a89491-dea3-4ede-b420-8629c8ed34e4\") " pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:42.280845 master-0 kubenswrapper[33142]: I1204 01:01:42.280776 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-0" Dec 04 01:01:50.542498 master-0 kubenswrapper[33142]: I1204 01:01:50.542429 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 01:01:52.165181 master-0 kubenswrapper[33142]: W1204 01:01:52.165083 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbab681a7_5fd3_4071_b8ba_7f07a5923507.slice/crio-6ccb41768815a073a02b29748d7569471ecb44f394fa8a1d194b1daea4ad5201 WatchSource:0}: Error finding container 6ccb41768815a073a02b29748d7569471ecb44f394fa8a1d194b1daea4ad5201: Status 404 returned error can't find the container with id 6ccb41768815a073a02b29748d7569471ecb44f394fa8a1d194b1daea4ad5201 Dec 04 01:01:52.228697 master-0 kubenswrapper[33142]: I1204 01:01:52.228587 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"bab681a7-5fd3-4071-b8ba-7f07a5923507","Type":"ContainerStarted","Data":"6ccb41768815a073a02b29748d7569471ecb44f394fa8a1d194b1daea4ad5201"} Dec 04 01:01:53.111460 master-0 kubenswrapper[33142]: I1204 01:01:53.109315 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d"] Dec 04 01:01:53.138291 master-0 kubenswrapper[33142]: I1204 01:01:53.138216 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Dec 04 01:01:53.145347 master-0 kubenswrapper[33142]: W1204 01:01:53.144616 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1093df42_0d18_468f_88e8_4476ca7f3712.slice/crio-2b23490792fc69ccbbdfe34c88af259f928c9827bcb5556538691a696cbf5951 WatchSource:0}: Error finding container 2b23490792fc69ccbbdfe34c88af259f928c9827bcb5556538691a696cbf5951: Status 404 returned error can't find the container with id 2b23490792fc69ccbbdfe34c88af259f928c9827bcb5556538691a696cbf5951 Dec 04 01:01:53.230127 master-0 kubenswrapper[33142]: I1204 01:01:53.229532 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 01:01:53.248469 master-0 kubenswrapper[33142]: I1204 01:01:53.248135 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"1093df42-0d18-468f-88e8-4476ca7f3712","Type":"ContainerStarted","Data":"2b23490792fc69ccbbdfe34c88af259f928c9827bcb5556538691a696cbf5951"} Dec 04 01:01:53.252119 master-0 kubenswrapper[33142]: I1204 01:01:53.251750 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"ea67d9c3-0854-49f4-adec-331db6ed81eb","Type":"ContainerStarted","Data":"e16dcf464fc823a08fbe9c7bde8a8e4a4c4e610d529c63c08b7a6515bffac93f"} Dec 04 01:01:53.252119 master-0 kubenswrapper[33142]: I1204 01:01:53.251871 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/memcached-0" Dec 04 01:01:53.259642 master-0 kubenswrapper[33142]: I1204 01:01:53.259487 33142 generic.go:334] "Generic (PLEG): container finished" podID="6a8f6791-d8d8-4c35-81e0-527ce3232f70" containerID="bd9155e418318b2302d395b1a625553d5d2f575cd3f3c9d690cb950386185323" exitCode=0 Dec 04 01:01:53.259642 master-0 kubenswrapper[33142]: I1204 01:01:53.259598 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" event={"ID":"6a8f6791-d8d8-4c35-81e0-527ce3232f70","Type":"ContainerDied","Data":"bd9155e418318b2302d395b1a625553d5d2f575cd3f3c9d690cb950386185323"} Dec 04 01:01:53.264537 master-0 kubenswrapper[33142]: I1204 01:01:53.264348 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d" event={"ID":"bf7dac9a-11f8-42a9-90f8-51eb463e30a9","Type":"ContainerStarted","Data":"daca460e9449322cbe4b63ec6a7e906b3f5749cbec681fab335a3d8beafd9471"} Dec 04 01:01:53.273242 master-0 kubenswrapper[33142]: I1204 01:01:53.272075 33142 generic.go:334] "Generic (PLEG): container finished" podID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerID="2656ef34044683764c36afc04cdc6c2ce39e5f4e4a7be77b51d9bb07416b17d4" exitCode=0 Dec 04 01:01:53.273242 master-0 kubenswrapper[33142]: I1204 01:01:53.272206 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" event={"ID":"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68","Type":"ContainerDied","Data":"2656ef34044683764c36afc04cdc6c2ce39e5f4e4a7be77b51d9bb07416b17d4"} Dec 04 01:01:53.277783 master-0 kubenswrapper[33142]: I1204 01:01:53.276064 33142 generic.go:334] "Generic (PLEG): container finished" podID="6afe080c-046d-409a-b00e-29bb8176cb4c" containerID="3aee4e1049e047cbb49f1ef7034d12b2d2b237b2af8904316ec190bba6167301" exitCode=0 Dec 04 01:01:53.277783 master-0 kubenswrapper[33142]: I1204 01:01:53.276152 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" event={"ID":"6afe080c-046d-409a-b00e-29bb8176cb4c","Type":"ContainerDied","Data":"3aee4e1049e047cbb49f1ef7034d12b2d2b237b2af8904316ec190bba6167301"} Dec 04 01:01:53.301332 master-0 kubenswrapper[33142]: I1204 01:01:53.298358 33142 generic.go:334] "Generic (PLEG): container finished" podID="f65e347e-5f35-4964-b087-d00d7087493a" containerID="b7b26acabdaa55a8c44e7fdbabdb4d4941489421964a4ea46acce2f01b26ecce" exitCode=0 Dec 04 01:01:53.301332 master-0 kubenswrapper[33142]: I1204 01:01:53.298435 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" event={"ID":"f65e347e-5f35-4964-b087-d00d7087493a","Type":"ContainerDied","Data":"b7b26acabdaa55a8c44e7fdbabdb4d4941489421964a4ea46acce2f01b26ecce"} Dec 04 01:01:53.301332 master-0 kubenswrapper[33142]: I1204 01:01:53.298689 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/memcached-0" podStartSLOduration=2.869284925 podStartE2EDuration="24.298664426s" podCreationTimestamp="2025-12-04 01:01:29 +0000 UTC" firstStartedPulling="2025-12-04 01:01:30.866504438 +0000 UTC m=+863.268506288" lastFinishedPulling="2025-12-04 01:01:52.295883939 +0000 UTC m=+884.697885789" observedRunningTime="2025-12-04 01:01:53.276993756 +0000 UTC m=+885.678995616" watchObservedRunningTime="2025-12-04 01:01:53.298664426 +0000 UTC m=+885.700666286" Dec 04 01:01:53.382231 master-0 kubenswrapper[33142]: I1204 01:01:53.381741 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 01:01:53.414427 master-0 kubenswrapper[33142]: W1204 01:01:53.400710 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92a89491_dea3_4ede_b420_8629c8ed34e4.slice/crio-6c97bf9685d18eb0a63bbea1bb12f6d663d43a5317e6ce65cca0dd120ce0e2dd WatchSource:0}: Error finding container 6c97bf9685d18eb0a63bbea1bb12f6d663d43a5317e6ce65cca0dd120ce0e2dd: Status 404 returned error can't find the container with id 6c97bf9685d18eb0a63bbea1bb12f6d663d43a5317e6ce65cca0dd120ce0e2dd Dec 04 01:01:53.697751 master-0 kubenswrapper[33142]: I1204 01:01:53.695957 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 01:01:53.746457 master-0 kubenswrapper[33142]: E1204 01:01:53.746392 33142 log.go:32] "CreateContainer in sandbox from runtime service failed" err=< Dec 04 01:01:53.746457 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = container create failed: mount `/var/lib/kubelet/pods/f65e347e-5f35-4964-b087-d00d7087493a/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 01:01:53.746457 master-0 kubenswrapper[33142]: > podSandboxID="3c641708fddd2d03b24286a83030a41d12a8bd1b034948da8fafc030112faad5" Dec 04 01:01:53.746673 master-0 kubenswrapper[33142]: E1204 01:01:53.746646 33142 kuberuntime_manager.go:1274] "Unhandled Error" err=< Dec 04 01:01:53.746673 master-0 kubenswrapper[33142]: container &Container{Name:dnsmasq-dns,Image:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:42f5663a161307156673f86e5eaad59f842a4bf25824f48008e69ab18e4ba792,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n575hdbh5fbhcbh69hc5hfh5dh546h56chcdh556h687hf6h54bh84hcfh5bbh54bh667h64h67bhbbh54ch5b7h54bh576h5cdh59ch5b9h66fh654q,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dns,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dns-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dns-svc,SubPath:dns-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-l4f8x,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000800000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dns-75d7c5dbd7-j4d5q_openstack(f65e347e-5f35-4964-b087-d00d7087493a): CreateContainerError: container create failed: mount `/var/lib/kubelet/pods/f65e347e-5f35-4964-b087-d00d7087493a/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 01:01:53.746673 master-0 kubenswrapper[33142]: > logger="UnhandledError" Dec 04 01:01:53.748719 master-0 kubenswrapper[33142]: E1204 01:01:53.748660 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dnsmasq-dns\" with CreateContainerError: \"container create failed: mount `/var/lib/kubelet/pods/f65e347e-5f35-4964-b087-d00d7087493a/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory\\n\"" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" podUID="f65e347e-5f35-4964-b087-d00d7087493a" Dec 04 01:01:53.802388 master-0 kubenswrapper[33142]: I1204 01:01:53.802318 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-q8gcl"] Dec 04 01:01:54.308750 master-0 kubenswrapper[33142]: I1204 01:01:54.308092 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:54.322439 master-0 kubenswrapper[33142]: I1204 01:01:54.320220 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:54.322439 master-0 kubenswrapper[33142]: I1204 01:01:54.321732 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-q8gcl" event={"ID":"84149f95-d7bd-478d-88fe-f1f582ec4929","Type":"ContainerStarted","Data":"2f770152434228add4f06e5b827e540943a40bb177803a4e261ab8938754390a"} Dec 04 01:01:54.349278 master-0 kubenswrapper[33142]: I1204 01:01:54.332391 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" event={"ID":"6a8f6791-d8d8-4c35-81e0-527ce3232f70","Type":"ContainerDied","Data":"ed56ddba34a8105bb8261eba0cc06dff4a320364322369bf2c28102fa1d27bfe"} Dec 04 01:01:54.349278 master-0 kubenswrapper[33142]: I1204 01:01:54.332443 33142 scope.go:117] "RemoveContainer" containerID="bd9155e418318b2302d395b1a625553d5d2f575cd3f3c9d690cb950386185323" Dec 04 01:01:54.349278 master-0 kubenswrapper[33142]: I1204 01:01:54.332451 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4" Dec 04 01:01:54.349278 master-0 kubenswrapper[33142]: I1204 01:01:54.341660 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" event={"ID":"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68","Type":"ContainerStarted","Data":"281e792829ab5828ce0cde55d54254d84397511e795989392d7e912c00de05b6"} Dec 04 01:01:54.349278 master-0 kubenswrapper[33142]: I1204 01:01:54.345526 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:54.350585 master-0 kubenswrapper[33142]: I1204 01:01:54.350465 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"c7fe0d53-7d39-4272-add3-ad3cc75b82d7","Type":"ContainerStarted","Data":"8b56308d38df530cb0111b50a5e146117f99673f336b41a213f4b44d941c9af7"} Dec 04 01:01:54.353996 master-0 kubenswrapper[33142]: I1204 01:01:54.353176 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"906b75fe-8760-47f2-af0b-44fe551598c3","Type":"ContainerStarted","Data":"a1136e4455cb473d2775a0d21fac23ca45feb47373d6be6fda626f92b8a91539"} Dec 04 01:01:54.359025 master-0 kubenswrapper[33142]: I1204 01:01:54.358961 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"92a89491-dea3-4ede-b420-8629c8ed34e4","Type":"ContainerStarted","Data":"6c97bf9685d18eb0a63bbea1bb12f6d663d43a5317e6ce65cca0dd120ce0e2dd"} Dec 04 01:01:54.369737 master-0 kubenswrapper[33142]: I1204 01:01:54.369683 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" Dec 04 01:01:54.369841 master-0 kubenswrapper[33142]: I1204 01:01:54.369752 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-j7vfz" event={"ID":"6afe080c-046d-409a-b00e-29bb8176cb4c","Type":"ContainerDied","Data":"10b4b544daef413ac85b95bf6b05ea481feb2d94d903206f6552515f67f47ac8"} Dec 04 01:01:54.398998 master-0 kubenswrapper[33142]: I1204 01:01:54.398850 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" podStartSLOduration=4.391151934 podStartE2EDuration="29.398826477s" podCreationTimestamp="2025-12-04 01:01:25 +0000 UTC" firstStartedPulling="2025-12-04 01:01:27.295365197 +0000 UTC m=+859.697367047" lastFinishedPulling="2025-12-04 01:01:52.30303974 +0000 UTC m=+884.705041590" observedRunningTime="2025-12-04 01:01:54.392031736 +0000 UTC m=+886.794033596" watchObservedRunningTime="2025-12-04 01:01:54.398826477 +0000 UTC m=+886.800828327" Dec 04 01:01:54.423667 master-0 kubenswrapper[33142]: I1204 01:01:54.423505 33142 scope.go:117] "RemoveContainer" containerID="3aee4e1049e047cbb49f1ef7034d12b2d2b237b2af8904316ec190bba6167301" Dec 04 01:01:54.454952 master-0 kubenswrapper[33142]: I1204 01:01:54.452201 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc\") pod \"6afe080c-046d-409a-b00e-29bb8176cb4c\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " Dec 04 01:01:54.454952 master-0 kubenswrapper[33142]: I1204 01:01:54.452347 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj8sc\" (UniqueName: \"kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc\") pod \"6afe080c-046d-409a-b00e-29bb8176cb4c\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " Dec 04 01:01:54.454952 master-0 kubenswrapper[33142]: I1204 01:01:54.452372 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config\") pod \"6afe080c-046d-409a-b00e-29bb8176cb4c\" (UID: \"6afe080c-046d-409a-b00e-29bb8176cb4c\") " Dec 04 01:01:54.454952 master-0 kubenswrapper[33142]: I1204 01:01:54.452489 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config\") pod \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " Dec 04 01:01:54.454952 master-0 kubenswrapper[33142]: I1204 01:01:54.452905 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94x74\" (UniqueName: \"kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74\") pod \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\" (UID: \"6a8f6791-d8d8-4c35-81e0-527ce3232f70\") " Dec 04 01:01:54.490800 master-0 kubenswrapper[33142]: I1204 01:01:54.490694 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74" (OuterVolumeSpecName: "kube-api-access-94x74") pod "6a8f6791-d8d8-4c35-81e0-527ce3232f70" (UID: "6a8f6791-d8d8-4c35-81e0-527ce3232f70"). InnerVolumeSpecName "kube-api-access-94x74". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:01:54.558526 master-0 kubenswrapper[33142]: I1204 01:01:54.558439 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-94x74\" (UniqueName: \"kubernetes.io/projected/6a8f6791-d8d8-4c35-81e0-527ce3232f70-kube-api-access-94x74\") on node \"master-0\" DevicePath \"\"" Dec 04 01:01:54.581197 master-0 kubenswrapper[33142]: I1204 01:01:54.580862 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc" (OuterVolumeSpecName: "kube-api-access-zj8sc") pod "6afe080c-046d-409a-b00e-29bb8176cb4c" (UID: "6afe080c-046d-409a-b00e-29bb8176cb4c"). InnerVolumeSpecName "kube-api-access-zj8sc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:01:54.662888 master-0 kubenswrapper[33142]: I1204 01:01:54.662714 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zj8sc\" (UniqueName: \"kubernetes.io/projected/6afe080c-046d-409a-b00e-29bb8176cb4c-kube-api-access-zj8sc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:01:54.722229 master-0 kubenswrapper[33142]: I1204 01:01:54.722134 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "6afe080c-046d-409a-b00e-29bb8176cb4c" (UID: "6afe080c-046d-409a-b00e-29bb8176cb4c"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:01:54.765303 master-0 kubenswrapper[33142]: I1204 01:01:54.765227 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:01:54.803362 master-0 kubenswrapper[33142]: I1204 01:01:54.803280 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config" (OuterVolumeSpecName: "config") pod "6afe080c-046d-409a-b00e-29bb8176cb4c" (UID: "6afe080c-046d-409a-b00e-29bb8176cb4c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:01:54.868136 master-0 kubenswrapper[33142]: I1204 01:01:54.868055 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6afe080c-046d-409a-b00e-29bb8176cb4c-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:01:54.904007 master-0 kubenswrapper[33142]: I1204 01:01:54.903937 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config" (OuterVolumeSpecName: "config") pod "6a8f6791-d8d8-4c35-81e0-527ce3232f70" (UID: "6a8f6791-d8d8-4c35-81e0-527ce3232f70"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:01:54.975995 master-0 kubenswrapper[33142]: I1204 01:01:54.973988 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f6791-d8d8-4c35-81e0-527ce3232f70-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:01:55.063414 master-0 kubenswrapper[33142]: I1204 01:01:55.063344 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:55.076166 master-0 kubenswrapper[33142]: I1204 01:01:55.074829 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-kbpk4"] Dec 04 01:01:55.154197 master-0 kubenswrapper[33142]: I1204 01:01:55.154126 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:55.164968 master-0 kubenswrapper[33142]: I1204 01:01:55.164877 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-j7vfz"] Dec 04 01:01:55.393862 master-0 kubenswrapper[33142]: I1204 01:01:55.393696 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"c7fe0d53-7d39-4272-add3-ad3cc75b82d7","Type":"ContainerStarted","Data":"ee70f5fbc0b571e712cc35f6320a54bd82af7da2811371c40a3208b32330ad33"} Dec 04 01:01:55.400629 master-0 kubenswrapper[33142]: I1204 01:01:55.400574 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" event={"ID":"f65e347e-5f35-4964-b087-d00d7087493a","Type":"ContainerStarted","Data":"adb976b65cc27698aba117e0a2ebe1e8b07615e47d5b55a4684e5e4b17657a5a"} Dec 04 01:01:55.401026 master-0 kubenswrapper[33142]: I1204 01:01:55.400941 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:01:55.405817 master-0 kubenswrapper[33142]: I1204 01:01:55.405735 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"fba01013-8dd9-433e-8c42-887c0423c58f","Type":"ContainerStarted","Data":"cc5c6fd403a2b915741e4253d796829fa0e4346a5d7e0a8635247e930b69d763"} Dec 04 01:01:55.675991 master-0 kubenswrapper[33142]: I1204 01:01:55.675753 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" podStartSLOduration=4.719756164 podStartE2EDuration="31.675724319s" podCreationTimestamp="2025-12-04 01:01:24 +0000 UTC" firstStartedPulling="2025-12-04 01:01:25.338340299 +0000 UTC m=+857.740342149" lastFinishedPulling="2025-12-04 01:01:52.294308414 +0000 UTC m=+884.696310304" observedRunningTime="2025-12-04 01:01:55.667083396 +0000 UTC m=+888.069085266" watchObservedRunningTime="2025-12-04 01:01:55.675724319 +0000 UTC m=+888.077726169" Dec 04 01:01:55.982526 master-0 kubenswrapper[33142]: I1204 01:01:55.982366 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8f6791-d8d8-4c35-81e0-527ce3232f70" path="/var/lib/kubelet/pods/6a8f6791-d8d8-4c35-81e0-527ce3232f70/volumes" Dec 04 01:01:55.983155 master-0 kubenswrapper[33142]: I1204 01:01:55.983104 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6afe080c-046d-409a-b00e-29bb8176cb4c" path="/var/lib/kubelet/pods/6afe080c-046d-409a-b00e-29bb8176cb4c/volumes" Dec 04 01:01:58.765048 master-0 kubenswrapper[33142]: I1204 01:01:58.764957 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-metrics-ngp47"] Dec 04 01:01:58.765653 master-0 kubenswrapper[33142]: E1204 01:01:58.765624 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a8f6791-d8d8-4c35-81e0-527ce3232f70" containerName="init" Dec 04 01:01:58.765653 master-0 kubenswrapper[33142]: I1204 01:01:58.765649 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8f6791-d8d8-4c35-81e0-527ce3232f70" containerName="init" Dec 04 01:01:58.765730 master-0 kubenswrapper[33142]: E1204 01:01:58.765677 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6afe080c-046d-409a-b00e-29bb8176cb4c" containerName="init" Dec 04 01:01:58.765730 master-0 kubenswrapper[33142]: I1204 01:01:58.765683 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afe080c-046d-409a-b00e-29bb8176cb4c" containerName="init" Dec 04 01:01:58.765958 master-0 kubenswrapper[33142]: I1204 01:01:58.765945 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a8f6791-d8d8-4c35-81e0-527ce3232f70" containerName="init" Dec 04 01:01:58.766024 master-0 kubenswrapper[33142]: I1204 01:01:58.765972 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6afe080c-046d-409a-b00e-29bb8176cb4c" containerName="init" Dec 04 01:01:58.767008 master-0 kubenswrapper[33142]: I1204 01:01:58.766981 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.769880 master-0 kubenswrapper[33142]: I1204 01:01:58.769816 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-metrics-config" Dec 04 01:01:58.783713 master-0 kubenswrapper[33142]: I1204 01:01:58.781709 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-ngp47"] Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.869896 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovn-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.869990 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkf7\" (UniqueName: \"kubernetes.io/projected/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-kube-api-access-kqkf7\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.870103 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-combined-ca-bundle\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.870127 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovs-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.870152 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.873007 master-0 kubenswrapper[33142]: I1204 01:01:58.870656 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-config\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.975841 master-0 kubenswrapper[33142]: I1204 01:01:58.949292 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:01:58.975841 master-0 kubenswrapper[33142]: I1204 01:01:58.949542 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="dnsmasq-dns" containerID="cri-o://adb976b65cc27698aba117e0a2ebe1e8b07615e47d5b55a4684e5e4b17657a5a" gracePeriod=10 Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980560 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkf7\" (UniqueName: \"kubernetes.io/projected/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-kube-api-access-kqkf7\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980626 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-combined-ca-bundle\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980644 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovs-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980666 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980751 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-config\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980812 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovn-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.980975 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovn-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.983353 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-ovs-rundir\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.983992 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-config\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.984719 master-0 kubenswrapper[33142]: I1204 01:01:58.984708 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-combined-ca-bundle\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:58.988125 master-0 kubenswrapper[33142]: I1204 01:01:58.987953 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:59.023168 master-0 kubenswrapper[33142]: I1204 01:01:59.023090 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:01:59.024863 master-0 kubenswrapper[33142]: I1204 01:01:59.024825 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.057207 master-0 kubenswrapper[33142]: I1204 01:01:59.037293 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Dec 04 01:01:59.057207 master-0 kubenswrapper[33142]: I1204 01:01:59.039293 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkf7\" (UniqueName: \"kubernetes.io/projected/5b8a2c13-798d-45ba-8d23-dbc76d75ede3-kube-api-access-kqkf7\") pod \"ovn-controller-metrics-ngp47\" (UID: \"5b8a2c13-798d-45ba-8d23-dbc76d75ede3\") " pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:59.095973 master-0 kubenswrapper[33142]: I1204 01:01:59.093988 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:01:59.095973 master-0 kubenswrapper[33142]: I1204 01:01:59.094500 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzfpp\" (UniqueName: \"kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.095973 master-0 kubenswrapper[33142]: I1204 01:01:59.094583 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.095973 master-0 kubenswrapper[33142]: I1204 01:01:59.094661 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.095973 master-0 kubenswrapper[33142]: I1204 01:01:59.094690 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.120957 master-0 kubenswrapper[33142]: I1204 01:01:59.118425 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-ngp47" Dec 04 01:01:59.196779 master-0 kubenswrapper[33142]: I1204 01:01:59.196175 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.196779 master-0 kubenswrapper[33142]: I1204 01:01:59.196496 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bzfpp\" (UniqueName: \"kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.196779 master-0 kubenswrapper[33142]: I1204 01:01:59.196590 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.196779 master-0 kubenswrapper[33142]: I1204 01:01:59.196723 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.198467 master-0 kubenswrapper[33142]: I1204 01:01:59.198416 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.199521 master-0 kubenswrapper[33142]: I1204 01:01:59.199479 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.207663 master-0 kubenswrapper[33142]: I1204 01:01:59.200717 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.299071 master-0 kubenswrapper[33142]: I1204 01:01:59.297465 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzfpp\" (UniqueName: \"kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp\") pod \"dnsmasq-dns-669479795c-v6wkz\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.444254 master-0 kubenswrapper[33142]: I1204 01:01:59.444151 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:01:59.446308 master-0 kubenswrapper[33142]: I1204 01:01:59.444691 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="dnsmasq-dns" containerID="cri-o://281e792829ab5828ce0cde55d54254d84397511e795989392d7e912c00de05b6" gracePeriod=10 Dec 04 01:01:59.454587 master-0 kubenswrapper[33142]: I1204 01:01:59.453664 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:01:59.508957 master-0 kubenswrapper[33142]: I1204 01:01:59.505216 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:01:59.513151 master-0 kubenswrapper[33142]: I1204 01:01:59.512206 33142 generic.go:334] "Generic (PLEG): container finished" podID="f65e347e-5f35-4964-b087-d00d7087493a" containerID="adb976b65cc27698aba117e0a2ebe1e8b07615e47d5b55a4684e5e4b17657a5a" exitCode=0 Dec 04 01:01:59.513151 master-0 kubenswrapper[33142]: I1204 01:01:59.512277 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" event={"ID":"f65e347e-5f35-4964-b087-d00d7087493a","Type":"ContainerDied","Data":"adb976b65cc27698aba117e0a2ebe1e8b07615e47d5b55a4684e5e4b17657a5a"} Dec 04 01:01:59.538123 master-0 kubenswrapper[33142]: I1204 01:01:59.537973 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:01:59.540044 master-0 kubenswrapper[33142]: I1204 01:01:59.539962 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.549314 master-0 kubenswrapper[33142]: I1204 01:01:59.548183 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Dec 04 01:01:59.557228 master-0 kubenswrapper[33142]: I1204 01:01:59.557179 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:01:59.630865 master-0 kubenswrapper[33142]: I1204 01:01:59.630752 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.631467 master-0 kubenswrapper[33142]: I1204 01:01:59.630962 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.631467 master-0 kubenswrapper[33142]: I1204 01:01:59.631006 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.631467 master-0 kubenswrapper[33142]: I1204 01:01:59.631233 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.631467 master-0 kubenswrapper[33142]: I1204 01:01:59.631319 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztsrq\" (UniqueName: \"kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.734707 master-0 kubenswrapper[33142]: I1204 01:01:59.734606 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735067 master-0 kubenswrapper[33142]: I1204 01:01:59.734752 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735067 master-0 kubenswrapper[33142]: I1204 01:01:59.734789 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735067 master-0 kubenswrapper[33142]: I1204 01:01:59.734864 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735067 master-0 kubenswrapper[33142]: I1204 01:01:59.734913 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ztsrq\" (UniqueName: \"kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735909 master-0 kubenswrapper[33142]: I1204 01:01:59.735663 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.735909 master-0 kubenswrapper[33142]: I1204 01:01:59.735738 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.737896 master-0 kubenswrapper[33142]: I1204 01:01:59.736155 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.737896 master-0 kubenswrapper[33142]: I1204 01:01:59.736811 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.753697 master-0 kubenswrapper[33142]: I1204 01:01:59.753638 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztsrq\" (UniqueName: \"kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq\") pod \"dnsmasq-dns-57545c5d5f-k9h6k\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:01:59.927584 master-0 kubenswrapper[33142]: I1204 01:01:59.927508 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:02:00.072286 master-0 kubenswrapper[33142]: I1204 01:02:00.072223 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/memcached-0" Dec 04 01:02:00.535868 master-0 kubenswrapper[33142]: I1204 01:02:00.535792 33142 generic.go:334] "Generic (PLEG): container finished" podID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerID="281e792829ab5828ce0cde55d54254d84397511e795989392d7e912c00de05b6" exitCode=0 Dec 04 01:02:00.536195 master-0 kubenswrapper[33142]: I1204 01:02:00.535857 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" event={"ID":"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68","Type":"ContainerDied","Data":"281e792829ab5828ce0cde55d54254d84397511e795989392d7e912c00de05b6"} Dec 04 01:02:01.686800 master-0 kubenswrapper[33142]: I1204 01:02:01.686688 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" event={"ID":"f65e347e-5f35-4964-b087-d00d7087493a","Type":"ContainerDied","Data":"3c641708fddd2d03b24286a83030a41d12a8bd1b034948da8fafc030112faad5"} Dec 04 01:02:01.687531 master-0 kubenswrapper[33142]: I1204 01:02:01.687446 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c641708fddd2d03b24286a83030a41d12a8bd1b034948da8fafc030112faad5" Dec 04 01:02:01.710946 master-0 kubenswrapper[33142]: I1204 01:02:01.708686 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:02:02.239814 master-0 kubenswrapper[33142]: I1204 01:02:02.233688 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:02:02.239814 master-0 kubenswrapper[33142]: I1204 01:02:02.238802 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:02:02.257117 master-0 kubenswrapper[33142]: I1204 01:02:02.257032 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" event={"ID":"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68","Type":"ContainerDied","Data":"427a4f00773ba785dbe97ac62ab11b8a7c07d7effd5b44cbf99d376b2ebd4312"} Dec 04 01:02:02.257117 master-0 kubenswrapper[33142]: I1204 01:02:02.257106 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:02:02.257618 master-0 kubenswrapper[33142]: I1204 01:02:02.257571 33142 scope.go:117] "RemoveContainer" containerID="281e792829ab5828ce0cde55d54254d84397511e795989392d7e912c00de05b6" Dec 04 01:02:02.257729 master-0 kubenswrapper[33142]: E1204 01:02:02.257582 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="dnsmasq-dns" Dec 04 01:02:02.257791 master-0 kubenswrapper[33142]: I1204 01:02:02.257757 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="dnsmasq-dns" Dec 04 01:02:02.258011 master-0 kubenswrapper[33142]: E1204 01:02:02.257991 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="dnsmasq-dns" Dec 04 01:02:02.258011 master-0 kubenswrapper[33142]: I1204 01:02:02.258005 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="dnsmasq-dns" Dec 04 01:02:02.258168 master-0 kubenswrapper[33142]: E1204 01:02:02.258033 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="init" Dec 04 01:02:02.258168 master-0 kubenswrapper[33142]: I1204 01:02:02.258041 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="init" Dec 04 01:02:02.258168 master-0 kubenswrapper[33142]: E1204 01:02:02.258065 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="init" Dec 04 01:02:02.258168 master-0 kubenswrapper[33142]: I1204 01:02:02.258072 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="init" Dec 04 01:02:02.260627 master-0 kubenswrapper[33142]: I1204 01:02:02.258716 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f65e347e-5f35-4964-b087-d00d7087493a" containerName="dnsmasq-dns" Dec 04 01:02:02.260627 master-0 kubenswrapper[33142]: I1204 01:02:02.258786 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="dnsmasq-dns" Dec 04 01:02:02.291799 master-0 kubenswrapper[33142]: I1204 01:02:02.264301 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.322341 master-0 kubenswrapper[33142]: I1204 01:02:02.322133 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:02:02.379533 master-0 kubenswrapper[33142]: I1204 01:02:02.378907 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc\") pod \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " Dec 04 01:02:02.379533 master-0 kubenswrapper[33142]: I1204 01:02:02.379160 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc\") pod \"f65e347e-5f35-4964-b087-d00d7087493a\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " Dec 04 01:02:02.379533 master-0 kubenswrapper[33142]: I1204 01:02:02.379494 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrd48\" (UniqueName: \"kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48\") pod \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " Dec 04 01:02:02.380033 master-0 kubenswrapper[33142]: I1204 01:02:02.379584 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4f8x\" (UniqueName: \"kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x\") pod \"f65e347e-5f35-4964-b087-d00d7087493a\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " Dec 04 01:02:02.380033 master-0 kubenswrapper[33142]: I1204 01:02:02.379627 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config\") pod \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\" (UID: \"2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68\") " Dec 04 01:02:02.380033 master-0 kubenswrapper[33142]: I1204 01:02:02.379728 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config\") pod \"f65e347e-5f35-4964-b087-d00d7087493a\" (UID: \"f65e347e-5f35-4964-b087-d00d7087493a\") " Dec 04 01:02:02.380256 master-0 kubenswrapper[33142]: I1204 01:02:02.380226 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvv2x\" (UniqueName: \"kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.380529 master-0 kubenswrapper[33142]: I1204 01:02:02.380346 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.380529 master-0 kubenswrapper[33142]: I1204 01:02:02.380382 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.380529 master-0 kubenswrapper[33142]: I1204 01:02:02.380422 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.380529 master-0 kubenswrapper[33142]: I1204 01:02:02.380490 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.396837 master-0 kubenswrapper[33142]: I1204 01:02:02.385847 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48" (OuterVolumeSpecName: "kube-api-access-lrd48") pod "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" (UID: "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68"). InnerVolumeSpecName "kube-api-access-lrd48". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:02.424775 master-0 kubenswrapper[33142]: I1204 01:02:02.424129 33142 scope.go:117] "RemoveContainer" containerID="2656ef34044683764c36afc04cdc6c2ce39e5f4e4a7be77b51d9bb07416b17d4" Dec 04 01:02:02.424775 master-0 kubenswrapper[33142]: I1204 01:02:02.424221 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x" (OuterVolumeSpecName: "kube-api-access-l4f8x") pod "f65e347e-5f35-4964-b087-d00d7087493a" (UID: "f65e347e-5f35-4964-b087-d00d7087493a"). InnerVolumeSpecName "kube-api-access-l4f8x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:02.486752 master-0 kubenswrapper[33142]: I1204 01:02:02.486361 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.487374 master-0 kubenswrapper[33142]: I1204 01:02:02.487328 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.487633 master-0 kubenswrapper[33142]: I1204 01:02:02.487583 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nvv2x\" (UniqueName: \"kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.500205 master-0 kubenswrapper[33142]: I1204 01:02:02.499252 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.500205 master-0 kubenswrapper[33142]: I1204 01:02:02.499347 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.500205 master-0 kubenswrapper[33142]: I1204 01:02:02.499757 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l4f8x\" (UniqueName: \"kubernetes.io/projected/f65e347e-5f35-4964-b087-d00d7087493a-kube-api-access-l4f8x\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.500205 master-0 kubenswrapper[33142]: I1204 01:02:02.499788 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lrd48\" (UniqueName: \"kubernetes.io/projected/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-kube-api-access-lrd48\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.500373 master-0 kubenswrapper[33142]: I1204 01:02:02.490877 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.500373 master-0 kubenswrapper[33142]: I1204 01:02:02.492294 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.504991 master-0 kubenswrapper[33142]: I1204 01:02:02.501180 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.504991 master-0 kubenswrapper[33142]: I1204 01:02:02.501361 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.535714 master-0 kubenswrapper[33142]: I1204 01:02:02.535637 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvv2x\" (UniqueName: \"kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x\") pod \"dnsmasq-dns-5789dc4cf-p6nnc\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.588087 master-0 kubenswrapper[33142]: I1204 01:02:02.588027 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:02:02.642887 master-0 kubenswrapper[33142]: I1204 01:02:02.642819 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:02.682997 master-0 kubenswrapper[33142]: I1204 01:02:02.681772 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "f65e347e-5f35-4964-b087-d00d7087493a" (UID: "f65e347e-5f35-4964-b087-d00d7087493a"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:02.692790 master-0 kubenswrapper[33142]: W1204 01:02:02.691781 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f8d1ef_d763_4010_9c1f_52b10ce84214.slice/crio-e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6 WatchSource:0}: Error finding container e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6: Status 404 returned error can't find the container with id e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6 Dec 04 01:02:02.707475 master-0 kubenswrapper[33142]: I1204 01:02:02.705817 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.707475 master-0 kubenswrapper[33142]: I1204 01:02:02.707304 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config" (OuterVolumeSpecName: "config") pod "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" (UID: "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:02.707475 master-0 kubenswrapper[33142]: I1204 01:02:02.707445 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config" (OuterVolumeSpecName: "config") pod "f65e347e-5f35-4964-b087-d00d7087493a" (UID: "f65e347e-5f35-4964-b087-d00d7087493a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:02.747866 master-0 kubenswrapper[33142]: I1204 01:02:02.747667 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" (UID: "2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:02.806247 master-0 kubenswrapper[33142]: I1204 01:02:02.806193 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:02:02.807978 master-0 kubenswrapper[33142]: I1204 01:02:02.807944 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.807978 master-0 kubenswrapper[33142]: I1204 01:02:02.807976 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65e347e-5f35-4964-b087-d00d7087493a-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.808084 master-0 kubenswrapper[33142]: I1204 01:02:02.807988 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:02.858574 master-0 kubenswrapper[33142]: I1204 01:02:02.858484 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-ngp47"] Dec 04 01:02:03.272803 master-0 kubenswrapper[33142]: I1204 01:02:03.272667 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-669479795c-v6wkz" event={"ID":"afda60a9-7c22-4c7e-807e-c8d387a3fcc7","Type":"ContainerStarted","Data":"946869b174263c143a670e380380d534de60d0568c4753947c6783b5a4aac037"} Dec 04 01:02:03.274961 master-0 kubenswrapper[33142]: I1204 01:02:03.274879 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" event={"ID":"17f8d1ef-d763-4010-9c1f-52b10ce84214","Type":"ContainerStarted","Data":"e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6"} Dec 04 01:02:03.279762 master-0 kubenswrapper[33142]: I1204 01:02:03.279657 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" Dec 04 01:02:03.283784 master-0 kubenswrapper[33142]: I1204 01:02:03.283706 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"bab681a7-5fd3-4071-b8ba-7f07a5923507","Type":"ContainerStarted","Data":"6bf08319dc3b6f350d977edaca627cdbd8036a4ed0ef13f4109ee88abd741760"} Dec 04 01:02:03.287973 master-0 kubenswrapper[33142]: I1204 01:02:03.287775 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-ngp47" event={"ID":"5b8a2c13-798d-45ba-8d23-dbc76d75ede3","Type":"ContainerStarted","Data":"2d65cd30581622ff60df9893af496ece47494ea18f204f15ec64ed5f6661c379"} Dec 04 01:02:03.300613 master-0 kubenswrapper[33142]: I1204 01:02:03.299742 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-j4d5q" Dec 04 01:02:03.300613 master-0 kubenswrapper[33142]: I1204 01:02:03.299985 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"1093df42-0d18-468f-88e8-4476ca7f3712","Type":"ContainerStarted","Data":"ba30f455c7892e5fc51b1264df5c45629b4df22f275dc9605f02e85397d4ca4b"} Dec 04 01:02:03.654379 master-0 kubenswrapper[33142]: I1204 01:02:03.654315 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:02:03.666501 master-0 kubenswrapper[33142]: I1204 01:02:03.666419 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-92v9d"] Dec 04 01:02:03.691762 master-0 kubenswrapper[33142]: I1204 01:02:03.691494 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:02:03.922783 master-0 kubenswrapper[33142]: I1204 01:02:03.922549 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" path="/var/lib/kubelet/pods/2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68/volumes" Dec 04 01:02:03.974779 master-0 kubenswrapper[33142]: I1204 01:02:03.974208 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:02:03.983329 master-0 kubenswrapper[33142]: I1204 01:02:03.983256 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-j4d5q"] Dec 04 01:02:04.284960 master-0 kubenswrapper[33142]: I1204 01:02:04.280407 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-storage-0"] Dec 04 01:02:04.294656 master-0 kubenswrapper[33142]: I1204 01:02:04.294584 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Dec 04 01:02:04.299067 master-0 kubenswrapper[33142]: I1204 01:02:04.298758 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-storage-config-data" Dec 04 01:02:04.300891 master-0 kubenswrapper[33142]: I1204 01:02:04.300043 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-files" Dec 04 01:02:04.300891 master-0 kubenswrapper[33142]: I1204 01:02:04.300256 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-conf" Dec 04 01:02:04.306153 master-0 kubenswrapper[33142]: I1204 01:02:04.306086 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Dec 04 01:02:04.326488 master-0 kubenswrapper[33142]: I1204 01:02:04.326358 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d" event={"ID":"bf7dac9a-11f8-42a9-90f8-51eb463e30a9","Type":"ContainerStarted","Data":"44902b19a58835a55c908186bc2273ac4a29e1903893c7d5a3f3fc4d41c3f868"} Dec 04 01:02:04.327256 master-0 kubenswrapper[33142]: I1204 01:02:04.327206 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-b4m9d" Dec 04 01:02:04.330566 master-0 kubenswrapper[33142]: I1204 01:02:04.330520 33142 generic.go:334] "Generic (PLEG): container finished" podID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerID="97cb0109392a04cce9c42db8f91aadf12281432d8cdab6fe673a68743641b763" exitCode=0 Dec 04 01:02:04.330741 master-0 kubenswrapper[33142]: I1204 01:02:04.330596 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" event={"ID":"17f8d1ef-d763-4010-9c1f-52b10ce84214","Type":"ContainerDied","Data":"97cb0109392a04cce9c42db8f91aadf12281432d8cdab6fe673a68743641b763"} Dec 04 01:02:04.336739 master-0 kubenswrapper[33142]: I1204 01:02:04.336506 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"906b75fe-8760-47f2-af0b-44fe551598c3","Type":"ContainerStarted","Data":"4d4857e7791d6994a8347c1cb16451ef37353b86856b8e59e6a05dc8b10d62a5"} Dec 04 01:02:04.340781 master-0 kubenswrapper[33142]: I1204 01:02:04.340743 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"92a89491-dea3-4ede-b420-8629c8ed34e4","Type":"ContainerStarted","Data":"554567b92401dc39874b624656d08ba8d601fac72c08c43be5a65cff1e9b3095"} Dec 04 01:02:04.380076 master-0 kubenswrapper[33142]: I1204 01:02:04.367557 33142 generic.go:334] "Generic (PLEG): container finished" podID="84149f95-d7bd-478d-88fe-f1f582ec4929" containerID="03e2262308b7dec6dc1f4c080dac8ef502bcd30d097c65b67628ff7a27754a32" exitCode=0 Dec 04 01:02:04.380076 master-0 kubenswrapper[33142]: I1204 01:02:04.367810 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-q8gcl" event={"ID":"84149f95-d7bd-478d-88fe-f1f582ec4929","Type":"ContainerDied","Data":"03e2262308b7dec6dc1f4c080dac8ef502bcd30d097c65b67628ff7a27754a32"} Dec 04 01:02:04.402459 master-0 kubenswrapper[33142]: I1204 01:02:04.397491 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" event={"ID":"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3","Type":"ContainerStarted","Data":"3fe6746a3c02ddb67fd5af20515f438a45d170d6340b0e02c2b2341c4982259d"} Dec 04 01:02:04.417144 master-0 kubenswrapper[33142]: I1204 01:02:04.415819 33142 generic.go:334] "Generic (PLEG): container finished" podID="afda60a9-7c22-4c7e-807e-c8d387a3fcc7" containerID="739d24f0b161ca7fd84c7c6cdbdc868d4bbabfa4297eba100ca04595bc49ceb3" exitCode=0 Dec 04 01:02:04.417144 master-0 kubenswrapper[33142]: I1204 01:02:04.415978 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-669479795c-v6wkz" event={"ID":"afda60a9-7c22-4c7e-807e-c8d387a3fcc7","Type":"ContainerDied","Data":"739d24f0b161ca7fd84c7c6cdbdc868d4bbabfa4297eba100ca04595bc49ceb3"} Dec 04 01:02:04.427777 master-0 kubenswrapper[33142]: I1204 01:02:04.427626 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-b4m9d" podStartSLOduration=19.091650501 podStartE2EDuration="27.42759261s" podCreationTimestamp="2025-12-04 01:01:37 +0000 UTC" firstStartedPulling="2025-12-04 01:01:53.157974902 +0000 UTC m=+885.559976752" lastFinishedPulling="2025-12-04 01:02:01.493917011 +0000 UTC m=+893.895918861" observedRunningTime="2025-12-04 01:02:04.384140285 +0000 UTC m=+896.786142165" watchObservedRunningTime="2025-12-04 01:02:04.42759261 +0000 UTC m=+896.829594480" Dec 04 01:02:04.478191 master-0 kubenswrapper[33142]: I1204 01:02:04.478111 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-lock\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.478644 master-0 kubenswrapper[33142]: I1204 01:02:04.478220 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f6c08b78-d328-4a4a-94f9-e0a229d674e6\" (UniqueName: \"kubernetes.io/csi/topolvm.io^3ac12e8b-fe43-4b14-b4ad-18011ff3a50a\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.478644 master-0 kubenswrapper[33142]: I1204 01:02:04.478269 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.478644 master-0 kubenswrapper[33142]: I1204 01:02:04.478351 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86pp\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-kube-api-access-h86pp\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.478644 master-0 kubenswrapper[33142]: I1204 01:02:04.478373 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-cache\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.581054 master-0 kubenswrapper[33142]: I1204 01:02:04.580986 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.581300 master-0 kubenswrapper[33142]: I1204 01:02:04.581212 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h86pp\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-kube-api-access-h86pp\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.581300 master-0 kubenswrapper[33142]: I1204 01:02:04.581248 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-cache\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.581435 master-0 kubenswrapper[33142]: I1204 01:02:04.581407 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-lock\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.581519 master-0 kubenswrapper[33142]: I1204 01:02:04.581498 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-f6c08b78-d328-4a4a-94f9-e0a229d674e6\" (UniqueName: \"kubernetes.io/csi/topolvm.io^3ac12e8b-fe43-4b14-b4ad-18011ff3a50a\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.582657 master-0 kubenswrapper[33142]: E1204 01:02:04.582632 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:04.582657 master-0 kubenswrapper[33142]: E1204 01:02:04.582654 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:04.582764 master-0 kubenswrapper[33142]: E1204 01:02:04.582719 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:05.08268015 +0000 UTC m=+897.484682000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:04.586100 master-0 kubenswrapper[33142]: I1204 01:02:04.586054 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-cache\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.586270 master-0 kubenswrapper[33142]: I1204 01:02:04.586160 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/96b9aff9-fcd4-4893-99cc-eebf4d97d339-lock\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.609608 master-0 kubenswrapper[33142]: I1204 01:02:04.609536 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:02:04.609608 master-0 kubenswrapper[33142]: I1204 01:02:04.609604 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-f6c08b78-d328-4a4a-94f9-e0a229d674e6\" (UniqueName: \"kubernetes.io/csi/topolvm.io^3ac12e8b-fe43-4b14-b4ad-18011ff3a50a\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/d2f38a385c6ee07cb5923f4f3727179f5b3e0b4d95aa6c53d91ebffcc43f81df/globalmount\"" pod="openstack/swift-storage-0" Dec 04 01:02:04.610180 master-0 kubenswrapper[33142]: I1204 01:02:04.610145 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86pp\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-kube-api-access-h86pp\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:04.947668 master-0 kubenswrapper[33142]: E1204 01:02:04.947547 33142 log.go:32] "CreateContainer in sandbox from runtime service failed" err=< Dec 04 01:02:04.947668 master-0 kubenswrapper[33142]: rpc error: code = Unknown desc = container create failed: mount `/var/lib/kubelet/pods/17f8d1ef-d763-4010-9c1f-52b10ce84214/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 01:02:04.947668 master-0 kubenswrapper[33142]: > podSandboxID="e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6" Dec 04 01:02:04.948811 master-0 kubenswrapper[33142]: E1204 01:02:04.947802 33142 kuberuntime_manager.go:1274] "Unhandled Error" err=< Dec 04 01:02:04.948811 master-0 kubenswrapper[33142]: container &Container{Name:dnsmasq-dns,Image:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:42f5663a161307156673f86e5eaad59f842a4bf25824f48008e69ab18e4ba792,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n578h4h686h595h655hdch5dh68ch558h4h67ch574h667h54dhcfhch5bdh67hc8h54ch5c7h698h576h5b7h694h5ddh686h5f8h94h7h58chcfq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dns,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dns-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dns-svc,SubPath:dns-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-nb,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/ovsdbserver-nb,SubPath:ovsdbserver-nb,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-sb,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/ovsdbserver-sb,SubPath:ovsdbserver-sb,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-ztsrq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000800000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dns-57545c5d5f-k9h6k_openstack(17f8d1ef-d763-4010-9c1f-52b10ce84214): CreateContainerError: container create failed: mount `/var/lib/kubelet/pods/17f8d1ef-d763-4010-9c1f-52b10ce84214/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 01:02:04.948811 master-0 kubenswrapper[33142]: > logger="UnhandledError" Dec 04 01:02:04.949168 master-0 kubenswrapper[33142]: E1204 01:02:04.949072 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dnsmasq-dns\" with CreateContainerError: \"container create failed: mount `/var/lib/kubelet/pods/17f8d1ef-d763-4010-9c1f-52b10ce84214/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory\\n\"" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" Dec 04 01:02:05.064320 master-0 kubenswrapper[33142]: I1204 01:02:05.064158 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:02:05.111428 master-0 kubenswrapper[33142]: I1204 01:02:05.111284 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:05.111756 master-0 kubenswrapper[33142]: E1204 01:02:05.111578 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:05.111756 master-0 kubenswrapper[33142]: E1204 01:02:05.111599 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:05.111756 master-0 kubenswrapper[33142]: E1204 01:02:05.111649 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:06.111634845 +0000 UTC m=+898.513636695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:05.212345 master-0 kubenswrapper[33142]: I1204 01:02:05.212298 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzfpp\" (UniqueName: \"kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp\") pod \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " Dec 04 01:02:05.212566 master-0 kubenswrapper[33142]: I1204 01:02:05.212421 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb\") pod \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " Dec 04 01:02:05.212566 master-0 kubenswrapper[33142]: I1204 01:02:05.212560 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config\") pod \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " Dec 04 01:02:05.212763 master-0 kubenswrapper[33142]: I1204 01:02:05.212734 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc\") pod \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\" (UID: \"afda60a9-7c22-4c7e-807e-c8d387a3fcc7\") " Dec 04 01:02:05.227261 master-0 kubenswrapper[33142]: I1204 01:02:05.227187 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp" (OuterVolumeSpecName: "kube-api-access-bzfpp") pod "afda60a9-7c22-4c7e-807e-c8d387a3fcc7" (UID: "afda60a9-7c22-4c7e-807e-c8d387a3fcc7"). InnerVolumeSpecName "kube-api-access-bzfpp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:05.239381 master-0 kubenswrapper[33142]: I1204 01:02:05.239035 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config" (OuterVolumeSpecName: "config") pod "afda60a9-7c22-4c7e-807e-c8d387a3fcc7" (UID: "afda60a9-7c22-4c7e-807e-c8d387a3fcc7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:05.259450 master-0 kubenswrapper[33142]: I1204 01:02:05.259353 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "afda60a9-7c22-4c7e-807e-c8d387a3fcc7" (UID: "afda60a9-7c22-4c7e-807e-c8d387a3fcc7"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:05.267912 master-0 kubenswrapper[33142]: I1204 01:02:05.267822 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "afda60a9-7c22-4c7e-807e-c8d387a3fcc7" (UID: "afda60a9-7c22-4c7e-807e-c8d387a3fcc7"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:05.323313 master-0 kubenswrapper[33142]: I1204 01:02:05.323157 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:05.323313 master-0 kubenswrapper[33142]: I1204 01:02:05.323232 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:05.323313 master-0 kubenswrapper[33142]: I1204 01:02:05.323255 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bzfpp\" (UniqueName: \"kubernetes.io/projected/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-kube-api-access-bzfpp\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:05.323313 master-0 kubenswrapper[33142]: I1204 01:02:05.323277 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/afda60a9-7c22-4c7e-807e-c8d387a3fcc7-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:05.439358 master-0 kubenswrapper[33142]: I1204 01:02:05.437818 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-669479795c-v6wkz" event={"ID":"afda60a9-7c22-4c7e-807e-c8d387a3fcc7","Type":"ContainerDied","Data":"946869b174263c143a670e380380d534de60d0568c4753947c6783b5a4aac037"} Dec 04 01:02:05.439358 master-0 kubenswrapper[33142]: I1204 01:02:05.437918 33142 scope.go:117] "RemoveContainer" containerID="739d24f0b161ca7fd84c7c6cdbdc868d4bbabfa4297eba100ca04595bc49ceb3" Dec 04 01:02:05.439358 master-0 kubenswrapper[33142]: I1204 01:02:05.437860 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-669479795c-v6wkz" Dec 04 01:02:05.441821 master-0 kubenswrapper[33142]: I1204 01:02:05.441778 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-q8gcl" event={"ID":"84149f95-d7bd-478d-88fe-f1f582ec4929","Type":"ContainerStarted","Data":"35106d7ff986100b6621bb2a5f7df60f554eac93764bf5dc62f63f2a85511bec"} Dec 04 01:02:05.445581 master-0 kubenswrapper[33142]: I1204 01:02:05.445529 33142 generic.go:334] "Generic (PLEG): container finished" podID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerID="db79ce2db76e6d95e811c6c6d364f6c4a398706dad19b7034ad9b3572d41e89b" exitCode=0 Dec 04 01:02:05.446328 master-0 kubenswrapper[33142]: I1204 01:02:05.446298 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" event={"ID":"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3","Type":"ContainerDied","Data":"db79ce2db76e6d95e811c6c6d364f6c4a398706dad19b7034ad9b3572d41e89b"} Dec 04 01:02:05.446410 master-0 kubenswrapper[33142]: I1204 01:02:05.446342 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" event={"ID":"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3","Type":"ContainerStarted","Data":"a0f915aa0e41770f8e996eb658a71d56b9e90678a7943015f960a395d831f289"} Dec 04 01:02:05.447635 master-0 kubenswrapper[33142]: I1204 01:02:05.447584 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:05.512169 master-0 kubenswrapper[33142]: I1204 01:02:05.512067 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" podStartSLOduration=4.512039669 podStartE2EDuration="4.512039669s" podCreationTimestamp="2025-12-04 01:02:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:05.496979364 +0000 UTC m=+897.898981234" watchObservedRunningTime="2025-12-04 01:02:05.512039669 +0000 UTC m=+897.914041519" Dec 04 01:02:05.565151 master-0 kubenswrapper[33142]: I1204 01:02:05.565076 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:02:05.582226 master-0 kubenswrapper[33142]: I1204 01:02:05.582010 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-669479795c-v6wkz"] Dec 04 01:02:05.916104 master-0 kubenswrapper[33142]: I1204 01:02:05.916036 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afda60a9-7c22-4c7e-807e-c8d387a3fcc7" path="/var/lib/kubelet/pods/afda60a9-7c22-4c7e-807e-c8d387a3fcc7/volumes" Dec 04 01:02:05.916616 master-0 kubenswrapper[33142]: I1204 01:02:05.916597 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65e347e-5f35-4964-b087-d00d7087493a" path="/var/lib/kubelet/pods/f65e347e-5f35-4964-b087-d00d7087493a/volumes" Dec 04 01:02:06.147677 master-0 kubenswrapper[33142]: I1204 01:02:06.147588 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:06.148328 master-0 kubenswrapper[33142]: E1204 01:02:06.147830 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:06.148328 master-0 kubenswrapper[33142]: E1204 01:02:06.147852 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:06.148328 master-0 kubenswrapper[33142]: E1204 01:02:06.147945 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:08.147889136 +0000 UTC m=+900.549890996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:06.205391 master-0 kubenswrapper[33142]: I1204 01:02:06.205225 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-658bb5765c-92v9d" podUID="2bf2ca39-d7d6-4a99-bf51-d5ba7da99d68" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.0.181:5353: i/o timeout" Dec 04 01:02:06.460158 master-0 kubenswrapper[33142]: I1204 01:02:06.459910 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-f6c08b78-d328-4a4a-94f9-e0a229d674e6\" (UniqueName: \"kubernetes.io/csi/topolvm.io^3ac12e8b-fe43-4b14-b4ad-18011ff3a50a\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:06.466472 master-0 kubenswrapper[33142]: I1204 01:02:06.466416 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-q8gcl" event={"ID":"84149f95-d7bd-478d-88fe-f1f582ec4929","Type":"ContainerStarted","Data":"2df97f1f1785498dccead092bdbbda4105316cc329c7bbfe72611c53ca5eedb2"} Dec 04 01:02:06.466762 master-0 kubenswrapper[33142]: I1204 01:02:06.466735 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:02:06.562387 master-0 kubenswrapper[33142]: I1204 01:02:06.562058 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-ovs-q8gcl" podStartSLOduration=22.185045619 podStartE2EDuration="29.562004676s" podCreationTimestamp="2025-12-04 01:01:37 +0000 UTC" firstStartedPulling="2025-12-04 01:01:54.05470297 +0000 UTC m=+886.456704820" lastFinishedPulling="2025-12-04 01:02:01.431662027 +0000 UTC m=+893.833663877" observedRunningTime="2025-12-04 01:02:06.549468273 +0000 UTC m=+898.951470133" watchObservedRunningTime="2025-12-04 01:02:06.562004676 +0000 UTC m=+898.964006546" Dec 04 01:02:06.737014 master-0 kubenswrapper[33142]: I1204 01:02:06.734523 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-ring-rebalance-786cl"] Dec 04 01:02:06.737014 master-0 kubenswrapper[33142]: E1204 01:02:06.735143 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="afda60a9-7c22-4c7e-807e-c8d387a3fcc7" containerName="init" Dec 04 01:02:06.737014 master-0 kubenswrapper[33142]: I1204 01:02:06.735161 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="afda60a9-7c22-4c7e-807e-c8d387a3fcc7" containerName="init" Dec 04 01:02:06.737014 master-0 kubenswrapper[33142]: I1204 01:02:06.735456 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="afda60a9-7c22-4c7e-807e-c8d387a3fcc7" containerName="init" Dec 04 01:02:06.737014 master-0 kubenswrapper[33142]: I1204 01:02:06.736468 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:06.742890 master-0 kubenswrapper[33142]: I1204 01:02:06.742835 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-config-data" Dec 04 01:02:06.743208 master-0 kubenswrapper[33142]: I1204 01:02:06.743184 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-proxy-config-data" Dec 04 01:02:06.743406 master-0 kubenswrapper[33142]: I1204 01:02:06.743384 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-scripts" Dec 04 01:02:06.754089 master-0 kubenswrapper[33142]: I1204 01:02:06.754039 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-ring-rebalance-786cl"] Dec 04 01:02:07.198121 master-0 kubenswrapper[33142]: I1204 01:02:07.198014 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198128 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198178 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198242 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198278 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgbcw\" (UniqueName: \"kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198399 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.198651 master-0 kubenswrapper[33142]: I1204 01:02:07.198440 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301077 master-0 kubenswrapper[33142]: I1204 01:02:07.300975 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301077 master-0 kubenswrapper[33142]: I1204 01:02:07.301081 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301534 master-0 kubenswrapper[33142]: I1204 01:02:07.301341 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301534 master-0 kubenswrapper[33142]: I1204 01:02:07.301391 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301534 master-0 kubenswrapper[33142]: I1204 01:02:07.301421 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301637 master-0 kubenswrapper[33142]: I1204 01:02:07.301584 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.301727 master-0 kubenswrapper[33142]: I1204 01:02:07.301616 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hgbcw\" (UniqueName: \"kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.306491 master-0 kubenswrapper[33142]: I1204 01:02:07.306408 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.306491 master-0 kubenswrapper[33142]: I1204 01:02:07.306459 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.306727 master-0 kubenswrapper[33142]: I1204 01:02:07.306656 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.309605 master-0 kubenswrapper[33142]: I1204 01:02:07.309092 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.309605 master-0 kubenswrapper[33142]: I1204 01:02:07.309564 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.309957 master-0 kubenswrapper[33142]: I1204 01:02:07.309871 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.468568 master-0 kubenswrapper[33142]: I1204 01:02:07.467781 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgbcw\" (UniqueName: \"kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw\") pod \"swift-ring-rebalance-786cl\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:07.484491 master-0 kubenswrapper[33142]: I1204 01:02:07.484397 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:02:07.674664 master-0 kubenswrapper[33142]: I1204 01:02:07.674539 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:08.222294 master-0 kubenswrapper[33142]: I1204 01:02:08.222230 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:08.232576 master-0 kubenswrapper[33142]: E1204 01:02:08.222415 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:08.232576 master-0 kubenswrapper[33142]: E1204 01:02:08.222440 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:08.232576 master-0 kubenswrapper[33142]: E1204 01:02:08.222509 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:12.222489336 +0000 UTC m=+904.624491186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:08.668325 master-0 kubenswrapper[33142]: I1204 01:02:08.667771 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" event={"ID":"17f8d1ef-d763-4010-9c1f-52b10ce84214","Type":"ContainerStarted","Data":"90b935ab03b22149784c5d749543687c768982460e8c9cb5bbbdb31e15f00deb"} Dec 04 01:02:08.673701 master-0 kubenswrapper[33142]: I1204 01:02:08.673167 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:02:08.676349 master-0 kubenswrapper[33142]: I1204 01:02:08.676280 33142 generic.go:334] "Generic (PLEG): container finished" podID="bab681a7-5fd3-4071-b8ba-7f07a5923507" containerID="6bf08319dc3b6f350d977edaca627cdbd8036a4ed0ef13f4109ee88abd741760" exitCode=0 Dec 04 01:02:08.676678 master-0 kubenswrapper[33142]: I1204 01:02:08.676615 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"bab681a7-5fd3-4071-b8ba-7f07a5923507","Type":"ContainerDied","Data":"6bf08319dc3b6f350d977edaca627cdbd8036a4ed0ef13f4109ee88abd741760"} Dec 04 01:02:08.712677 master-0 kubenswrapper[33142]: I1204 01:02:08.712611 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-ring-rebalance-786cl"] Dec 04 01:02:08.719408 master-0 kubenswrapper[33142]: I1204 01:02:08.719229 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" podStartSLOduration=9.719192103 podStartE2EDuration="9.719192103s" podCreationTimestamp="2025-12-04 01:01:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:08.697328177 +0000 UTC m=+901.099330047" watchObservedRunningTime="2025-12-04 01:02:08.719192103 +0000 UTC m=+901.121193963" Dec 04 01:02:08.974498 master-0 kubenswrapper[33142]: I1204 01:02:08.974440 33142 trace.go:236] Trace[1139391702]: "Calculate volume metrics of mysql-db for pod openstack/openstack-galera-0" (04-Dec-2025 01:02:07.876) (total time: 1098ms): Dec 04 01:02:08.974498 master-0 kubenswrapper[33142]: Trace[1139391702]: [1.098105073s] [1.098105073s] END Dec 04 01:02:09.138205 master-0 kubenswrapper[33142]: I1204 01:02:09.138060 33142 trace.go:236] Trace[1176753830]: "Calculate volume metrics of ovndbcluster-sb-etc-ovn for pod openstack/ovsdbserver-sb-0" (04-Dec-2025 01:02:07.876) (total time: 1261ms): Dec 04 01:02:09.138205 master-0 kubenswrapper[33142]: Trace[1176753830]: [1.261405246s] [1.261405246s] END Dec 04 01:02:09.595962 master-0 kubenswrapper[33142]: I1204 01:02:09.595110 33142 trace.go:236] Trace[712463213]: "Calculate volume metrics of swift for pod openstack/swift-storage-0" (04-Dec-2025 01:02:07.876) (total time: 1718ms): Dec 04 01:02:09.595962 master-0 kubenswrapper[33142]: Trace[712463213]: [1.718846366s] [1.718846366s] END Dec 04 01:02:09.694957 master-0 kubenswrapper[33142]: I1204 01:02:09.694812 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-ngp47" event={"ID":"5b8a2c13-798d-45ba-8d23-dbc76d75ede3","Type":"ContainerStarted","Data":"60988eb5c00cdc4e97ee49c7472e4cb16dd43c99592b7d8f03ee2f66d9b5b70d"} Dec 04 01:02:09.704648 master-0 kubenswrapper[33142]: I1204 01:02:09.704531 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"906b75fe-8760-47f2-af0b-44fe551598c3","Type":"ContainerStarted","Data":"5fc68312e69ac9b56d0dc101c459918ee8cb85400ba2e5c87133eef3425d509e"} Dec 04 01:02:09.707993 master-0 kubenswrapper[33142]: I1204 01:02:09.707914 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"92a89491-dea3-4ede-b420-8629c8ed34e4","Type":"ContainerStarted","Data":"7e2987a2707e98d551a0abe1ac3997ed41bbb54a12910ea85e36c9deb888b233"} Dec 04 01:02:09.711235 master-0 kubenswrapper[33142]: I1204 01:02:09.711152 33142 generic.go:334] "Generic (PLEG): container finished" podID="1093df42-0d18-468f-88e8-4476ca7f3712" containerID="ba30f455c7892e5fc51b1264df5c45629b4df22f275dc9605f02e85397d4ca4b" exitCode=0 Dec 04 01:02:09.711525 master-0 kubenswrapper[33142]: I1204 01:02:09.711265 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"1093df42-0d18-468f-88e8-4476ca7f3712","Type":"ContainerDied","Data":"ba30f455c7892e5fc51b1264df5c45629b4df22f275dc9605f02e85397d4ca4b"} Dec 04 01:02:09.719660 master-0 kubenswrapper[33142]: I1204 01:02:09.714807 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-786cl" event={"ID":"444be810-c219-4b45-af71-5a72e77d633a","Type":"ContainerStarted","Data":"bb50289429202f530f2fd5f9c1109d7273a37db5004c34b66aae0d238afada3d"} Dec 04 01:02:09.719908 master-0 kubenswrapper[33142]: I1204 01:02:09.719787 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-metrics-ngp47" podStartSLOduration=6.405736984 podStartE2EDuration="11.719759108s" podCreationTimestamp="2025-12-04 01:01:58 +0000 UTC" firstStartedPulling="2025-12-04 01:02:02.830124195 +0000 UTC m=+895.232126035" lastFinishedPulling="2025-12-04 01:02:08.144146309 +0000 UTC m=+900.546148159" observedRunningTime="2025-12-04 01:02:09.716585119 +0000 UTC m=+902.118586979" watchObservedRunningTime="2025-12-04 01:02:09.719759108 +0000 UTC m=+902.121760978" Dec 04 01:02:09.734574 master-0 kubenswrapper[33142]: I1204 01:02:09.734491 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"bab681a7-5fd3-4071-b8ba-7f07a5923507","Type":"ContainerStarted","Data":"d1b842efe72b963e6aac4e6cf4a765b1543978c299aade52b68e63936a593a5e"} Dec 04 01:02:09.795474 master-0 kubenswrapper[33142]: I1204 01:02:09.795377 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-nb-0" podStartSLOduration=21.342121529 podStartE2EDuration="35.795355058s" podCreationTimestamp="2025-12-04 01:01:34 +0000 UTC" firstStartedPulling="2025-12-04 01:01:53.713976059 +0000 UTC m=+886.115977909" lastFinishedPulling="2025-12-04 01:02:08.167209588 +0000 UTC m=+900.569211438" observedRunningTime="2025-12-04 01:02:09.77839369 +0000 UTC m=+902.180395540" watchObservedRunningTime="2025-12-04 01:02:09.795355058 +0000 UTC m=+902.197356908" Dec 04 01:02:09.830133 master-0 kubenswrapper[33142]: I1204 01:02:09.829850 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-sb-0" podStartSLOduration=18.067192572 podStartE2EDuration="32.82981659s" podCreationTimestamp="2025-12-04 01:01:37 +0000 UTC" firstStartedPulling="2025-12-04 01:01:53.404093557 +0000 UTC m=+885.806095407" lastFinishedPulling="2025-12-04 01:02:08.166717565 +0000 UTC m=+900.568719425" observedRunningTime="2025-12-04 01:02:09.814869548 +0000 UTC m=+902.216871398" watchObservedRunningTime="2025-12-04 01:02:09.82981659 +0000 UTC m=+902.231818450" Dec 04 01:02:09.872326 master-0 kubenswrapper[33142]: I1204 01:02:09.871754 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-cell1-galera-0" podStartSLOduration=32.629300857 podStartE2EDuration="41.871732141s" podCreationTimestamp="2025-12-04 01:01:28 +0000 UTC" firstStartedPulling="2025-12-04 01:01:52.19478358 +0000 UTC m=+884.596785430" lastFinishedPulling="2025-12-04 01:02:01.437214864 +0000 UTC m=+893.839216714" observedRunningTime="2025-12-04 01:02:09.860657549 +0000 UTC m=+902.262659399" watchObservedRunningTime="2025-12-04 01:02:09.871732141 +0000 UTC m=+902.273734001" Dec 04 01:02:10.748278 master-0 kubenswrapper[33142]: I1204 01:02:10.748082 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"1093df42-0d18-468f-88e8-4476ca7f3712","Type":"ContainerStarted","Data":"77246779d84eb4e5a070370e0f87a1e85ad2a5daf2e8d7127cfb73cf64e15913"} Dec 04 01:02:10.791080 master-0 kubenswrapper[33142]: I1204 01:02:10.790957 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-galera-0" podStartSLOduration=36.293891844 podStartE2EDuration="44.790898682s" podCreationTimestamp="2025-12-04 01:01:26 +0000 UTC" firstStartedPulling="2025-12-04 01:01:53.166248235 +0000 UTC m=+885.568250085" lastFinishedPulling="2025-12-04 01:02:01.663255083 +0000 UTC m=+894.065256923" observedRunningTime="2025-12-04 01:02:10.780273103 +0000 UTC m=+903.182274953" watchObservedRunningTime="2025-12-04 01:02:10.790898682 +0000 UTC m=+903.192900532" Dec 04 01:02:10.992466 master-0 kubenswrapper[33142]: I1204 01:02:10.992401 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-nb-0" Dec 04 01:02:10.992466 master-0 kubenswrapper[33142]: I1204 01:02:10.992478 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-nb-0" Dec 04 01:02:11.040216 master-0 kubenswrapper[33142]: I1204 01:02:11.040065 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-nb-0" Dec 04 01:02:11.820833 master-0 kubenswrapper[33142]: I1204 01:02:11.819782 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-nb-0" Dec 04 01:02:12.223607 master-0 kubenswrapper[33142]: I1204 01:02:12.223517 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:12.223944 master-0 kubenswrapper[33142]: E1204 01:02:12.223873 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:12.223944 master-0 kubenswrapper[33142]: E1204 01:02:12.223940 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:12.224047 master-0 kubenswrapper[33142]: E1204 01:02:12.224031 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:20.223997395 +0000 UTC m=+912.625999245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:12.281400 master-0 kubenswrapper[33142]: I1204 01:02:12.281019 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-sb-0" Dec 04 01:02:12.281400 master-0 kubenswrapper[33142]: I1204 01:02:12.281113 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-sb-0" Dec 04 01:02:12.342427 master-0 kubenswrapper[33142]: I1204 01:02:12.342365 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-sb-0" Dec 04 01:02:12.651958 master-0 kubenswrapper[33142]: I1204 01:02:12.651159 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:02:12.814239 master-0 kubenswrapper[33142]: I1204 01:02:12.814165 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-sb-0" Dec 04 01:02:13.875307 master-0 kubenswrapper[33142]: I1204 01:02:13.875132 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-galera-0" Dec 04 01:02:13.876038 master-0 kubenswrapper[33142]: I1204 01:02:13.875939 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-galera-0" Dec 04 01:02:13.968644 master-0 kubenswrapper[33142]: I1204 01:02:13.968551 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:02:13.969055 master-0 kubenswrapper[33142]: I1204 01:02:13.968890 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="dnsmasq-dns" containerID="cri-o://90b935ab03b22149784c5d749543687c768982460e8c9cb5bbbdb31e15f00deb" gracePeriod=10 Dec 04 01:02:13.970207 master-0 kubenswrapper[33142]: I1204 01:02:13.970098 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:02:14.952125 master-0 kubenswrapper[33142]: I1204 01:02:14.952047 33142 generic.go:334] "Generic (PLEG): container finished" podID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerID="90b935ab03b22149784c5d749543687c768982460e8c9cb5bbbdb31e15f00deb" exitCode=0 Dec 04 01:02:14.952789 master-0 kubenswrapper[33142]: I1204 01:02:14.952140 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" event={"ID":"17f8d1ef-d763-4010-9c1f-52b10ce84214","Type":"ContainerDied","Data":"90b935ab03b22149784c5d749543687c768982460e8c9cb5bbbdb31e15f00deb"} Dec 04 01:02:15.355087 master-0 kubenswrapper[33142]: I1204 01:02:15.354819 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:02:15.445335 master-0 kubenswrapper[33142]: I1204 01:02:15.445247 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb\") pod \"17f8d1ef-d763-4010-9c1f-52b10ce84214\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " Dec 04 01:02:15.445552 master-0 kubenswrapper[33142]: I1204 01:02:15.445537 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb\") pod \"17f8d1ef-d763-4010-9c1f-52b10ce84214\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " Dec 04 01:02:15.445831 master-0 kubenswrapper[33142]: I1204 01:02:15.445816 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config\") pod \"17f8d1ef-d763-4010-9c1f-52b10ce84214\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " Dec 04 01:02:15.445971 master-0 kubenswrapper[33142]: I1204 01:02:15.445955 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc\") pod \"17f8d1ef-d763-4010-9c1f-52b10ce84214\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " Dec 04 01:02:15.446090 master-0 kubenswrapper[33142]: I1204 01:02:15.446075 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztsrq\" (UniqueName: \"kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq\") pod \"17f8d1ef-d763-4010-9c1f-52b10ce84214\" (UID: \"17f8d1ef-d763-4010-9c1f-52b10ce84214\") " Dec 04 01:02:15.454886 master-0 kubenswrapper[33142]: I1204 01:02:15.454827 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq" (OuterVolumeSpecName: "kube-api-access-ztsrq") pod "17f8d1ef-d763-4010-9c1f-52b10ce84214" (UID: "17f8d1ef-d763-4010-9c1f-52b10ce84214"). InnerVolumeSpecName "kube-api-access-ztsrq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:15.495801 master-0 kubenswrapper[33142]: I1204 01:02:15.495639 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "17f8d1ef-d763-4010-9c1f-52b10ce84214" (UID: "17f8d1ef-d763-4010-9c1f-52b10ce84214"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:15.496977 master-0 kubenswrapper[33142]: I1204 01:02:15.496848 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "17f8d1ef-d763-4010-9c1f-52b10ce84214" (UID: "17f8d1ef-d763-4010-9c1f-52b10ce84214"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:15.504642 master-0 kubenswrapper[33142]: I1204 01:02:15.504503 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config" (OuterVolumeSpecName: "config") pod "17f8d1ef-d763-4010-9c1f-52b10ce84214" (UID: "17f8d1ef-d763-4010-9c1f-52b10ce84214"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:15.510421 master-0 kubenswrapper[33142]: I1204 01:02:15.510328 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "17f8d1ef-d763-4010-9c1f-52b10ce84214" (UID: "17f8d1ef-d763-4010-9c1f-52b10ce84214"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:15.550791 master-0 kubenswrapper[33142]: I1204 01:02:15.550723 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:15.550791 master-0 kubenswrapper[33142]: I1204 01:02:15.550777 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:15.550791 master-0 kubenswrapper[33142]: I1204 01:02:15.550790 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ztsrq\" (UniqueName: \"kubernetes.io/projected/17f8d1ef-d763-4010-9c1f-52b10ce84214-kube-api-access-ztsrq\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:15.550791 master-0 kubenswrapper[33142]: I1204 01:02:15.550801 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:15.550791 master-0 kubenswrapper[33142]: I1204 01:02:15.550811 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/17f8d1ef-d763-4010-9c1f-52b10ce84214-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:15.551777 master-0 kubenswrapper[33142]: I1204 01:02:15.551744 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-cell1-galera-0" Dec 04 01:02:15.551839 master-0 kubenswrapper[33142]: I1204 01:02:15.551795 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-cell1-galera-0" Dec 04 01:02:15.637821 master-0 kubenswrapper[33142]: I1204 01:02:15.637749 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-cell1-galera-0" Dec 04 01:02:15.967276 master-0 kubenswrapper[33142]: I1204 01:02:15.967221 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" event={"ID":"17f8d1ef-d763-4010-9c1f-52b10ce84214","Type":"ContainerDied","Data":"e16e9f72bd6e0a56975bb94ead14bc3738032df1608d002f00f596588259b9e6"} Dec 04 01:02:15.967820 master-0 kubenswrapper[33142]: I1204 01:02:15.967288 33142 scope.go:117] "RemoveContainer" containerID="90b935ab03b22149784c5d749543687c768982460e8c9cb5bbbdb31e15f00deb" Dec 04 01:02:15.967820 master-0 kubenswrapper[33142]: I1204 01:02:15.967402 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" Dec 04 01:02:15.970734 master-0 kubenswrapper[33142]: I1204 01:02:15.970669 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-786cl" event={"ID":"444be810-c219-4b45-af71-5a72e77d633a","Type":"ContainerStarted","Data":"2f07f747a14c39a6de8c6a589755afef9d3d03248a49ec3871de679c647c6e81"} Dec 04 01:02:15.991280 master-0 kubenswrapper[33142]: I1204 01:02:15.991238 33142 scope.go:117] "RemoveContainer" containerID="97cb0109392a04cce9c42db8f91aadf12281432d8cdab6fe673a68743641b763" Dec 04 01:02:16.054391 master-0 kubenswrapper[33142]: I1204 01:02:16.054213 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-cell1-galera-0" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.223553 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-northd-0"] Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: E1204 01:02:17.224728 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="dnsmasq-dns" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.224754 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="dnsmasq-dns" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: E1204 01:02:17.224878 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="init" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.224890 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="init" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.225585 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="dnsmasq-dns" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.232187 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.240093 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovnnorthd-ovndbs" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.240842 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-scripts" Dec 04 01:02:17.243843 master-0 kubenswrapper[33142]: I1204 01:02:17.241094 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-config" Dec 04 01:02:17.357791 master-0 kubenswrapper[33142]: I1204 01:02:17.357696 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Dec 04 01:02:17.433815 master-0 kubenswrapper[33142]: I1204 01:02:17.433691 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:02:17.502130 master-0 kubenswrapper[33142]: I1204 01:02:17.501853 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502130 master-0 kubenswrapper[33142]: I1204 01:02:17.501993 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-scripts\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502130 master-0 kubenswrapper[33142]: I1204 01:02:17.502080 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-config\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502130 master-0 kubenswrapper[33142]: I1204 01:02:17.502110 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502130 master-0 kubenswrapper[33142]: I1204 01:02:17.502143 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502857 master-0 kubenswrapper[33142]: I1204 01:02:17.502218 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/b76434a6-93d9-4226-ac7e-33aff78911e3-kube-api-access-qtrkw\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.502857 master-0 kubenswrapper[33142]: I1204 01:02:17.502239 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.550221 master-0 kubenswrapper[33142]: I1204 01:02:17.550137 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-57545c5d5f-k9h6k"] Dec 04 01:02:17.605587 master-0 kubenswrapper[33142]: I1204 01:02:17.605513 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.605587 master-0 kubenswrapper[33142]: I1204 01:02:17.605599 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-scripts\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.605642 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-config\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.605668 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.605701 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.605772 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/b76434a6-93d9-4226-ac7e-33aff78911e3-kube-api-access-qtrkw\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.605804 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.606550 master-0 kubenswrapper[33142]: I1204 01:02:17.606344 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.607337 master-0 kubenswrapper[33142]: I1204 01:02:17.606899 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-scripts\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.607337 master-0 kubenswrapper[33142]: I1204 01:02:17.607032 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76434a6-93d9-4226-ac7e-33aff78911e3-config\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.610368 master-0 kubenswrapper[33142]: I1204 01:02:17.610315 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.610724 master-0 kubenswrapper[33142]: I1204 01:02:17.610650 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.626194 master-0 kubenswrapper[33142]: I1204 01:02:17.626123 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b76434a6-93d9-4226-ac7e-33aff78911e3-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:17.917150 master-0 kubenswrapper[33142]: I1204 01:02:17.916237 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" path="/var/lib/kubelet/pods/17f8d1ef-d763-4010-9c1f-52b10ce84214/volumes" Dec 04 01:02:19.162593 master-0 kubenswrapper[33142]: I1204 01:02:19.162551 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrkw\" (UniqueName: \"kubernetes.io/projected/b76434a6-93d9-4226-ac7e-33aff78911e3-kube-api-access-qtrkw\") pod \"ovn-northd-0\" (UID: \"b76434a6-93d9-4226-ac7e-33aff78911e3\") " pod="openstack/ovn-northd-0" Dec 04 01:02:19.365563 master-0 kubenswrapper[33142]: I1204 01:02:19.365479 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Dec 04 01:02:19.402369 master-0 kubenswrapper[33142]: I1204 01:02:19.402214 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-ring-rebalance-786cl" podStartSLOduration=6.801105698 podStartE2EDuration="13.4021846s" podCreationTimestamp="2025-12-04 01:02:06 +0000 UTC" firstStartedPulling="2025-12-04 01:02:08.74855134 +0000 UTC m=+901.150553190" lastFinishedPulling="2025-12-04 01:02:15.349630242 +0000 UTC m=+907.751632092" observedRunningTime="2025-12-04 01:02:19.399580756 +0000 UTC m=+911.801582626" watchObservedRunningTime="2025-12-04 01:02:19.4021846 +0000 UTC m=+911.804186460" Dec 04 01:02:19.931356 master-0 kubenswrapper[33142]: I1204 01:02:19.931250 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-57545c5d5f-k9h6k" podUID="17f8d1ef-d763-4010-9c1f-52b10ce84214" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.0.193:5353: i/o timeout" Dec 04 01:02:19.956007 master-0 kubenswrapper[33142]: I1204 01:02:19.948365 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Dec 04 01:02:19.956007 master-0 kubenswrapper[33142]: W1204 01:02:19.950314 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb76434a6_93d9_4226_ac7e_33aff78911e3.slice/crio-fd89fce39b04acb1979de28aac7a251020712e90c93e92924ff02b220e2c9099 WatchSource:0}: Error finding container fd89fce39b04acb1979de28aac7a251020712e90c93e92924ff02b220e2c9099: Status 404 returned error can't find the container with id fd89fce39b04acb1979de28aac7a251020712e90c93e92924ff02b220e2c9099 Dec 04 01:02:20.018024 master-0 kubenswrapper[33142]: I1204 01:02:20.016058 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-galera-0" Dec 04 01:02:20.032343 master-0 kubenswrapper[33142]: I1204 01:02:20.032215 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"b76434a6-93d9-4226-ac7e-33aff78911e3","Type":"ContainerStarted","Data":"fd89fce39b04acb1979de28aac7a251020712e90c93e92924ff02b220e2c9099"} Dec 04 01:02:20.110551 master-0 kubenswrapper[33142]: I1204 01:02:20.110481 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-galera-0" Dec 04 01:02:20.281018 master-0 kubenswrapper[33142]: I1204 01:02:20.280903 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:20.281849 master-0 kubenswrapper[33142]: E1204 01:02:20.281142 33142 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 01:02:20.281849 master-0 kubenswrapper[33142]: E1204 01:02:20.281166 33142 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 01:02:20.281849 master-0 kubenswrapper[33142]: E1204 01:02:20.281270 33142 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift podName:96b9aff9-fcd4-4893-99cc-eebf4d97d339 nodeName:}" failed. No retries permitted until 2025-12-04 01:02:36.28122928 +0000 UTC m=+928.683231130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift") pod "swift-storage-0" (UID: "96b9aff9-fcd4-4893-99cc-eebf4d97d339") : configmap "swift-ring-files" not found Dec 04 01:02:20.440018 master-0 kubenswrapper[33142]: I1204 01:02:20.437772 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-db-create-dznzz"] Dec 04 01:02:20.440018 master-0 kubenswrapper[33142]: I1204 01:02:20.439471 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.480278 master-0 kubenswrapper[33142]: I1204 01:02:20.480202 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-3055-account-create-update-wzvdp"] Dec 04 01:02:20.489187 master-0 kubenswrapper[33142]: I1204 01:02:20.489120 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.492143 master-0 kubenswrapper[33142]: I1204 01:02:20.492079 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-db-secret" Dec 04 01:02:20.518439 master-0 kubenswrapper[33142]: I1204 01:02:20.518377 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-dznzz"] Dec 04 01:02:20.542076 master-0 kubenswrapper[33142]: I1204 01:02:20.542004 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-3055-account-create-update-wzvdp"] Dec 04 01:02:20.591477 master-0 kubenswrapper[33142]: I1204 01:02:20.591408 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.591844 master-0 kubenswrapper[33142]: I1204 01:02:20.591773 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk5hj\" (UniqueName: \"kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.591964 master-0 kubenswrapper[33142]: I1204 01:02:20.591854 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.592111 master-0 kubenswrapper[33142]: I1204 01:02:20.592079 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmbp7\" (UniqueName: \"kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.700023 master-0 kubenswrapper[33142]: I1204 01:02:20.699351 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jk5hj\" (UniqueName: \"kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.700023 master-0 kubenswrapper[33142]: I1204 01:02:20.699437 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.700023 master-0 kubenswrapper[33142]: I1204 01:02:20.699538 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dmbp7\" (UniqueName: \"kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.700023 master-0 kubenswrapper[33142]: I1204 01:02:20.699663 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.707139 master-0 kubenswrapper[33142]: I1204 01:02:20.700844 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.707139 master-0 kubenswrapper[33142]: I1204 01:02:20.705409 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.719628 master-0 kubenswrapper[33142]: I1204 01:02:20.719554 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmbp7\" (UniqueName: \"kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7\") pod \"glance-3055-account-create-update-wzvdp\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:20.720369 master-0 kubenswrapper[33142]: I1204 01:02:20.720314 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk5hj\" (UniqueName: \"kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj\") pod \"glance-db-create-dznzz\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.852031 master-0 kubenswrapper[33142]: I1204 01:02:20.851951 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-dznzz" Dec 04 01:02:20.860093 master-0 kubenswrapper[33142]: I1204 01:02:20.860024 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:21.465071 master-0 kubenswrapper[33142]: I1204 01:02:21.462769 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-dznzz"] Dec 04 01:02:21.630241 master-0 kubenswrapper[33142]: I1204 01:02:21.627051 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-3055-account-create-update-wzvdp"] Dec 04 01:02:21.641168 master-0 kubenswrapper[33142]: W1204 01:02:21.641067 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81563256_d2c5_4528_8e4f_d0aa5ed88bc7.slice/crio-20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b WatchSource:0}: Error finding container 20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b: Status 404 returned error can't find the container with id 20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b Dec 04 01:02:22.076376 master-0 kubenswrapper[33142]: I1204 01:02:22.076173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-3055-account-create-update-wzvdp" event={"ID":"81563256-d2c5-4528-8e4f-d0aa5ed88bc7","Type":"ContainerStarted","Data":"8f9f493caf985b4f4ff7f89f4036ab389e1fdfdde539c98755c5337450c5b855"} Dec 04 01:02:22.076376 master-0 kubenswrapper[33142]: I1204 01:02:22.076278 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-3055-account-create-update-wzvdp" event={"ID":"81563256-d2c5-4528-8e4f-d0aa5ed88bc7","Type":"ContainerStarted","Data":"20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b"} Dec 04 01:02:22.084364 master-0 kubenswrapper[33142]: I1204 01:02:22.084074 33142 generic.go:334] "Generic (PLEG): container finished" podID="8d803fea-abf9-409b-ba05-3859cddb9a61" containerID="d278891a9bc725a4065ecbb2f41a64daec59fbb6aaefc0db046e4f1f5889df80" exitCode=0 Dec 04 01:02:22.084364 master-0 kubenswrapper[33142]: I1204 01:02:22.084282 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-dznzz" event={"ID":"8d803fea-abf9-409b-ba05-3859cddb9a61","Type":"ContainerDied","Data":"d278891a9bc725a4065ecbb2f41a64daec59fbb6aaefc0db046e4f1f5889df80"} Dec 04 01:02:22.084364 master-0 kubenswrapper[33142]: I1204 01:02:22.084332 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-dznzz" event={"ID":"8d803fea-abf9-409b-ba05-3859cddb9a61","Type":"ContainerStarted","Data":"aad1521b08410473d857398a58ef71a963fa0e87898ed1aa1cb31b236492abdd"} Dec 04 01:02:22.088768 master-0 kubenswrapper[33142]: I1204 01:02:22.088658 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"b76434a6-93d9-4226-ac7e-33aff78911e3","Type":"ContainerStarted","Data":"10573ef136d692b60b76386bb4b3e37c18ee1800882292edc621f431e301d6b9"} Dec 04 01:02:22.088768 master-0 kubenswrapper[33142]: I1204 01:02:22.088743 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"b76434a6-93d9-4226-ac7e-33aff78911e3","Type":"ContainerStarted","Data":"2bcc0c36c4fc946011bc364536fe717cc8bbec10cb774c24758b1700c7d9faba"} Dec 04 01:02:22.090978 master-0 kubenswrapper[33142]: I1204 01:02:22.090910 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-northd-0" Dec 04 01:02:22.102115 master-0 kubenswrapper[33142]: I1204 01:02:22.101982 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-3055-account-create-update-wzvdp" podStartSLOduration=2.101899596 podStartE2EDuration="2.101899596s" podCreationTimestamp="2025-12-04 01:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:22.095243218 +0000 UTC m=+914.497245098" watchObservedRunningTime="2025-12-04 01:02:22.101899596 +0000 UTC m=+914.503901436" Dec 04 01:02:22.139756 master-0 kubenswrapper[33142]: I1204 01:02:22.139656 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-northd-0" podStartSLOduration=5.054914642 podStartE2EDuration="6.139630999s" podCreationTimestamp="2025-12-04 01:02:16 +0000 UTC" firstStartedPulling="2025-12-04 01:02:19.952471826 +0000 UTC m=+912.354473686" lastFinishedPulling="2025-12-04 01:02:21.037188143 +0000 UTC m=+913.439190043" observedRunningTime="2025-12-04 01:02:22.137964612 +0000 UTC m=+914.539966482" watchObservedRunningTime="2025-12-04 01:02:22.139630999 +0000 UTC m=+914.541632849" Dec 04 01:02:23.106230 master-0 kubenswrapper[33142]: I1204 01:02:23.106145 33142 generic.go:334] "Generic (PLEG): container finished" podID="81563256-d2c5-4528-8e4f-d0aa5ed88bc7" containerID="8f9f493caf985b4f4ff7f89f4036ab389e1fdfdde539c98755c5337450c5b855" exitCode=0 Dec 04 01:02:23.106917 master-0 kubenswrapper[33142]: I1204 01:02:23.106247 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-3055-account-create-update-wzvdp" event={"ID":"81563256-d2c5-4528-8e4f-d0aa5ed88bc7","Type":"ContainerDied","Data":"8f9f493caf985b4f4ff7f89f4036ab389e1fdfdde539c98755c5337450c5b855"} Dec 04 01:02:23.657963 master-0 kubenswrapper[33142]: I1204 01:02:23.657864 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-dznzz" Dec 04 01:02:23.738484 master-0 kubenswrapper[33142]: E1204 01:02:23.738413 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444be810_c219_4b45_af71_5a72e77d633a.slice/crio-2f07f747a14c39a6de8c6a589755afef9d3d03248a49ec3871de679c647c6e81.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444be810_c219_4b45_af71_5a72e77d633a.slice/crio-conmon-2f07f747a14c39a6de8c6a589755afef9d3d03248a49ec3871de679c647c6e81.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:02:23.812662 master-0 kubenswrapper[33142]: I1204 01:02:23.812467 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts\") pod \"8d803fea-abf9-409b-ba05-3859cddb9a61\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " Dec 04 01:02:23.812885 master-0 kubenswrapper[33142]: I1204 01:02:23.812708 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk5hj\" (UniqueName: \"kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj\") pod \"8d803fea-abf9-409b-ba05-3859cddb9a61\" (UID: \"8d803fea-abf9-409b-ba05-3859cddb9a61\") " Dec 04 01:02:23.813105 master-0 kubenswrapper[33142]: I1204 01:02:23.813041 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8d803fea-abf9-409b-ba05-3859cddb9a61" (UID: "8d803fea-abf9-409b-ba05-3859cddb9a61"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:23.813653 master-0 kubenswrapper[33142]: I1204 01:02:23.813606 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d803fea-abf9-409b-ba05-3859cddb9a61-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:23.816639 master-0 kubenswrapper[33142]: I1204 01:02:23.816523 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj" (OuterVolumeSpecName: "kube-api-access-jk5hj") pod "8d803fea-abf9-409b-ba05-3859cddb9a61" (UID: "8d803fea-abf9-409b-ba05-3859cddb9a61"). InnerVolumeSpecName "kube-api-access-jk5hj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:23.919352 master-0 kubenswrapper[33142]: I1204 01:02:23.919279 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jk5hj\" (UniqueName: \"kubernetes.io/projected/8d803fea-abf9-409b-ba05-3859cddb9a61-kube-api-access-jk5hj\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:24.126132 master-0 kubenswrapper[33142]: I1204 01:02:24.125996 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-dznzz" event={"ID":"8d803fea-abf9-409b-ba05-3859cddb9a61","Type":"ContainerDied","Data":"aad1521b08410473d857398a58ef71a963fa0e87898ed1aa1cb31b236492abdd"} Dec 04 01:02:24.126132 master-0 kubenswrapper[33142]: I1204 01:02:24.126084 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aad1521b08410473d857398a58ef71a963fa0e87898ed1aa1cb31b236492abdd" Dec 04 01:02:24.127248 master-0 kubenswrapper[33142]: I1204 01:02:24.126175 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-dznzz" Dec 04 01:02:24.129549 master-0 kubenswrapper[33142]: I1204 01:02:24.129453 33142 generic.go:334] "Generic (PLEG): container finished" podID="444be810-c219-4b45-af71-5a72e77d633a" containerID="2f07f747a14c39a6de8c6a589755afef9d3d03248a49ec3871de679c647c6e81" exitCode=0 Dec 04 01:02:24.129738 master-0 kubenswrapper[33142]: I1204 01:02:24.129551 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-786cl" event={"ID":"444be810-c219-4b45-af71-5a72e77d633a","Type":"ContainerDied","Data":"2f07f747a14c39a6de8c6a589755afef9d3d03248a49ec3871de679c647c6e81"} Dec 04 01:02:24.596090 master-0 kubenswrapper[33142]: I1204 01:02:24.595991 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:24.737914 master-0 kubenswrapper[33142]: I1204 01:02:24.737754 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts\") pod \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " Dec 04 01:02:24.737914 master-0 kubenswrapper[33142]: I1204 01:02:24.737829 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmbp7\" (UniqueName: \"kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7\") pod \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\" (UID: \"81563256-d2c5-4528-8e4f-d0aa5ed88bc7\") " Dec 04 01:02:24.738278 master-0 kubenswrapper[33142]: I1204 01:02:24.738239 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "81563256-d2c5-4528-8e4f-d0aa5ed88bc7" (UID: "81563256-d2c5-4528-8e4f-d0aa5ed88bc7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:24.738678 master-0 kubenswrapper[33142]: I1204 01:02:24.738642 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:24.741485 master-0 kubenswrapper[33142]: I1204 01:02:24.741386 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7" (OuterVolumeSpecName: "kube-api-access-dmbp7") pod "81563256-d2c5-4528-8e4f-d0aa5ed88bc7" (UID: "81563256-d2c5-4528-8e4f-d0aa5ed88bc7"). InnerVolumeSpecName "kube-api-access-dmbp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:24.841731 master-0 kubenswrapper[33142]: I1204 01:02:24.841598 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dmbp7\" (UniqueName: \"kubernetes.io/projected/81563256-d2c5-4528-8e4f-d0aa5ed88bc7-kube-api-access-dmbp7\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.145068 master-0 kubenswrapper[33142]: I1204 01:02:25.144976 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-3055-account-create-update-wzvdp" event={"ID":"81563256-d2c5-4528-8e4f-d0aa5ed88bc7","Type":"ContainerDied","Data":"20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b"} Dec 04 01:02:25.145068 master-0 kubenswrapper[33142]: I1204 01:02:25.145054 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-3055-account-create-update-wzvdp" Dec 04 01:02:25.145866 master-0 kubenswrapper[33142]: I1204 01:02:25.145064 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20dbadd37d28e002a223adf881a7f9ebc0de0b6af658cb98b443514b1af5df1b" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.600143 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-db-sync-lflzk"] Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: E1204 01:02:25.600747 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d803fea-abf9-409b-ba05-3859cddb9a61" containerName="mariadb-database-create" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.600768 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d803fea-abf9-409b-ba05-3859cddb9a61" containerName="mariadb-database-create" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: E1204 01:02:25.600991 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81563256-d2c5-4528-8e4f-d0aa5ed88bc7" containerName="mariadb-account-create-update" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.601006 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81563256-d2c5-4528-8e4f-d0aa5ed88bc7" containerName="mariadb-account-create-update" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.601454 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="81563256-d2c5-4528-8e4f-d0aa5ed88bc7" containerName="mariadb-account-create-update" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.601533 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d803fea-abf9-409b-ba05-3859cddb9a61" containerName="mariadb-database-create" Dec 04 01:02:25.603788 master-0 kubenswrapper[33142]: I1204 01:02:25.602419 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.604998 master-0 kubenswrapper[33142]: I1204 01:02:25.604836 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-config-data" Dec 04 01:02:25.621133 master-0 kubenswrapper[33142]: I1204 01:02:25.619619 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-sync-lflzk"] Dec 04 01:02:25.649839 master-0 kubenswrapper[33142]: I1204 01:02:25.649782 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:25.763873 master-0 kubenswrapper[33142]: I1204 01:02:25.763723 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.764440 master-0 kubenswrapper[33142]: I1204 01:02:25.764412 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.764675 master-0 kubenswrapper[33142]: I1204 01:02:25.764654 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgbcw\" (UniqueName: \"kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.764915 master-0 kubenswrapper[33142]: I1204 01:02:25.764897 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.765407 master-0 kubenswrapper[33142]: I1204 01:02:25.765383 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.765722 master-0 kubenswrapper[33142]: I1204 01:02:25.765696 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.766054 master-0 kubenswrapper[33142]: I1204 01:02:25.766028 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices\") pod \"444be810-c219-4b45-af71-5a72e77d633a\" (UID: \"444be810-c219-4b45-af71-5a72e77d633a\") " Dec 04 01:02:25.766635 master-0 kubenswrapper[33142]: I1204 01:02:25.766553 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:25.766948 master-0 kubenswrapper[33142]: I1204 01:02:25.766887 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.767135 master-0 kubenswrapper[33142]: I1204 01:02:25.767109 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.767450 master-0 kubenswrapper[33142]: I1204 01:02:25.767427 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwpfm\" (UniqueName: \"kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.767685 master-0 kubenswrapper[33142]: I1204 01:02:25.766887 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:02:25.768088 master-0 kubenswrapper[33142]: I1204 01:02:25.768041 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw" (OuterVolumeSpecName: "kube-api-access-hgbcw") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "kube-api-access-hgbcw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:25.768282 master-0 kubenswrapper[33142]: I1204 01:02:25.768247 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.768544 master-0 kubenswrapper[33142]: I1204 01:02:25.768517 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hgbcw\" (UniqueName: \"kubernetes.io/projected/444be810-c219-4b45-af71-5a72e77d633a-kube-api-access-hgbcw\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.768675 master-0 kubenswrapper[33142]: I1204 01:02:25.768654 33142 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/444be810-c219-4b45-af71-5a72e77d633a-etc-swift\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.768803 master-0 kubenswrapper[33142]: I1204 01:02:25.768782 33142 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-ring-data-devices\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.772493 master-0 kubenswrapper[33142]: I1204 01:02:25.772448 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:25.792055 master-0 kubenswrapper[33142]: I1204 01:02:25.791998 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:25.792372 master-0 kubenswrapper[33142]: I1204 01:02:25.792267 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts" (OuterVolumeSpecName: "scripts") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:25.794292 master-0 kubenswrapper[33142]: I1204 01:02:25.794248 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "444be810-c219-4b45-af71-5a72e77d633a" (UID: "444be810-c219-4b45-af71-5a72e77d633a"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:25.871009 master-0 kubenswrapper[33142]: I1204 01:02:25.870899 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.871268 master-0 kubenswrapper[33142]: I1204 01:02:25.871092 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.871268 master-0 kubenswrapper[33142]: I1204 01:02:25.871128 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.871268 master-0 kubenswrapper[33142]: I1204 01:02:25.871172 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wwpfm\" (UniqueName: \"kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.871416 master-0 kubenswrapper[33142]: I1204 01:02:25.871273 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/444be810-c219-4b45-af71-5a72e77d633a-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.871416 master-0 kubenswrapper[33142]: I1204 01:02:25.871291 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.871416 master-0 kubenswrapper[33142]: I1204 01:02:25.871307 33142 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-swiftconf\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.871416 master-0 kubenswrapper[33142]: I1204 01:02:25.871324 33142 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/444be810-c219-4b45-af71-5a72e77d633a-dispersionconf\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:25.888455 master-0 kubenswrapper[33142]: I1204 01:02:25.887946 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.897264 master-0 kubenswrapper[33142]: I1204 01:02:25.895910 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwpfm\" (UniqueName: \"kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.901724 master-0 kubenswrapper[33142]: I1204 01:02:25.901430 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.903541 master-0 kubenswrapper[33142]: I1204 01:02:25.903497 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle\") pod \"glance-db-sync-lflzk\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:25.970227 master-0 kubenswrapper[33142]: I1204 01:02:25.970160 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:26.162331 master-0 kubenswrapper[33142]: I1204 01:02:26.162261 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-786cl" event={"ID":"444be810-c219-4b45-af71-5a72e77d633a","Type":"ContainerDied","Data":"bb50289429202f530f2fd5f9c1109d7273a37db5004c34b66aae0d238afada3d"} Dec 04 01:02:26.162331 master-0 kubenswrapper[33142]: I1204 01:02:26.162321 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb50289429202f530f2fd5f9c1109d7273a37db5004c34b66aae0d238afada3d" Dec 04 01:02:26.162889 master-0 kubenswrapper[33142]: I1204 01:02:26.162374 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-786cl" Dec 04 01:02:26.631343 master-0 kubenswrapper[33142]: I1204 01:02:26.631241 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-sync-lflzk"] Dec 04 01:02:27.177100 master-0 kubenswrapper[33142]: I1204 01:02:27.177021 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-lflzk" event={"ID":"45d14747-33b8-47fd-b63c-25f4982d6308","Type":"ContainerStarted","Data":"f2de8b67601179a1496d3be805ea83943ed504d703693dea9a8198cf08f69198"} Dec 04 01:02:28.194424 master-0 kubenswrapper[33142]: I1204 01:02:28.194342 33142 generic.go:334] "Generic (PLEG): container finished" podID="c7fe0d53-7d39-4272-add3-ad3cc75b82d7" containerID="ee70f5fbc0b571e712cc35f6320a54bd82af7da2811371c40a3208b32330ad33" exitCode=0 Dec 04 01:02:28.194424 master-0 kubenswrapper[33142]: I1204 01:02:28.194423 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"c7fe0d53-7d39-4272-add3-ad3cc75b82d7","Type":"ContainerDied","Data":"ee70f5fbc0b571e712cc35f6320a54bd82af7da2811371c40a3208b32330ad33"} Dec 04 01:02:29.208608 master-0 kubenswrapper[33142]: I1204 01:02:29.208526 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"c7fe0d53-7d39-4272-add3-ad3cc75b82d7","Type":"ContainerStarted","Data":"e0cc57d0a59ef3513f5a512bf252806fcf22f051d9463a55f37f466a868013db"} Dec 04 01:02:29.209292 master-0 kubenswrapper[33142]: I1204 01:02:29.208979 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:02:29.240126 master-0 kubenswrapper[33142]: I1204 01:02:29.239998 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-cell1-server-0" podStartSLOduration=64.239966729 podStartE2EDuration="1m4.239966729s" podCreationTimestamp="2025-12-04 01:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:29.235142933 +0000 UTC m=+921.637144783" watchObservedRunningTime="2025-12-04 01:02:29.239966729 +0000 UTC m=+921.641968589" Dec 04 01:02:29.892097 master-0 kubenswrapper[33142]: I1204 01:02:29.892010 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-db-create-58skt"] Dec 04 01:02:29.892606 master-0 kubenswrapper[33142]: E1204 01:02:29.892573 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="444be810-c219-4b45-af71-5a72e77d633a" containerName="swift-ring-rebalance" Dec 04 01:02:29.892606 master-0 kubenswrapper[33142]: I1204 01:02:29.892602 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="444be810-c219-4b45-af71-5a72e77d633a" containerName="swift-ring-rebalance" Dec 04 01:02:29.893110 master-0 kubenswrapper[33142]: I1204 01:02:29.893055 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="444be810-c219-4b45-af71-5a72e77d633a" containerName="swift-ring-rebalance" Dec 04 01:02:29.894201 master-0 kubenswrapper[33142]: I1204 01:02:29.894160 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-58skt" Dec 04 01:02:29.905022 master-0 kubenswrapper[33142]: I1204 01:02:29.904951 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-58skt"] Dec 04 01:02:29.974832 master-0 kubenswrapper[33142]: I1204 01:02:29.974758 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-e4ec-account-create-update-dp9v4"] Dec 04 01:02:29.977645 master-0 kubenswrapper[33142]: I1204 01:02:29.977609 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:29.982633 master-0 kubenswrapper[33142]: I1204 01:02:29.982394 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-db-secret" Dec 04 01:02:30.000494 master-0 kubenswrapper[33142]: I1204 01:02:30.000440 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-e4ec-account-create-update-dp9v4"] Dec 04 01:02:30.083007 master-0 kubenswrapper[33142]: I1204 01:02:30.082417 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-db-create-25l22"] Dec 04 01:02:30.083278 master-0 kubenswrapper[33142]: I1204 01:02:30.083084 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.083278 master-0 kubenswrapper[33142]: I1204 01:02:30.083137 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.083278 master-0 kubenswrapper[33142]: I1204 01:02:30.083245 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vbp\" (UniqueName: \"kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.083434 master-0 kubenswrapper[33142]: I1204 01:02:30.083330 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2cm\" (UniqueName: \"kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.083875 master-0 kubenswrapper[33142]: I1204 01:02:30.083835 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.099892 master-0 kubenswrapper[33142]: I1204 01:02:30.099822 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-25l22"] Dec 04 01:02:30.186490 master-0 kubenswrapper[33142]: I1204 01:02:30.186407 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vbp\" (UniqueName: \"kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.186490 master-0 kubenswrapper[33142]: I1204 01:02:30.186501 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbnj6\" (UniqueName: \"kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.186800 master-0 kubenswrapper[33142]: I1204 01:02:30.186568 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-df2cm\" (UniqueName: \"kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.186800 master-0 kubenswrapper[33142]: I1204 01:02:30.186646 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.186800 master-0 kubenswrapper[33142]: I1204 01:02:30.186697 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.186800 master-0 kubenswrapper[33142]: I1204 01:02:30.186714 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.187677 master-0 kubenswrapper[33142]: I1204 01:02:30.187642 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.191593 master-0 kubenswrapper[33142]: I1204 01:02:30.191551 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.197013 master-0 kubenswrapper[33142]: I1204 01:02:30.196648 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-5b74-account-create-update-jdwpk"] Dec 04 01:02:30.200097 master-0 kubenswrapper[33142]: I1204 01:02:30.198658 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.205400 master-0 kubenswrapper[33142]: I1204 01:02:30.205362 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vbp\" (UniqueName: \"kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp\") pod \"keystone-e4ec-account-create-update-dp9v4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.205682 master-0 kubenswrapper[33142]: I1204 01:02:30.205657 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-db-secret" Dec 04 01:02:30.209259 master-0 kubenswrapper[33142]: I1204 01:02:30.209230 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2cm\" (UniqueName: \"kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm\") pod \"keystone-db-create-58skt\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.212452 master-0 kubenswrapper[33142]: I1204 01:02:30.212396 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-5b74-account-create-update-jdwpk"] Dec 04 01:02:30.231506 master-0 kubenswrapper[33142]: I1204 01:02:30.231437 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-58skt" Dec 04 01:02:30.231810 master-0 kubenswrapper[33142]: I1204 01:02:30.231745 33142 generic.go:334] "Generic (PLEG): container finished" podID="fba01013-8dd9-433e-8c42-887c0423c58f" containerID="cc5c6fd403a2b915741e4253d796829fa0e4346a5d7e0a8635247e930b69d763" exitCode=0 Dec 04 01:02:30.231895 master-0 kubenswrapper[33142]: I1204 01:02:30.231843 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"fba01013-8dd9-433e-8c42-887c0423c58f","Type":"ContainerDied","Data":"cc5c6fd403a2b915741e4253d796829fa0e4346a5d7e0a8635247e930b69d763"} Dec 04 01:02:30.288541 master-0 kubenswrapper[33142]: I1204 01:02:30.288481 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.288667 master-0 kubenswrapper[33142]: I1204 01:02:30.288557 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xffmv\" (UniqueName: \"kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.288667 master-0 kubenswrapper[33142]: I1204 01:02:30.288602 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.288730 master-0 kubenswrapper[33142]: I1204 01:02:30.288680 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qbnj6\" (UniqueName: \"kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.289732 master-0 kubenswrapper[33142]: I1204 01:02:30.289664 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.307491 master-0 kubenswrapper[33142]: I1204 01:02:30.307396 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbnj6\" (UniqueName: \"kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6\") pod \"placement-db-create-25l22\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.327256 master-0 kubenswrapper[33142]: I1204 01:02:30.327182 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:30.393979 master-0 kubenswrapper[33142]: I1204 01:02:30.391110 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xffmv\" (UniqueName: \"kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.393979 master-0 kubenswrapper[33142]: I1204 01:02:30.391213 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.394251 master-0 kubenswrapper[33142]: I1204 01:02:30.394071 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.409302 master-0 kubenswrapper[33142]: I1204 01:02:30.409239 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xffmv\" (UniqueName: \"kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv\") pod \"placement-5b74-account-create-update-jdwpk\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.479884 master-0 kubenswrapper[33142]: I1204 01:02:30.479761 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-25l22" Dec 04 01:02:30.515550 master-0 kubenswrapper[33142]: I1204 01:02:30.515402 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:30.986475 master-0 kubenswrapper[33142]: W1204 01:02:30.986367 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6b31b9a_5aa5_475d_a093_86ae2ce98694.slice/crio-cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731 WatchSource:0}: Error finding container cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731: Status 404 returned error can't find the container with id cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731 Dec 04 01:02:30.988687 master-0 kubenswrapper[33142]: I1204 01:02:30.987480 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-58skt"] Dec 04 01:02:31.029203 master-0 kubenswrapper[33142]: I1204 01:02:31.029088 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-e4ec-account-create-update-dp9v4"] Dec 04 01:02:31.226967 master-0 kubenswrapper[33142]: I1204 01:02:31.225885 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-25l22"] Dec 04 01:02:31.256066 master-0 kubenswrapper[33142]: W1204 01:02:31.255747 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57b2062a_68af_4067_861b_fc33151f7a10.slice/crio-e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec WatchSource:0}: Error finding container e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec: Status 404 returned error can't find the container with id e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec Dec 04 01:02:31.267247 master-0 kubenswrapper[33142]: I1204 01:02:31.267200 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-e4ec-account-create-update-dp9v4" event={"ID":"2c316750-7605-4e15-8a2b-ffb9877de6e4","Type":"ContainerStarted","Data":"551cb95ebde03164961a61113c443e756d4ee554cf5fede29b4cf54be4be1619"} Dec 04 01:02:31.271988 master-0 kubenswrapper[33142]: I1204 01:02:31.271898 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"fba01013-8dd9-433e-8c42-887c0423c58f","Type":"ContainerStarted","Data":"43d3a5817c15b62d4aa0a30971b8949c250843ed402c86c92f40035567d0a78b"} Dec 04 01:02:31.272243 master-0 kubenswrapper[33142]: I1204 01:02:31.272192 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-server-0" Dec 04 01:02:31.277215 master-0 kubenswrapper[33142]: I1204 01:02:31.277176 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-58skt" event={"ID":"f6b31b9a-5aa5-475d-a093-86ae2ce98694","Type":"ContainerStarted","Data":"cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731"} Dec 04 01:02:31.329320 master-0 kubenswrapper[33142]: I1204 01:02:31.328760 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-server-0" podStartSLOduration=46.625982402 podStartE2EDuration="1m6.328730418s" podCreationTimestamp="2025-12-04 01:01:25 +0000 UTC" firstStartedPulling="2025-12-04 01:01:32.627442729 +0000 UTC m=+865.029444579" lastFinishedPulling="2025-12-04 01:01:52.330190745 +0000 UTC m=+884.732192595" observedRunningTime="2025-12-04 01:02:31.313361795 +0000 UTC m=+923.715363655" watchObservedRunningTime="2025-12-04 01:02:31.328730418 +0000 UTC m=+923.730732278" Dec 04 01:02:31.347452 master-0 kubenswrapper[33142]: I1204 01:02:31.344464 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-5b74-account-create-update-jdwpk"] Dec 04 01:02:32.324696 master-0 kubenswrapper[33142]: I1204 01:02:32.324529 33142 generic.go:334] "Generic (PLEG): container finished" podID="f6b31b9a-5aa5-475d-a093-86ae2ce98694" containerID="4ac38acd5edb6d343da73dd6cd6d8e23942fe2f84cbc2ba06a600e56a448014f" exitCode=0 Dec 04 01:02:32.325335 master-0 kubenswrapper[33142]: I1204 01:02:32.324619 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-58skt" event={"ID":"f6b31b9a-5aa5-475d-a093-86ae2ce98694","Type":"ContainerDied","Data":"4ac38acd5edb6d343da73dd6cd6d8e23942fe2f84cbc2ba06a600e56a448014f"} Dec 04 01:02:32.329284 master-0 kubenswrapper[33142]: I1204 01:02:32.329207 33142 generic.go:334] "Generic (PLEG): container finished" podID="2c316750-7605-4e15-8a2b-ffb9877de6e4" containerID="a64601a695eec1270bb2fc37480e88cec18c1cfaf5569cdc2b9cb5869f6bd66f" exitCode=0 Dec 04 01:02:32.329449 master-0 kubenswrapper[33142]: I1204 01:02:32.329335 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-e4ec-account-create-update-dp9v4" event={"ID":"2c316750-7605-4e15-8a2b-ffb9877de6e4","Type":"ContainerDied","Data":"a64601a695eec1270bb2fc37480e88cec18c1cfaf5569cdc2b9cb5869f6bd66f"} Dec 04 01:02:32.331412 master-0 kubenswrapper[33142]: I1204 01:02:32.331361 33142 generic.go:334] "Generic (PLEG): container finished" podID="57b2062a-68af-4067-861b-fc33151f7a10" containerID="ffb444dab5c1bd9f0e45fa9dcc12924c1271914e6b6a488955d04092508278fe" exitCode=0 Dec 04 01:02:32.331502 master-0 kubenswrapper[33142]: I1204 01:02:32.331471 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-25l22" event={"ID":"57b2062a-68af-4067-861b-fc33151f7a10","Type":"ContainerDied","Data":"ffb444dab5c1bd9f0e45fa9dcc12924c1271914e6b6a488955d04092508278fe"} Dec 04 01:02:32.331542 master-0 kubenswrapper[33142]: I1204 01:02:32.331498 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-25l22" event={"ID":"57b2062a-68af-4067-861b-fc33151f7a10","Type":"ContainerStarted","Data":"e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec"} Dec 04 01:02:32.333537 master-0 kubenswrapper[33142]: I1204 01:02:32.333501 33142 generic.go:334] "Generic (PLEG): container finished" podID="1184467a-cc92-43c0-81d8-43f3c56d3760" containerID="089fc0fb72d14986e2b5656005f959fb02ef2ea610c1ec2b57fb37911312627b" exitCode=0 Dec 04 01:02:32.334401 master-0 kubenswrapper[33142]: I1204 01:02:32.334344 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5b74-account-create-update-jdwpk" event={"ID":"1184467a-cc92-43c0-81d8-43f3c56d3760","Type":"ContainerDied","Data":"089fc0fb72d14986e2b5656005f959fb02ef2ea610c1ec2b57fb37911312627b"} Dec 04 01:02:32.334446 master-0 kubenswrapper[33142]: I1204 01:02:32.334411 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5b74-account-create-update-jdwpk" event={"ID":"1184467a-cc92-43c0-81d8-43f3c56d3760","Type":"ContainerStarted","Data":"04fe62ffbd8e24cb05fe3016e76791889abe0edc3848a66e34d48b926f378b0c"} Dec 04 01:02:33.381243 master-0 kubenswrapper[33142]: I1204 01:02:33.381138 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-b4m9d" podUID="bf7dac9a-11f8-42a9-90f8-51eb463e30a9" containerName="ovn-controller" probeResult="failure" output=< Dec 04 01:02:33.381243 master-0 kubenswrapper[33142]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Dec 04 01:02:33.381243 master-0 kubenswrapper[33142]: > Dec 04 01:02:34.430907 master-0 kubenswrapper[33142]: I1204 01:02:34.430837 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-northd-0" Dec 04 01:02:36.354299 master-0 kubenswrapper[33142]: I1204 01:02:36.354209 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:36.359018 master-0 kubenswrapper[33142]: I1204 01:02:36.358957 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96b9aff9-fcd4-4893-99cc-eebf4d97d339-etc-swift\") pod \"swift-storage-0\" (UID: \"96b9aff9-fcd4-4893-99cc-eebf4d97d339\") " pod="openstack/swift-storage-0" Dec 04 01:02:36.553148 master-0 kubenswrapper[33142]: I1204 01:02:36.553082 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Dec 04 01:02:38.389099 master-0 kubenswrapper[33142]: I1204 01:02:38.388988 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-b4m9d" podUID="bf7dac9a-11f8-42a9-90f8-51eb463e30a9" containerName="ovn-controller" probeResult="failure" output=< Dec 04 01:02:38.389099 master-0 kubenswrapper[33142]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Dec 04 01:02:38.389099 master-0 kubenswrapper[33142]: > Dec 04 01:02:38.402325 master-0 kubenswrapper[33142]: I1204 01:02:38.402199 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:02:38.407037 master-0 kubenswrapper[33142]: I1204 01:02:38.406637 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-q8gcl" Dec 04 01:02:38.676535 master-0 kubenswrapper[33142]: I1204 01:02:38.676373 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-b4m9d-config-cjfp8"] Dec 04 01:02:38.678173 master-0 kubenswrapper[33142]: I1204 01:02:38.678146 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.680233 master-0 kubenswrapper[33142]: I1204 01:02:38.680178 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-extra-scripts" Dec 04 01:02:38.690430 master-0 kubenswrapper[33142]: I1204 01:02:38.690343 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d-config-cjfp8"] Dec 04 01:02:38.836405 master-0 kubenswrapper[33142]: I1204 01:02:38.836317 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccck\" (UniqueName: \"kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.836652 master-0 kubenswrapper[33142]: I1204 01:02:38.836424 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.836652 master-0 kubenswrapper[33142]: I1204 01:02:38.836483 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.836652 master-0 kubenswrapper[33142]: I1204 01:02:38.836549 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.836652 master-0 kubenswrapper[33142]: I1204 01:02:38.836634 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.836779 master-0 kubenswrapper[33142]: I1204 01:02:38.836662 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939010 master-0 kubenswrapper[33142]: I1204 01:02:38.938861 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939010 master-0 kubenswrapper[33142]: I1204 01:02:38.938941 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939010 master-0 kubenswrapper[33142]: I1204 01:02:38.938990 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sccck\" (UniqueName: \"kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939391 master-0 kubenswrapper[33142]: I1204 01:02:38.939036 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939391 master-0 kubenswrapper[33142]: I1204 01:02:38.939076 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939391 master-0 kubenswrapper[33142]: I1204 01:02:38.939082 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939391 master-0 kubenswrapper[33142]: I1204 01:02:38.939123 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939391 master-0 kubenswrapper[33142]: I1204 01:02:38.939222 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.939612 master-0 kubenswrapper[33142]: I1204 01:02:38.939406 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.941437 master-0 kubenswrapper[33142]: I1204 01:02:38.941410 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:38.943530 master-0 kubenswrapper[33142]: I1204 01:02:38.943445 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:39.671473 master-0 kubenswrapper[33142]: I1204 01:02:39.671153 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccck\" (UniqueName: \"kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck\") pod \"ovn-controller-b4m9d-config-cjfp8\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:39.914019 master-0 kubenswrapper[33142]: I1204 01:02:39.913957 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:39.925534 master-0 kubenswrapper[33142]: I1204 01:02:39.925418 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:39.973643 master-0 kubenswrapper[33142]: I1204 01:02:39.973551 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:39.985096 master-0 kubenswrapper[33142]: I1204 01:02:39.983986 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-58skt" Dec 04 01:02:40.011826 master-0 kubenswrapper[33142]: I1204 01:02:40.011498 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-25l22" Dec 04 01:02:40.073304 master-0 kubenswrapper[33142]: I1204 01:02:40.073112 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts\") pod \"2c316750-7605-4e15-8a2b-ffb9877de6e4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " Dec 04 01:02:40.073550 master-0 kubenswrapper[33142]: I1204 01:02:40.073368 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8vbp\" (UniqueName: \"kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp\") pod \"2c316750-7605-4e15-8a2b-ffb9877de6e4\" (UID: \"2c316750-7605-4e15-8a2b-ffb9877de6e4\") " Dec 04 01:02:40.073550 master-0 kubenswrapper[33142]: I1204 01:02:40.073422 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts\") pod \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " Dec 04 01:02:40.073550 master-0 kubenswrapper[33142]: I1204 01:02:40.073460 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts\") pod \"1184467a-cc92-43c0-81d8-43f3c56d3760\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " Dec 04 01:02:40.073550 master-0 kubenswrapper[33142]: I1204 01:02:40.073505 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df2cm\" (UniqueName: \"kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm\") pod \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\" (UID: \"f6b31b9a-5aa5-475d-a093-86ae2ce98694\") " Dec 04 01:02:40.073743 master-0 kubenswrapper[33142]: I1204 01:02:40.073588 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xffmv\" (UniqueName: \"kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv\") pod \"1184467a-cc92-43c0-81d8-43f3c56d3760\" (UID: \"1184467a-cc92-43c0-81d8-43f3c56d3760\") " Dec 04 01:02:40.076641 master-0 kubenswrapper[33142]: I1204 01:02:40.076543 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2c316750-7605-4e15-8a2b-ffb9877de6e4" (UID: "2c316750-7605-4e15-8a2b-ffb9877de6e4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:40.076641 master-0 kubenswrapper[33142]: I1204 01:02:40.076570 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1184467a-cc92-43c0-81d8-43f3c56d3760" (UID: "1184467a-cc92-43c0-81d8-43f3c56d3760"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:40.077517 master-0 kubenswrapper[33142]: I1204 01:02:40.077475 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f6b31b9a-5aa5-475d-a093-86ae2ce98694" (UID: "f6b31b9a-5aa5-475d-a093-86ae2ce98694"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:40.077643 master-0 kubenswrapper[33142]: I1204 01:02:40.077563 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv" (OuterVolumeSpecName: "kube-api-access-xffmv") pod "1184467a-cc92-43c0-81d8-43f3c56d3760" (UID: "1184467a-cc92-43c0-81d8-43f3c56d3760"). InnerVolumeSpecName "kube-api-access-xffmv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:40.080218 master-0 kubenswrapper[33142]: I1204 01:02:40.080095 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp" (OuterVolumeSpecName: "kube-api-access-f8vbp") pod "2c316750-7605-4e15-8a2b-ffb9877de6e4" (UID: "2c316750-7605-4e15-8a2b-ffb9877de6e4"). InnerVolumeSpecName "kube-api-access-f8vbp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:40.081849 master-0 kubenswrapper[33142]: I1204 01:02:40.081798 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm" (OuterVolumeSpecName: "kube-api-access-df2cm") pod "f6b31b9a-5aa5-475d-a093-86ae2ce98694" (UID: "f6b31b9a-5aa5-475d-a093-86ae2ce98694"). InnerVolumeSpecName "kube-api-access-df2cm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:40.175324 master-0 kubenswrapper[33142]: I1204 01:02:40.175271 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbnj6\" (UniqueName: \"kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6\") pod \"57b2062a-68af-4067-861b-fc33151f7a10\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " Dec 04 01:02:40.175597 master-0 kubenswrapper[33142]: I1204 01:02:40.175515 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts\") pod \"57b2062a-68af-4067-861b-fc33151f7a10\" (UID: \"57b2062a-68af-4067-861b-fc33151f7a10\") " Dec 04 01:02:40.176157 master-0 kubenswrapper[33142]: I1204 01:02:40.176097 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "57b2062a-68af-4067-861b-fc33151f7a10" (UID: "57b2062a-68af-4067-861b-fc33151f7a10"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176127 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xffmv\" (UniqueName: \"kubernetes.io/projected/1184467a-cc92-43c0-81d8-43f3c56d3760-kube-api-access-xffmv\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176201 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c316750-7605-4e15-8a2b-ffb9877de6e4-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176216 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f8vbp\" (UniqueName: \"kubernetes.io/projected/2c316750-7605-4e15-8a2b-ffb9877de6e4-kube-api-access-f8vbp\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176226 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f6b31b9a-5aa5-475d-a093-86ae2ce98694-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176238 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1184467a-cc92-43c0-81d8-43f3c56d3760-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.176245 master-0 kubenswrapper[33142]: I1204 01:02:40.176248 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-df2cm\" (UniqueName: \"kubernetes.io/projected/f6b31b9a-5aa5-475d-a093-86ae2ce98694-kube-api-access-df2cm\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.182023 master-0 kubenswrapper[33142]: I1204 01:02:40.181735 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6" (OuterVolumeSpecName: "kube-api-access-qbnj6") pod "57b2062a-68af-4067-861b-fc33151f7a10" (UID: "57b2062a-68af-4067-861b-fc33151f7a10"). InnerVolumeSpecName "kube-api-access-qbnj6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:40.308012 master-0 kubenswrapper[33142]: I1204 01:02:40.307544 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57b2062a-68af-4067-861b-fc33151f7a10-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.308012 master-0 kubenswrapper[33142]: I1204 01:02:40.307598 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qbnj6\" (UniqueName: \"kubernetes.io/projected/57b2062a-68af-4067-861b-fc33151f7a10-kube-api-access-qbnj6\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:40.375699 master-0 kubenswrapper[33142]: I1204 01:02:40.375621 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Dec 04 01:02:40.376239 master-0 kubenswrapper[33142]: W1204 01:02:40.376201 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96b9aff9_fcd4_4893_99cc_eebf4d97d339.slice/crio-1b13c7c9bd292be0f2589c96fa37236804d2f60b40a1ea3d5b554b909607883c WatchSource:0}: Error finding container 1b13c7c9bd292be0f2589c96fa37236804d2f60b40a1ea3d5b554b909607883c: Status 404 returned error can't find the container with id 1b13c7c9bd292be0f2589c96fa37236804d2f60b40a1ea3d5b554b909607883c Dec 04 01:02:40.438446 master-0 kubenswrapper[33142]: I1204 01:02:40.438345 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d-config-cjfp8"] Dec 04 01:02:40.455513 master-0 kubenswrapper[33142]: I1204 01:02:40.455451 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-58skt" event={"ID":"f6b31b9a-5aa5-475d-a093-86ae2ce98694","Type":"ContainerDied","Data":"cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731"} Dec 04 01:02:40.455619 master-0 kubenswrapper[33142]: I1204 01:02:40.455535 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd26e0f12fbe73004b4d6e567a8482961ad7aa616dda1308dd57e8411f0de731" Dec 04 01:02:40.455619 master-0 kubenswrapper[33142]: I1204 01:02:40.455493 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-58skt" Dec 04 01:02:40.459717 master-0 kubenswrapper[33142]: I1204 01:02:40.458723 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-e4ec-account-create-update-dp9v4" event={"ID":"2c316750-7605-4e15-8a2b-ffb9877de6e4","Type":"ContainerDied","Data":"551cb95ebde03164961a61113c443e756d4ee554cf5fede29b4cf54be4be1619"} Dec 04 01:02:40.459717 master-0 kubenswrapper[33142]: I1204 01:02:40.458769 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-e4ec-account-create-update-dp9v4" Dec 04 01:02:40.459717 master-0 kubenswrapper[33142]: I1204 01:02:40.458776 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="551cb95ebde03164961a61113c443e756d4ee554cf5fede29b4cf54be4be1619" Dec 04 01:02:40.460331 master-0 kubenswrapper[33142]: I1204 01:02:40.460180 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"1b13c7c9bd292be0f2589c96fa37236804d2f60b40a1ea3d5b554b909607883c"} Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.463303 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-25l22" event={"ID":"57b2062a-68af-4067-861b-fc33151f7a10","Type":"ContainerDied","Data":"e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec"} Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.463340 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e806e6916c9e8cdbdc3e846a3d88bc02490a0dabef3ad0ba5c5fcb824543a2ec" Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.463390 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-25l22" Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.465544 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5b74-account-create-update-jdwpk" event={"ID":"1184467a-cc92-43c0-81d8-43f3c56d3760","Type":"ContainerDied","Data":"04fe62ffbd8e24cb05fe3016e76791889abe0edc3848a66e34d48b926f378b0c"} Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.465587 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04fe62ffbd8e24cb05fe3016e76791889abe0edc3848a66e34d48b926f378b0c" Dec 04 01:02:40.467952 master-0 kubenswrapper[33142]: I1204 01:02:40.465646 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5b74-account-create-update-jdwpk" Dec 04 01:02:41.517842 master-0 kubenswrapper[33142]: I1204 01:02:41.517716 33142 generic.go:334] "Generic (PLEG): container finished" podID="622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" containerID="a300518533bfe9f38c86a41ff778da16a919b21033f45e1b80bbe58145e6f4f0" exitCode=0 Dec 04 01:02:41.517842 master-0 kubenswrapper[33142]: I1204 01:02:41.517835 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-cjfp8" event={"ID":"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31","Type":"ContainerDied","Data":"a300518533bfe9f38c86a41ff778da16a919b21033f45e1b80bbe58145e6f4f0"} Dec 04 01:02:41.517842 master-0 kubenswrapper[33142]: I1204 01:02:41.517865 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-cjfp8" event={"ID":"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31","Type":"ContainerStarted","Data":"67e36d74d7f9b0a86bdd54506821b60fbdd68f7fc2766d5c775bdc462a4506bd"} Dec 04 01:02:41.521225 master-0 kubenswrapper[33142]: I1204 01:02:41.521115 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-lflzk" event={"ID":"45d14747-33b8-47fd-b63c-25f4982d6308","Type":"ContainerStarted","Data":"13e4ea8bb4876387d87dd6646c84e4927d4c1fcb8cfd693dac49a4cbf7762892"} Dec 04 01:02:41.569541 master-0 kubenswrapper[33142]: I1204 01:02:41.569435 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-db-sync-lflzk" podStartSLOduration=3.398201079 podStartE2EDuration="16.569412953s" podCreationTimestamp="2025-12-04 01:02:25 +0000 UTC" firstStartedPulling="2025-12-04 01:02:26.62956373 +0000 UTC m=+919.031565600" lastFinishedPulling="2025-12-04 01:02:39.800775614 +0000 UTC m=+932.202777474" observedRunningTime="2025-12-04 01:02:41.557312572 +0000 UTC m=+933.959314452" watchObservedRunningTime="2025-12-04 01:02:41.569412953 +0000 UTC m=+933.971414813" Dec 04 01:02:41.588124 master-0 kubenswrapper[33142]: I1204 01:02:41.588071 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-server-0" Dec 04 01:02:41.994571 master-0 kubenswrapper[33142]: I1204 01:02:41.994203 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-db-create-lgnv9"] Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: E1204 01:02:41.995881 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1184467a-cc92-43c0-81d8-43f3c56d3760" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:41.995943 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1184467a-cc92-43c0-81d8-43f3c56d3760" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: E1204 01:02:41.995962 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2c316750-7605-4e15-8a2b-ffb9877de6e4" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:41.995970 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c316750-7605-4e15-8a2b-ffb9877de6e4" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: E1204 01:02:41.996001 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f6b31b9a-5aa5-475d-a093-86ae2ce98694" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:41.996008 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b31b9a-5aa5-475d-a093-86ae2ce98694" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: E1204 01:02:41.996167 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57b2062a-68af-4067-861b-fc33151f7a10" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:41.996218 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b2062a-68af-4067-861b-fc33151f7a10" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:42.001523 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="57b2062a-68af-4067-861b-fc33151f7a10" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:42.001661 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1184467a-cc92-43c0-81d8-43f3c56d3760" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:42.001718 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2c316750-7605-4e15-8a2b-ffb9877de6e4" containerName="mariadb-account-create-update" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:42.001767 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f6b31b9a-5aa5-475d-a093-86ae2ce98694" containerName="mariadb-database-create" Dec 04 01:02:42.003960 master-0 kubenswrapper[33142]: I1204 01:02:42.003461 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.065271 master-0 kubenswrapper[33142]: I1204 01:02:42.064721 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-4e38-account-create-update-ktrnh"] Dec 04 01:02:42.066714 master-0 kubenswrapper[33142]: I1204 01:02:42.066680 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.070769 master-0 kubenswrapper[33142]: I1204 01:02:42.070308 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-db-secret" Dec 04 01:02:42.078437 master-0 kubenswrapper[33142]: I1204 01:02:42.078096 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-lgnv9"] Dec 04 01:02:42.093903 master-0 kubenswrapper[33142]: I1204 01:02:42.093845 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-4e38-account-create-update-ktrnh"] Dec 04 01:02:42.099902 master-0 kubenswrapper[33142]: I1204 01:02:42.099833 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxxq\" (UniqueName: \"kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.100290 master-0 kubenswrapper[33142]: I1204 01:02:42.100255 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48tsv\" (UniqueName: \"kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.100361 master-0 kubenswrapper[33142]: I1204 01:02:42.100306 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.101803 master-0 kubenswrapper[33142]: I1204 01:02:42.101645 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.172058 master-0 kubenswrapper[33142]: I1204 01:02:42.171996 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-db-create-2wcw4"] Dec 04 01:02:42.174104 master-0 kubenswrapper[33142]: I1204 01:02:42.174073 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.184955 master-0 kubenswrapper[33142]: I1204 01:02:42.181832 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-732e-account-create-update-r5lnh"] Dec 04 01:02:42.184955 master-0 kubenswrapper[33142]: I1204 01:02:42.183382 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.190617 master-0 kubenswrapper[33142]: I1204 01:02:42.187109 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-db-secret" Dec 04 01:02:42.191039 master-0 kubenswrapper[33142]: I1204 01:02:42.191002 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-create-2wcw4"] Dec 04 01:02:42.200042 master-0 kubenswrapper[33142]: I1204 01:02:42.199978 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-732e-account-create-update-r5lnh"] Dec 04 01:02:42.210964 master-0 kubenswrapper[33142]: I1204 01:02:42.205302 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxxq\" (UniqueName: \"kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.211421 master-0 kubenswrapper[33142]: I1204 01:02:42.211379 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.211780 master-0 kubenswrapper[33142]: I1204 01:02:42.211755 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwr8\" (UniqueName: \"kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.211913 master-0 kubenswrapper[33142]: I1204 01:02:42.211897 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.212069 master-0 kubenswrapper[33142]: I1204 01:02:42.212048 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h49lp\" (UniqueName: \"kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.212268 master-0 kubenswrapper[33142]: I1204 01:02:42.212253 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-48tsv\" (UniqueName: \"kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.212345 master-0 kubenswrapper[33142]: I1204 01:02:42.212332 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.212482 master-0 kubenswrapper[33142]: I1204 01:02:42.212468 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.213348 master-0 kubenswrapper[33142]: I1204 01:02:42.213333 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.222957 master-0 kubenswrapper[33142]: I1204 01:02:42.214244 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.223405 master-0 kubenswrapper[33142]: I1204 01:02:42.222615 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxxq\" (UniqueName: \"kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq\") pod \"cinder-4e38-account-create-update-ktrnh\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.239957 master-0 kubenswrapper[33142]: I1204 01:02:42.237234 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-48tsv\" (UniqueName: \"kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv\") pod \"cinder-db-create-lgnv9\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.315201 master-0 kubenswrapper[33142]: I1204 01:02:42.315092 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.315297 master-0 kubenswrapper[33142]: I1204 01:02:42.315200 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwr8\" (UniqueName: \"kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.315297 master-0 kubenswrapper[33142]: I1204 01:02:42.315243 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.315297 master-0 kubenswrapper[33142]: I1204 01:02:42.315283 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h49lp\" (UniqueName: \"kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.317643 master-0 kubenswrapper[33142]: I1204 01:02:42.317582 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.318977 master-0 kubenswrapper[33142]: I1204 01:02:42.318903 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.334691 master-0 kubenswrapper[33142]: I1204 01:02:42.334620 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwr8\" (UniqueName: \"kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8\") pod \"neutron-db-create-2wcw4\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.337340 master-0 kubenswrapper[33142]: I1204 01:02:42.337260 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h49lp\" (UniqueName: \"kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp\") pod \"neutron-732e-account-create-update-r5lnh\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.384099 master-0 kubenswrapper[33142]: I1204 01:02:42.384048 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:42.394549 master-0 kubenswrapper[33142]: I1204 01:02:42.394501 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:42.495698 master-0 kubenswrapper[33142]: I1204 01:02:42.495619 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:42.519451 master-0 kubenswrapper[33142]: I1204 01:02:42.518958 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:42.573370 master-0 kubenswrapper[33142]: I1204 01:02:42.573263 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"befee9326fb9fd4b01a8584cca39162191c576ce741f01cb767a7ee738b47e27"} Dec 04 01:02:42.573463 master-0 kubenswrapper[33142]: I1204 01:02:42.573428 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"18603eaa0db9fe1d48643373a4a5d31db3fe2cd9efdce83eb49ae5773d5c6a25"} Dec 04 01:02:42.573463 master-0 kubenswrapper[33142]: I1204 01:02:42.573448 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"d2378631f746338922bcc4859c7a8efdbe51e8e400fa3c6d923067e12406402e"} Dec 04 01:02:42.821990 master-0 kubenswrapper[33142]: I1204 01:02:42.818169 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-cell1-server-0" Dec 04 01:02:43.077044 master-0 kubenswrapper[33142]: I1204 01:02:43.073677 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-lgnv9"] Dec 04 01:02:43.206944 master-0 kubenswrapper[33142]: I1204 01:02:43.206813 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-4e38-account-create-update-ktrnh"] Dec 04 01:02:43.295078 master-0 kubenswrapper[33142]: I1204 01:02:43.295011 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:43.334817 master-0 kubenswrapper[33142]: I1204 01:02:43.331750 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-create-2wcw4"] Dec 04 01:02:43.382573 master-0 kubenswrapper[33142]: I1204 01:02:43.382502 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-b4m9d" Dec 04 01:02:43.485058 master-0 kubenswrapper[33142]: I1204 01:02:43.484975 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.485267 master-0 kubenswrapper[33142]: I1204 01:02:43.485085 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sccck\" (UniqueName: \"kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.485267 master-0 kubenswrapper[33142]: I1204 01:02:43.485163 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.485802 master-0 kubenswrapper[33142]: I1204 01:02:43.485744 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run" (OuterVolumeSpecName: "var-run") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:43.488350 master-0 kubenswrapper[33142]: I1204 01:02:43.488309 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.488406 master-0 kubenswrapper[33142]: I1204 01:02:43.488355 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.488681 master-0 kubenswrapper[33142]: I1204 01:02:43.488570 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn\") pod \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\" (UID: \"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31\") " Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.490108 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.490598 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.491233 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts" (OuterVolumeSpecName: "scripts") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.491278 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.493886 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-732e-account-create-update-r5lnh"] Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.495919 33142 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-log-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.495955 33142 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.495965 33142 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-var-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.495975 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.496981 master-0 kubenswrapper[33142]: I1204 01:02:43.495989 33142 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-additional-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.513658 master-0 kubenswrapper[33142]: I1204 01:02:43.508778 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck" (OuterVolumeSpecName: "kube-api-access-sccck") pod "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" (UID: "622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31"). InnerVolumeSpecName "kube-api-access-sccck". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:43.593490 master-0 kubenswrapper[33142]: I1204 01:02:43.593291 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-cjfp8" Dec 04 01:02:43.594000 master-0 kubenswrapper[33142]: I1204 01:02:43.593299 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-cjfp8" event={"ID":"622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31","Type":"ContainerDied","Data":"67e36d74d7f9b0a86bdd54506821b60fbdd68f7fc2766d5c775bdc462a4506bd"} Dec 04 01:02:43.594063 master-0 kubenswrapper[33142]: I1204 01:02:43.594018 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67e36d74d7f9b0a86bdd54506821b60fbdd68f7fc2766d5c775bdc462a4506bd" Dec 04 01:02:43.597469 master-0 kubenswrapper[33142]: I1204 01:02:43.597436 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sccck\" (UniqueName: \"kubernetes.io/projected/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31-kube-api-access-sccck\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:43.598282 master-0 kubenswrapper[33142]: I1204 01:02:43.598110 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"0297321e883a2bd4753cfba60df3fa011622626dc38e0d02ccfe9966c25a2a08"} Dec 04 01:02:43.604011 master-0 kubenswrapper[33142]: I1204 01:02:43.603950 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-2wcw4" event={"ID":"1b920064-b05e-4929-a352-f7d2fd03e688","Type":"ContainerStarted","Data":"0709c2362cd3dd4839cd7523430fb916acfa1c4e331882d1a1cf7c6bb6e7948e"} Dec 04 01:02:43.609503 master-0 kubenswrapper[33142]: I1204 01:02:43.609441 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgnv9" event={"ID":"d571241f-d1c4-43fb-ad16-450fd86e9575","Type":"ContainerStarted","Data":"e57c1757ae785f2973640a0625edaa45799660ff2542d9382184af2765f5e48c"} Dec 04 01:02:43.609503 master-0 kubenswrapper[33142]: I1204 01:02:43.609501 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgnv9" event={"ID":"d571241f-d1c4-43fb-ad16-450fd86e9575","Type":"ContainerStarted","Data":"f42c644a9ba134374eeabb73090e3a3c3476e17598d75f0db0088c666d171ac8"} Dec 04 01:02:43.612673 master-0 kubenswrapper[33142]: I1204 01:02:43.612083 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-732e-account-create-update-r5lnh" event={"ID":"16464e54-554e-4e4f-beb7-27229e08fc4b","Type":"ContainerStarted","Data":"0fd17124255300717057a66888d263e8ef7367482cc4f3e66560406a90cae435"} Dec 04 01:02:43.623020 master-0 kubenswrapper[33142]: I1204 01:02:43.619526 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-4e38-account-create-update-ktrnh" event={"ID":"a4085e59-a2cf-46bd-9d24-980a0423a6c6","Type":"ContainerStarted","Data":"0c7681254b5cb9874e4aa4be8abe59499be45b43de76c2d117151b3e87b0ae61"} Dec 04 01:02:43.642119 master-0 kubenswrapper[33142]: I1204 01:02:43.642000 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-db-create-lgnv9" podStartSLOduration=2.6419747559999998 podStartE2EDuration="2.641974756s" podCreationTimestamp="2025-12-04 01:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:43.62933201 +0000 UTC m=+936.031333870" watchObservedRunningTime="2025-12-04 01:02:43.641974756 +0000 UTC m=+936.043976606" Dec 04 01:02:43.665955 master-0 kubenswrapper[33142]: I1204 01:02:43.663697 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-4e38-account-create-update-ktrnh" podStartSLOduration=2.663674897 podStartE2EDuration="2.663674897s" podCreationTimestamp="2025-12-04 01:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:43.649687424 +0000 UTC m=+936.051689284" watchObservedRunningTime="2025-12-04 01:02:43.663674897 +0000 UTC m=+936.065676747" Dec 04 01:02:44.448036 master-0 kubenswrapper[33142]: I1204 01:02:44.444147 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ovn-controller-b4m9d-config-cjfp8"] Dec 04 01:02:44.462681 master-0 kubenswrapper[33142]: I1204 01:02:44.462557 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ovn-controller-b4m9d-config-cjfp8"] Dec 04 01:02:44.554580 master-0 kubenswrapper[33142]: I1204 01:02:44.554481 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-b4m9d-config-wvfgq"] Dec 04 01:02:44.555813 master-0 kubenswrapper[33142]: E1204 01:02:44.555259 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" containerName="ovn-config" Dec 04 01:02:44.555813 master-0 kubenswrapper[33142]: I1204 01:02:44.555284 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" containerName="ovn-config" Dec 04 01:02:44.555813 master-0 kubenswrapper[33142]: I1204 01:02:44.555569 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" containerName="ovn-config" Dec 04 01:02:44.557666 master-0 kubenswrapper[33142]: I1204 01:02:44.557517 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.564230 master-0 kubenswrapper[33142]: I1204 01:02:44.564148 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-extra-scripts" Dec 04 01:02:44.589078 master-0 kubenswrapper[33142]: I1204 01:02:44.587865 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d-config-wvfgq"] Dec 04 01:02:44.624868 master-0 kubenswrapper[33142]: I1204 01:02:44.624612 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7znp\" (UniqueName: \"kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.624868 master-0 kubenswrapper[33142]: I1204 01:02:44.624807 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.624868 master-0 kubenswrapper[33142]: I1204 01:02:44.624854 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.625629 master-0 kubenswrapper[33142]: I1204 01:02:44.624910 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.625629 master-0 kubenswrapper[33142]: I1204 01:02:44.624982 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.625629 master-0 kubenswrapper[33142]: I1204 01:02:44.625016 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.639862 master-0 kubenswrapper[33142]: I1204 01:02:44.639776 33142 generic.go:334] "Generic (PLEG): container finished" podID="16464e54-554e-4e4f-beb7-27229e08fc4b" containerID="4e7306a064f2e09abfee29feeb76f35824f786b7128cdd43a36e3b2f6c39dc6d" exitCode=0 Dec 04 01:02:44.640223 master-0 kubenswrapper[33142]: I1204 01:02:44.639913 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-732e-account-create-update-r5lnh" event={"ID":"16464e54-554e-4e4f-beb7-27229e08fc4b","Type":"ContainerDied","Data":"4e7306a064f2e09abfee29feeb76f35824f786b7128cdd43a36e3b2f6c39dc6d"} Dec 04 01:02:44.652524 master-0 kubenswrapper[33142]: I1204 01:02:44.652325 33142 generic.go:334] "Generic (PLEG): container finished" podID="a4085e59-a2cf-46bd-9d24-980a0423a6c6" containerID="74f3c369fa4dd53f62d7ff24f43bd40742766ed54cb869e202077b7abd58abad" exitCode=0 Dec 04 01:02:44.652524 master-0 kubenswrapper[33142]: I1204 01:02:44.652463 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-4e38-account-create-update-ktrnh" event={"ID":"a4085e59-a2cf-46bd-9d24-980a0423a6c6","Type":"ContainerDied","Data":"74f3c369fa4dd53f62d7ff24f43bd40742766ed54cb869e202077b7abd58abad"} Dec 04 01:02:44.658653 master-0 kubenswrapper[33142]: I1204 01:02:44.658273 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"2e200588a7f0f57629ba87bf36c5339334aed6445112aa0027f0e20012f514d2"} Dec 04 01:02:44.666291 master-0 kubenswrapper[33142]: I1204 01:02:44.666176 33142 generic.go:334] "Generic (PLEG): container finished" podID="1b920064-b05e-4929-a352-f7d2fd03e688" containerID="cd3bae5feaace0e8c1b62f5fba7247a81e94714a4a439dd0fd1e24fb0b05dea0" exitCode=0 Dec 04 01:02:44.666482 master-0 kubenswrapper[33142]: I1204 01:02:44.666293 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-2wcw4" event={"ID":"1b920064-b05e-4929-a352-f7d2fd03e688","Type":"ContainerDied","Data":"cd3bae5feaace0e8c1b62f5fba7247a81e94714a4a439dd0fd1e24fb0b05dea0"} Dec 04 01:02:44.669484 master-0 kubenswrapper[33142]: I1204 01:02:44.669423 33142 generic.go:334] "Generic (PLEG): container finished" podID="d571241f-d1c4-43fb-ad16-450fd86e9575" containerID="e57c1757ae785f2973640a0625edaa45799660ff2542d9382184af2765f5e48c" exitCode=0 Dec 04 01:02:44.669702 master-0 kubenswrapper[33142]: I1204 01:02:44.669517 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgnv9" event={"ID":"d571241f-d1c4-43fb-ad16-450fd86e9575","Type":"ContainerDied","Data":"e57c1757ae785f2973640a0625edaa45799660ff2542d9382184af2765f5e48c"} Dec 04 01:02:44.726825 master-0 kubenswrapper[33142]: I1204 01:02:44.726715 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v7znp\" (UniqueName: \"kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727210 master-0 kubenswrapper[33142]: I1204 01:02:44.726942 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727210 master-0 kubenswrapper[33142]: I1204 01:02:44.726993 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727210 master-0 kubenswrapper[33142]: I1204 01:02:44.727051 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727210 master-0 kubenswrapper[33142]: I1204 01:02:44.727115 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727210 master-0 kubenswrapper[33142]: I1204 01:02:44.727156 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727398 master-0 kubenswrapper[33142]: I1204 01:02:44.727358 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727524 master-0 kubenswrapper[33142]: I1204 01:02:44.727462 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.727627 master-0 kubenswrapper[33142]: I1204 01:02:44.727582 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.728415 master-0 kubenswrapper[33142]: I1204 01:02:44.728384 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.730243 master-0 kubenswrapper[33142]: I1204 01:02:44.730184 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.745987 master-0 kubenswrapper[33142]: I1204 01:02:44.745912 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7znp\" (UniqueName: \"kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp\") pod \"ovn-controller-b4m9d-config-wvfgq\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:44.875813 master-0 kubenswrapper[33142]: I1204 01:02:44.875704 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:45.666230 master-0 kubenswrapper[33142]: I1204 01:02:45.665232 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-b4m9d-config-wvfgq"] Dec 04 01:02:45.721352 master-0 kubenswrapper[33142]: I1204 01:02:45.721269 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"047aa6dca54aa4862254a861587b9cf62ddd3e70e8b6b4bb46659c795652104a"} Dec 04 01:02:45.721352 master-0 kubenswrapper[33142]: I1204 01:02:45.721334 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"1fd24d854e4a3891e46ceabca7f0c56f06571ceb28cdf402ba5646ca1ccb39be"} Dec 04 01:02:45.927990 master-0 kubenswrapper[33142]: I1204 01:02:45.927802 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31" path="/var/lib/kubelet/pods/622f4fd4-1bb3-4d4c-a09b-f3f8e293eb31/volumes" Dec 04 01:02:45.929010 master-0 kubenswrapper[33142]: I1204 01:02:45.928796 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-db-sync-qbvdt"] Dec 04 01:02:45.939052 master-0 kubenswrapper[33142]: I1204 01:02:45.937869 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-sync-qbvdt"] Dec 04 01:02:45.939052 master-0 kubenswrapper[33142]: I1204 01:02:45.938048 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:45.945051 master-0 kubenswrapper[33142]: I1204 01:02:45.944850 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 01:02:45.945051 master-0 kubenswrapper[33142]: I1204 01:02:45.944993 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 01:02:45.945776 master-0 kubenswrapper[33142]: I1204 01:02:45.945726 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 01:02:46.112100 master-0 kubenswrapper[33142]: I1204 01:02:46.111973 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.112328 master-0 kubenswrapper[33142]: I1204 01:02:46.112153 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.112328 master-0 kubenswrapper[33142]: I1204 01:02:46.112266 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgr7x\" (UniqueName: \"kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.215369 master-0 kubenswrapper[33142]: I1204 01:02:46.214979 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sgr7x\" (UniqueName: \"kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.217223 master-0 kubenswrapper[33142]: I1204 01:02:46.216142 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.217379 master-0 kubenswrapper[33142]: I1204 01:02:46.216319 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.220556 master-0 kubenswrapper[33142]: I1204 01:02:46.220472 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.228482 master-0 kubenswrapper[33142]: I1204 01:02:46.228154 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.238033 master-0 kubenswrapper[33142]: I1204 01:02:46.237951 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgr7x\" (UniqueName: \"kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x\") pod \"keystone-db-sync-qbvdt\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.272107 master-0 kubenswrapper[33142]: I1204 01:02:46.271496 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:46.417695 master-0 kubenswrapper[33142]: I1204 01:02:46.417652 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:46.433887 master-0 kubenswrapper[33142]: I1204 01:02:46.433826 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:46.449663 master-0 kubenswrapper[33142]: I1204 01:02:46.449141 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:46.463456 master-0 kubenswrapper[33142]: I1204 01:02:46.463265 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:46.528916 master-0 kubenswrapper[33142]: I1204 01:02:46.524192 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlwr8\" (UniqueName: \"kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8\") pod \"1b920064-b05e-4929-a352-f7d2fd03e688\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " Dec 04 01:02:46.528916 master-0 kubenswrapper[33142]: I1204 01:02:46.524663 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcxxq\" (UniqueName: \"kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq\") pod \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " Dec 04 01:02:46.528916 master-0 kubenswrapper[33142]: I1204 01:02:46.524727 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts\") pod \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\" (UID: \"a4085e59-a2cf-46bd-9d24-980a0423a6c6\") " Dec 04 01:02:46.528916 master-0 kubenswrapper[33142]: I1204 01:02:46.524834 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts\") pod \"1b920064-b05e-4929-a352-f7d2fd03e688\" (UID: \"1b920064-b05e-4929-a352-f7d2fd03e688\") " Dec 04 01:02:46.528916 master-0 kubenswrapper[33142]: I1204 01:02:46.526286 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1b920064-b05e-4929-a352-f7d2fd03e688" (UID: "1b920064-b05e-4929-a352-f7d2fd03e688"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:46.540036 master-0 kubenswrapper[33142]: I1204 01:02:46.539600 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4085e59-a2cf-46bd-9d24-980a0423a6c6" (UID: "a4085e59-a2cf-46bd-9d24-980a0423a6c6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:46.541327 master-0 kubenswrapper[33142]: I1204 01:02:46.541191 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8" (OuterVolumeSpecName: "kube-api-access-tlwr8") pod "1b920064-b05e-4929-a352-f7d2fd03e688" (UID: "1b920064-b05e-4929-a352-f7d2fd03e688"). InnerVolumeSpecName "kube-api-access-tlwr8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:46.566807 master-0 kubenswrapper[33142]: I1204 01:02:46.546102 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq" (OuterVolumeSpecName: "kube-api-access-jcxxq") pod "a4085e59-a2cf-46bd-9d24-980a0423a6c6" (UID: "a4085e59-a2cf-46bd-9d24-980a0423a6c6"). InnerVolumeSpecName "kube-api-access-jcxxq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:46.628621 master-0 kubenswrapper[33142]: I1204 01:02:46.627693 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h49lp\" (UniqueName: \"kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp\") pod \"16464e54-554e-4e4f-beb7-27229e08fc4b\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " Dec 04 01:02:46.629969 master-0 kubenswrapper[33142]: I1204 01:02:46.629913 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts\") pod \"d571241f-d1c4-43fb-ad16-450fd86e9575\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " Dec 04 01:02:46.630150 master-0 kubenswrapper[33142]: I1204 01:02:46.630135 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts\") pod \"16464e54-554e-4e4f-beb7-27229e08fc4b\" (UID: \"16464e54-554e-4e4f-beb7-27229e08fc4b\") " Dec 04 01:02:46.630571 master-0 kubenswrapper[33142]: I1204 01:02:46.630503 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d571241f-d1c4-43fb-ad16-450fd86e9575" (UID: "d571241f-d1c4-43fb-ad16-450fd86e9575"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:46.630834 master-0 kubenswrapper[33142]: I1204 01:02:46.630816 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48tsv\" (UniqueName: \"kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv\") pod \"d571241f-d1c4-43fb-ad16-450fd86e9575\" (UID: \"d571241f-d1c4-43fb-ad16-450fd86e9575\") " Dec 04 01:02:46.631615 master-0 kubenswrapper[33142]: I1204 01:02:46.631531 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "16464e54-554e-4e4f-beb7-27229e08fc4b" (UID: "16464e54-554e-4e4f-beb7-27229e08fc4b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:46.632058 master-0 kubenswrapper[33142]: I1204 01:02:46.632041 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b920064-b05e-4929-a352-f7d2fd03e688-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.632181 master-0 kubenswrapper[33142]: I1204 01:02:46.632167 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tlwr8\" (UniqueName: \"kubernetes.io/projected/1b920064-b05e-4929-a352-f7d2fd03e688-kube-api-access-tlwr8\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.632454 master-0 kubenswrapper[33142]: I1204 01:02:46.632422 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d571241f-d1c4-43fb-ad16-450fd86e9575-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.632732 master-0 kubenswrapper[33142]: I1204 01:02:46.632676 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jcxxq\" (UniqueName: \"kubernetes.io/projected/a4085e59-a2cf-46bd-9d24-980a0423a6c6-kube-api-access-jcxxq\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.633288 master-0 kubenswrapper[33142]: I1204 01:02:46.633273 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16464e54-554e-4e4f-beb7-27229e08fc4b-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.633430 master-0 kubenswrapper[33142]: I1204 01:02:46.633398 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4085e59-a2cf-46bd-9d24-980a0423a6c6-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.634424 master-0 kubenswrapper[33142]: I1204 01:02:46.634406 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp" (OuterVolumeSpecName: "kube-api-access-h49lp") pod "16464e54-554e-4e4f-beb7-27229e08fc4b" (UID: "16464e54-554e-4e4f-beb7-27229e08fc4b"). InnerVolumeSpecName "kube-api-access-h49lp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:46.635026 master-0 kubenswrapper[33142]: I1204 01:02:46.634941 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv" (OuterVolumeSpecName: "kube-api-access-48tsv") pod "d571241f-d1c4-43fb-ad16-450fd86e9575" (UID: "d571241f-d1c4-43fb-ad16-450fd86e9575"). InnerVolumeSpecName "kube-api-access-48tsv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:46.736373 master-0 kubenswrapper[33142]: I1204 01:02:46.736210 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-48tsv\" (UniqueName: \"kubernetes.io/projected/d571241f-d1c4-43fb-ad16-450fd86e9575-kube-api-access-48tsv\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.736373 master-0 kubenswrapper[33142]: I1204 01:02:46.736267 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h49lp\" (UniqueName: \"kubernetes.io/projected/16464e54-554e-4e4f-beb7-27229e08fc4b-kube-api-access-h49lp\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:46.737756 master-0 kubenswrapper[33142]: I1204 01:02:46.737712 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-2wcw4" event={"ID":"1b920064-b05e-4929-a352-f7d2fd03e688","Type":"ContainerDied","Data":"0709c2362cd3dd4839cd7523430fb916acfa1c4e331882d1a1cf7c6bb6e7948e"} Dec 04 01:02:46.737890 master-0 kubenswrapper[33142]: I1204 01:02:46.737874 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0709c2362cd3dd4839cd7523430fb916acfa1c4e331882d1a1cf7c6bb6e7948e" Dec 04 01:02:46.737985 master-0 kubenswrapper[33142]: I1204 01:02:46.737728 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-2wcw4" Dec 04 01:02:46.741861 master-0 kubenswrapper[33142]: I1204 01:02:46.741819 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgnv9" event={"ID":"d571241f-d1c4-43fb-ad16-450fd86e9575","Type":"ContainerDied","Data":"f42c644a9ba134374eeabb73090e3a3c3476e17598d75f0db0088c666d171ac8"} Dec 04 01:02:46.741962 master-0 kubenswrapper[33142]: I1204 01:02:46.741869 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f42c644a9ba134374eeabb73090e3a3c3476e17598d75f0db0088c666d171ac8" Dec 04 01:02:46.742030 master-0 kubenswrapper[33142]: I1204 01:02:46.741961 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgnv9" Dec 04 01:02:46.747514 master-0 kubenswrapper[33142]: I1204 01:02:46.747359 33142 generic.go:334] "Generic (PLEG): container finished" podID="ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" containerID="74836ace3f856ae90c3f027921bc8b96b7a45feee9ed64cb26eac5b0419d52f4" exitCode=0 Dec 04 01:02:46.747514 master-0 kubenswrapper[33142]: I1204 01:02:46.747491 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-wvfgq" event={"ID":"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb","Type":"ContainerDied","Data":"74836ace3f856ae90c3f027921bc8b96b7a45feee9ed64cb26eac5b0419d52f4"} Dec 04 01:02:46.747638 master-0 kubenswrapper[33142]: I1204 01:02:46.747542 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-wvfgq" event={"ID":"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb","Type":"ContainerStarted","Data":"1e6ad97e638aac71ee68779deb27ab2e4227710eedd3fcc51746521802634d25"} Dec 04 01:02:46.757443 master-0 kubenswrapper[33142]: I1204 01:02:46.757344 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-4e38-account-create-update-ktrnh" Dec 04 01:02:46.757535 master-0 kubenswrapper[33142]: I1204 01:02:46.757367 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-4e38-account-create-update-ktrnh" event={"ID":"a4085e59-a2cf-46bd-9d24-980a0423a6c6","Type":"ContainerDied","Data":"0c7681254b5cb9874e4aa4be8abe59499be45b43de76c2d117151b3e87b0ae61"} Dec 04 01:02:46.757535 master-0 kubenswrapper[33142]: I1204 01:02:46.757514 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c7681254b5cb9874e4aa4be8abe59499be45b43de76c2d117151b3e87b0ae61" Dec 04 01:02:46.760463 master-0 kubenswrapper[33142]: I1204 01:02:46.760424 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-732e-account-create-update-r5lnh" event={"ID":"16464e54-554e-4e4f-beb7-27229e08fc4b","Type":"ContainerDied","Data":"0fd17124255300717057a66888d263e8ef7367482cc4f3e66560406a90cae435"} Dec 04 01:02:46.761028 master-0 kubenswrapper[33142]: I1204 01:02:46.760470 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fd17124255300717057a66888d263e8ef7367482cc4f3e66560406a90cae435" Dec 04 01:02:46.761028 master-0 kubenswrapper[33142]: I1204 01:02:46.760443 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-732e-account-create-update-r5lnh" Dec 04 01:02:46.776667 master-0 kubenswrapper[33142]: I1204 01:02:46.776564 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"424395c5687c5240f40c7c829753bf0ddfac302adb344a41b8794cb85b61d530"} Dec 04 01:02:46.871252 master-0 kubenswrapper[33142]: I1204 01:02:46.871186 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-sync-qbvdt"] Dec 04 01:02:47.793955 master-0 kubenswrapper[33142]: I1204 01:02:47.793873 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"1c3290cb59a13e99a1e2ab2fa15e2a786576dc65e8adf4da4259f4af253b585c"} Dec 04 01:02:47.793955 master-0 kubenswrapper[33142]: I1204 01:02:47.793946 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"b066a333838a5d2fa0d0c9b6a0637c1ccb6ac8f34bbff2e20538554f3fe03c89"} Dec 04 01:02:47.793955 master-0 kubenswrapper[33142]: I1204 01:02:47.793961 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"a9ae0313a787f9e3e005df95f0ab0022a0969243af78973055587906495fc090"} Dec 04 01:02:47.795296 master-0 kubenswrapper[33142]: I1204 01:02:47.795247 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-qbvdt" event={"ID":"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba","Type":"ContainerStarted","Data":"45d2c94e6b950802750c088183ad241521719876f98d0e208a288c37b7490c75"} Dec 04 01:02:48.319628 master-0 kubenswrapper[33142]: I1204 01:02:48.318752 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:48.491395 master-0 kubenswrapper[33142]: I1204 01:02:48.491280 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.491819 master-0 kubenswrapper[33142]: I1204 01:02:48.491395 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.491819 master-0 kubenswrapper[33142]: I1204 01:02:48.491475 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7znp\" (UniqueName: \"kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.491819 master-0 kubenswrapper[33142]: I1204 01:02:48.491551 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.491819 master-0 kubenswrapper[33142]: I1204 01:02:48.491686 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.491819 master-0 kubenswrapper[33142]: I1204 01:02:48.491743 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn\") pod \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\" (UID: \"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb\") " Dec 04 01:02:48.492532 master-0 kubenswrapper[33142]: I1204 01:02:48.492411 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:48.492604 master-0 kubenswrapper[33142]: I1204 01:02:48.492531 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:48.493127 master-0 kubenswrapper[33142]: I1204 01:02:48.493095 33142 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.493205 master-0 kubenswrapper[33142]: I1204 01:02:48.493126 33142 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-additional-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.493205 master-0 kubenswrapper[33142]: I1204 01:02:48.493166 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run" (OuterVolumeSpecName: "var-run") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:48.493205 master-0 kubenswrapper[33142]: I1204 01:02:48.493199 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:02:48.493836 master-0 kubenswrapper[33142]: I1204 01:02:48.493773 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts" (OuterVolumeSpecName: "scripts") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:48.507084 master-0 kubenswrapper[33142]: I1204 01:02:48.506220 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp" (OuterVolumeSpecName: "kube-api-access-v7znp") pod "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" (UID: "ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb"). InnerVolumeSpecName "kube-api-access-v7znp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:48.595215 master-0 kubenswrapper[33142]: I1204 01:02:48.595141 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.595215 master-0 kubenswrapper[33142]: I1204 01:02:48.595187 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v7znp\" (UniqueName: \"kubernetes.io/projected/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-kube-api-access-v7znp\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.595215 master-0 kubenswrapper[33142]: I1204 01:02:48.595200 33142 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.595215 master-0 kubenswrapper[33142]: I1204 01:02:48.595208 33142 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb-var-log-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:48.810508 master-0 kubenswrapper[33142]: I1204 01:02:48.810463 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-b4m9d-config-wvfgq" Dec 04 01:02:48.811071 master-0 kubenswrapper[33142]: I1204 01:02:48.810457 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-b4m9d-config-wvfgq" event={"ID":"ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb","Type":"ContainerDied","Data":"1e6ad97e638aac71ee68779deb27ab2e4227710eedd3fcc51746521802634d25"} Dec 04 01:02:48.811071 master-0 kubenswrapper[33142]: I1204 01:02:48.810622 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6ad97e638aac71ee68779deb27ab2e4227710eedd3fcc51746521802634d25" Dec 04 01:02:48.819982 master-0 kubenswrapper[33142]: I1204 01:02:48.819866 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"42b4f4169df248cc3a0e5fa4455a3ecc9e2efb4382a1fbc8775aa09af67e4846"} Dec 04 01:02:48.820160 master-0 kubenswrapper[33142]: I1204 01:02:48.819994 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"2297710925dd14fb3a1a2d8ee8d9add7cbe48cc5600c11b9393e09a85fe65b57"} Dec 04 01:02:48.820160 master-0 kubenswrapper[33142]: I1204 01:02:48.820008 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"dad450cd9e47c7a3471c16642b1e48d1e620be4eec2a44674b160707f69a8648"} Dec 04 01:02:49.551531 master-0 kubenswrapper[33142]: I1204 01:02:49.551425 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ovn-controller-b4m9d-config-wvfgq"] Dec 04 01:02:49.571112 master-0 kubenswrapper[33142]: I1204 01:02:49.571027 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ovn-controller-b4m9d-config-wvfgq"] Dec 04 01:02:49.848522 master-0 kubenswrapper[33142]: I1204 01:02:49.848450 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"96b9aff9-fcd4-4893-99cc-eebf4d97d339","Type":"ContainerStarted","Data":"b6a16d1526392203a0b2db54252c5e932938507fd223e2c0cd44a40f1195e8e4"} Dec 04 01:02:49.936381 master-0 kubenswrapper[33142]: I1204 01:02:49.936263 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" path="/var/lib/kubelet/pods/ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb/volumes" Dec 04 01:02:49.943797 master-0 kubenswrapper[33142]: I1204 01:02:49.943692 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-storage-0" podStartSLOduration=41.274876991 podStartE2EDuration="47.943659512s" podCreationTimestamp="2025-12-04 01:02:02 +0000 UTC" firstStartedPulling="2025-12-04 01:02:40.384819012 +0000 UTC m=+932.786820862" lastFinishedPulling="2025-12-04 01:02:47.053601403 +0000 UTC m=+939.455603383" observedRunningTime="2025-12-04 01:02:49.906641968 +0000 UTC m=+942.308643858" watchObservedRunningTime="2025-12-04 01:02:49.943659512 +0000 UTC m=+942.345661372" Dec 04 01:02:50.236152 master-0 kubenswrapper[33142]: I1204 01:02:50.235905 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:50.236680 master-0 kubenswrapper[33142]: E1204 01:02:50.236639 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" containerName="ovn-config" Dec 04 01:02:50.236680 master-0 kubenswrapper[33142]: I1204 01:02:50.236670 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" containerName="ovn-config" Dec 04 01:02:50.236798 master-0 kubenswrapper[33142]: E1204 01:02:50.236749 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d571241f-d1c4-43fb-ad16-450fd86e9575" containerName="mariadb-database-create" Dec 04 01:02:50.236798 master-0 kubenswrapper[33142]: I1204 01:02:50.236765 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d571241f-d1c4-43fb-ad16-450fd86e9575" containerName="mariadb-database-create" Dec 04 01:02:50.236798 master-0 kubenswrapper[33142]: E1204 01:02:50.236792 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b920064-b05e-4929-a352-f7d2fd03e688" containerName="mariadb-database-create" Dec 04 01:02:50.236982 master-0 kubenswrapper[33142]: I1204 01:02:50.236805 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b920064-b05e-4929-a352-f7d2fd03e688" containerName="mariadb-database-create" Dec 04 01:02:50.236982 master-0 kubenswrapper[33142]: E1204 01:02:50.236832 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4085e59-a2cf-46bd-9d24-980a0423a6c6" containerName="mariadb-account-create-update" Dec 04 01:02:50.236982 master-0 kubenswrapper[33142]: I1204 01:02:50.236841 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4085e59-a2cf-46bd-9d24-980a0423a6c6" containerName="mariadb-account-create-update" Dec 04 01:02:50.236982 master-0 kubenswrapper[33142]: E1204 01:02:50.236861 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16464e54-554e-4e4f-beb7-27229e08fc4b" containerName="mariadb-account-create-update" Dec 04 01:02:50.236982 master-0 kubenswrapper[33142]: I1204 01:02:50.236868 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="16464e54-554e-4e4f-beb7-27229e08fc4b" containerName="mariadb-account-create-update" Dec 04 01:02:50.237249 master-0 kubenswrapper[33142]: I1204 01:02:50.237205 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b920064-b05e-4929-a352-f7d2fd03e688" containerName="mariadb-database-create" Dec 04 01:02:50.237249 master-0 kubenswrapper[33142]: I1204 01:02:50.237244 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d571241f-d1c4-43fb-ad16-450fd86e9575" containerName="mariadb-database-create" Dec 04 01:02:50.237358 master-0 kubenswrapper[33142]: I1204 01:02:50.237264 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="ec20c8a7-4044-4d85-8a6b-5ac6fff5f7fb" containerName="ovn-config" Dec 04 01:02:50.237358 master-0 kubenswrapper[33142]: I1204 01:02:50.237287 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4085e59-a2cf-46bd-9d24-980a0423a6c6" containerName="mariadb-account-create-update" Dec 04 01:02:50.237358 master-0 kubenswrapper[33142]: I1204 01:02:50.237303 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="16464e54-554e-4e4f-beb7-27229e08fc4b" containerName="mariadb-account-create-update" Dec 04 01:02:50.238724 master-0 kubenswrapper[33142]: I1204 01:02:50.238687 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.244056 master-0 kubenswrapper[33142]: I1204 01:02:50.241208 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Dec 04 01:02:50.249230 master-0 kubenswrapper[33142]: I1204 01:02:50.247700 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:50.342513 master-0 kubenswrapper[33142]: I1204 01:02:50.342343 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.342800 master-0 kubenswrapper[33142]: I1204 01:02:50.342721 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.343367 master-0 kubenswrapper[33142]: I1204 01:02:50.343061 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.343870 master-0 kubenswrapper[33142]: I1204 01:02:50.343619 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.343960 master-0 kubenswrapper[33142]: I1204 01:02:50.343922 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.344002 master-0 kubenswrapper[33142]: I1204 01:02:50.343990 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2hw\" (UniqueName: \"kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.446958 master-0 kubenswrapper[33142]: I1204 01:02:50.446832 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.447201 master-0 kubenswrapper[33142]: I1204 01:02:50.447001 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.447201 master-0 kubenswrapper[33142]: I1204 01:02:50.447121 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.447280 master-0 kubenswrapper[33142]: I1204 01:02:50.447205 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.447280 master-0 kubenswrapper[33142]: I1204 01:02:50.447231 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2hw\" (UniqueName: \"kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.447344 master-0 kubenswrapper[33142]: I1204 01:02:50.447323 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.450948 master-0 kubenswrapper[33142]: I1204 01:02:50.447913 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.450948 master-0 kubenswrapper[33142]: I1204 01:02:50.448391 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.450948 master-0 kubenswrapper[33142]: I1204 01:02:50.448511 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.450948 master-0 kubenswrapper[33142]: I1204 01:02:50.448877 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.454018 master-0 kubenswrapper[33142]: I1204 01:02:50.453443 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.465587 master-0 kubenswrapper[33142]: I1204 01:02:50.465545 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2hw\" (UniqueName: \"kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw\") pod \"dnsmasq-dns-67894fd4d5-kt7sx\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.593626 master-0 kubenswrapper[33142]: I1204 01:02:50.593412 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:50.866188 master-0 kubenswrapper[33142]: I1204 01:02:50.865604 33142 generic.go:334] "Generic (PLEG): container finished" podID="45d14747-33b8-47fd-b63c-25f4982d6308" containerID="13e4ea8bb4876387d87dd6646c84e4927d4c1fcb8cfd693dac49a4cbf7762892" exitCode=0 Dec 04 01:02:50.866188 master-0 kubenswrapper[33142]: I1204 01:02:50.865746 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-lflzk" event={"ID":"45d14747-33b8-47fd-b63c-25f4982d6308","Type":"ContainerDied","Data":"13e4ea8bb4876387d87dd6646c84e4927d4c1fcb8cfd693dac49a4cbf7762892"} Dec 04 01:02:52.327251 master-0 kubenswrapper[33142]: W1204 01:02:52.327083 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46c7acdf_5e23_4b36_b0b5_ac754c255f2f.slice/crio-f147730ab08bd51175979923fe591cd68be87000f1f761c8c3fa8ca1b7c90822 WatchSource:0}: Error finding container f147730ab08bd51175979923fe591cd68be87000f1f761c8c3fa8ca1b7c90822: Status 404 returned error can't find the container with id f147730ab08bd51175979923fe591cd68be87000f1f761c8c3fa8ca1b7c90822 Dec 04 01:02:52.342184 master-0 kubenswrapper[33142]: I1204 01:02:52.336583 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:52.426292 master-0 kubenswrapper[33142]: I1204 01:02:52.426230 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:52.513574 master-0 kubenswrapper[33142]: I1204 01:02:52.512569 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle\") pod \"45d14747-33b8-47fd-b63c-25f4982d6308\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " Dec 04 01:02:52.513574 master-0 kubenswrapper[33142]: I1204 01:02:52.512862 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data\") pod \"45d14747-33b8-47fd-b63c-25f4982d6308\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " Dec 04 01:02:52.513574 master-0 kubenswrapper[33142]: I1204 01:02:52.513477 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data\") pod \"45d14747-33b8-47fd-b63c-25f4982d6308\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " Dec 04 01:02:52.513574 master-0 kubenswrapper[33142]: I1204 01:02:52.513514 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwpfm\" (UniqueName: \"kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm\") pod \"45d14747-33b8-47fd-b63c-25f4982d6308\" (UID: \"45d14747-33b8-47fd-b63c-25f4982d6308\") " Dec 04 01:02:52.517230 master-0 kubenswrapper[33142]: I1204 01:02:52.517149 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm" (OuterVolumeSpecName: "kube-api-access-wwpfm") pod "45d14747-33b8-47fd-b63c-25f4982d6308" (UID: "45d14747-33b8-47fd-b63c-25f4982d6308"). InnerVolumeSpecName "kube-api-access-wwpfm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:52.517560 master-0 kubenswrapper[33142]: I1204 01:02:52.517504 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "45d14747-33b8-47fd-b63c-25f4982d6308" (UID: "45d14747-33b8-47fd-b63c-25f4982d6308"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:52.546451 master-0 kubenswrapper[33142]: I1204 01:02:52.545476 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45d14747-33b8-47fd-b63c-25f4982d6308" (UID: "45d14747-33b8-47fd-b63c-25f4982d6308"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:52.587580 master-0 kubenswrapper[33142]: I1204 01:02:52.587480 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data" (OuterVolumeSpecName: "config-data") pod "45d14747-33b8-47fd-b63c-25f4982d6308" (UID: "45d14747-33b8-47fd-b63c-25f4982d6308"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:52.616483 master-0 kubenswrapper[33142]: I1204 01:02:52.616340 33142 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-db-sync-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:52.616483 master-0 kubenswrapper[33142]: I1204 01:02:52.616396 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:52.616483 master-0 kubenswrapper[33142]: I1204 01:02:52.616407 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wwpfm\" (UniqueName: \"kubernetes.io/projected/45d14747-33b8-47fd-b63c-25f4982d6308-kube-api-access-wwpfm\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:52.616483 master-0 kubenswrapper[33142]: I1204 01:02:52.616415 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d14747-33b8-47fd-b63c-25f4982d6308-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:52.900798 master-0 kubenswrapper[33142]: I1204 01:02:52.900705 33142 generic.go:334] "Generic (PLEG): container finished" podID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerID="617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95" exitCode=0 Dec 04 01:02:52.901321 master-0 kubenswrapper[33142]: I1204 01:02:52.901215 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" event={"ID":"46c7acdf-5e23-4b36-b0b5-ac754c255f2f","Type":"ContainerDied","Data":"617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95"} Dec 04 01:02:52.901393 master-0 kubenswrapper[33142]: I1204 01:02:52.901335 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" event={"ID":"46c7acdf-5e23-4b36-b0b5-ac754c255f2f","Type":"ContainerStarted","Data":"f147730ab08bd51175979923fe591cd68be87000f1f761c8c3fa8ca1b7c90822"} Dec 04 01:02:52.908913 master-0 kubenswrapper[33142]: I1204 01:02:52.908842 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-lflzk" event={"ID":"45d14747-33b8-47fd-b63c-25f4982d6308","Type":"ContainerDied","Data":"f2de8b67601179a1496d3be805ea83943ed504d703693dea9a8198cf08f69198"} Dec 04 01:02:52.909033 master-0 kubenswrapper[33142]: I1204 01:02:52.908912 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2de8b67601179a1496d3be805ea83943ed504d703693dea9a8198cf08f69198" Dec 04 01:02:52.909033 master-0 kubenswrapper[33142]: I1204 01:02:52.909013 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-lflzk" Dec 04 01:02:52.927838 master-0 kubenswrapper[33142]: I1204 01:02:52.927724 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-qbvdt" event={"ID":"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba","Type":"ContainerStarted","Data":"97406cf5455ed24c46eba551e7c329b83da958b3d731f40612c67eb2cf228234"} Dec 04 01:02:53.108032 master-0 kubenswrapper[33142]: I1204 01:02:53.105587 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-db-sync-qbvdt" podStartSLOduration=3.222405929 podStartE2EDuration="8.105559851s" podCreationTimestamp="2025-12-04 01:02:45 +0000 UTC" firstStartedPulling="2025-12-04 01:02:46.99175084 +0000 UTC m=+939.393752690" lastFinishedPulling="2025-12-04 01:02:51.874904762 +0000 UTC m=+944.276906612" observedRunningTime="2025-12-04 01:02:53.099245263 +0000 UTC m=+945.501247133" watchObservedRunningTime="2025-12-04 01:02:53.105559851 +0000 UTC m=+945.507561701" Dec 04 01:02:53.510958 master-0 kubenswrapper[33142]: I1204 01:02:53.506467 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:53.582954 master-0 kubenswrapper[33142]: I1204 01:02:53.582852 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:02:53.584088 master-0 kubenswrapper[33142]: E1204 01:02:53.583760 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45d14747-33b8-47fd-b63c-25f4982d6308" containerName="glance-db-sync" Dec 04 01:02:53.584088 master-0 kubenswrapper[33142]: I1204 01:02:53.583786 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d14747-33b8-47fd-b63c-25f4982d6308" containerName="glance-db-sync" Dec 04 01:02:53.584232 master-0 kubenswrapper[33142]: I1204 01:02:53.584167 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="45d14747-33b8-47fd-b63c-25f4982d6308" containerName="glance-db-sync" Dec 04 01:02:53.609279 master-0 kubenswrapper[33142]: I1204 01:02:53.609179 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.678163 master-0 kubenswrapper[33142]: I1204 01:02:53.678098 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:02:53.718861 master-0 kubenswrapper[33142]: I1204 01:02:53.718721 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.718861 master-0 kubenswrapper[33142]: I1204 01:02:53.718796 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h94m\" (UniqueName: \"kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.719311 master-0 kubenswrapper[33142]: I1204 01:02:53.718912 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.719311 master-0 kubenswrapper[33142]: I1204 01:02:53.718957 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.719311 master-0 kubenswrapper[33142]: I1204 01:02:53.719011 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.719311 master-0 kubenswrapper[33142]: I1204 01:02:53.719045 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820522 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820616 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820657 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2h94m\" (UniqueName: \"kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820781 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820814 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.821616 master-0 kubenswrapper[33142]: I1204 01:02:53.820867 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.822000 master-0 kubenswrapper[33142]: I1204 01:02:53.821723 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.822000 master-0 kubenswrapper[33142]: I1204 01:02:53.821759 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.822313 master-0 kubenswrapper[33142]: I1204 01:02:53.822185 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.822562 master-0 kubenswrapper[33142]: I1204 01:02:53.822522 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.822788 master-0 kubenswrapper[33142]: I1204 01:02:53.822757 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.849637 master-0 kubenswrapper[33142]: I1204 01:02:53.849579 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h94m\" (UniqueName: \"kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m\") pod \"dnsmasq-dns-798856cd8c-tqmbp\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.942770 master-0 kubenswrapper[33142]: I1204 01:02:53.942685 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" event={"ID":"46c7acdf-5e23-4b36-b0b5-ac754c255f2f","Type":"ContainerStarted","Data":"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b"} Dec 04 01:02:53.959887 master-0 kubenswrapper[33142]: I1204 01:02:53.959833 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:53.984745 master-0 kubenswrapper[33142]: I1204 01:02:53.984575 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" podStartSLOduration=3.9845493100000002 podStartE2EDuration="3.98454931s" podCreationTimestamp="2025-12-04 01:02:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:53.973428237 +0000 UTC m=+946.375430097" watchObservedRunningTime="2025-12-04 01:02:53.98454931 +0000 UTC m=+946.386551170" Dec 04 01:02:54.619158 master-0 kubenswrapper[33142]: W1204 01:02:54.619079 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb85754d3_7863_4c16_990b_78c0b7e606cb.slice/crio-a703449ba9ef99281e24c231fd16edbaf0fd215a55f88c421a68234a03704751 WatchSource:0}: Error finding container a703449ba9ef99281e24c231fd16edbaf0fd215a55f88c421a68234a03704751: Status 404 returned error can't find the container with id a703449ba9ef99281e24c231fd16edbaf0fd215a55f88c421a68234a03704751 Dec 04 01:02:54.619760 master-0 kubenswrapper[33142]: I1204 01:02:54.619604 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:02:54.956345 master-0 kubenswrapper[33142]: I1204 01:02:54.956264 33142 generic.go:334] "Generic (PLEG): container finished" podID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerID="df2c156d19ab20ebac6c59b03637b1374b4008beeb41981139f73cdaae8b0434" exitCode=0 Dec 04 01:02:54.956611 master-0 kubenswrapper[33142]: I1204 01:02:54.956585 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="dnsmasq-dns" containerID="cri-o://84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b" gracePeriod=10 Dec 04 01:02:54.958272 master-0 kubenswrapper[33142]: I1204 01:02:54.957856 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" event={"ID":"b85754d3-7863-4c16-990b-78c0b7e606cb","Type":"ContainerDied","Data":"df2c156d19ab20ebac6c59b03637b1374b4008beeb41981139f73cdaae8b0434"} Dec 04 01:02:54.958272 master-0 kubenswrapper[33142]: I1204 01:02:54.957894 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" event={"ID":"b85754d3-7863-4c16-990b-78c0b7e606cb","Type":"ContainerStarted","Data":"a703449ba9ef99281e24c231fd16edbaf0fd215a55f88c421a68234a03704751"} Dec 04 01:02:54.958272 master-0 kubenswrapper[33142]: I1204 01:02:54.957918 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:55.552135 master-0 kubenswrapper[33142]: I1204 01:02:55.552072 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:55.646167 master-0 kubenswrapper[33142]: I1204 01:02:55.646073 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.646167 master-0 kubenswrapper[33142]: I1204 01:02:55.646172 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw2hw\" (UniqueName: \"kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.647965 master-0 kubenswrapper[33142]: I1204 01:02:55.646226 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.647965 master-0 kubenswrapper[33142]: I1204 01:02:55.646272 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.647965 master-0 kubenswrapper[33142]: I1204 01:02:55.646306 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.647965 master-0 kubenswrapper[33142]: I1204 01:02:55.646419 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0\") pod \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\" (UID: \"46c7acdf-5e23-4b36-b0b5-ac754c255f2f\") " Dec 04 01:02:55.658297 master-0 kubenswrapper[33142]: I1204 01:02:55.658211 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw" (OuterVolumeSpecName: "kube-api-access-bw2hw") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "kube-api-access-bw2hw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:55.704302 master-0 kubenswrapper[33142]: I1204 01:02:55.704220 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:55.708607 master-0 kubenswrapper[33142]: I1204 01:02:55.708503 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:55.708779 master-0 kubenswrapper[33142]: I1204 01:02:55.708753 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:55.709756 master-0 kubenswrapper[33142]: I1204 01:02:55.709681 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:55.720114 master-0 kubenswrapper[33142]: I1204 01:02:55.719980 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config" (OuterVolumeSpecName: "config") pod "46c7acdf-5e23-4b36-b0b5-ac754c255f2f" (UID: "46c7acdf-5e23-4b36-b0b5-ac754c255f2f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:02:55.749963 master-0 kubenswrapper[33142]: I1204 01:02:55.749826 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.750235 master-0 kubenswrapper[33142]: I1204 01:02:55.750218 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bw2hw\" (UniqueName: \"kubernetes.io/projected/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-kube-api-access-bw2hw\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.750391 master-0 kubenswrapper[33142]: I1204 01:02:55.750381 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.750457 master-0 kubenswrapper[33142]: I1204 01:02:55.750446 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.750525 master-0 kubenswrapper[33142]: I1204 01:02:55.750513 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.750584 master-0 kubenswrapper[33142]: I1204 01:02:55.750574 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/46c7acdf-5e23-4b36-b0b5-ac754c255f2f-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:55.981684 master-0 kubenswrapper[33142]: I1204 01:02:55.981600 33142 generic.go:334] "Generic (PLEG): container finished" podID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerID="84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b" exitCode=0 Dec 04 01:02:55.981914 master-0 kubenswrapper[33142]: I1204 01:02:55.981709 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" Dec 04 01:02:55.981914 master-0 kubenswrapper[33142]: I1204 01:02:55.981705 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" event={"ID":"46c7acdf-5e23-4b36-b0b5-ac754c255f2f","Type":"ContainerDied","Data":"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b"} Dec 04 01:02:55.981914 master-0 kubenswrapper[33142]: I1204 01:02:55.981816 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67894fd4d5-kt7sx" event={"ID":"46c7acdf-5e23-4b36-b0b5-ac754c255f2f","Type":"ContainerDied","Data":"f147730ab08bd51175979923fe591cd68be87000f1f761c8c3fa8ca1b7c90822"} Dec 04 01:02:55.981914 master-0 kubenswrapper[33142]: I1204 01:02:55.981843 33142 scope.go:117] "RemoveContainer" containerID="84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b" Dec 04 01:02:55.995168 master-0 kubenswrapper[33142]: I1204 01:02:55.995100 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" event={"ID":"b85754d3-7863-4c16-990b-78c0b7e606cb","Type":"ContainerStarted","Data":"4c8105fbeb5f61d525680072c41356cc2a43d80d2295f3261b7d9861b0f5f526"} Dec 04 01:02:56.001039 master-0 kubenswrapper[33142]: I1204 01:02:55.995512 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:02:56.030283 master-0 kubenswrapper[33142]: I1204 01:02:56.030227 33142 scope.go:117] "RemoveContainer" containerID="617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95" Dec 04 01:02:56.031799 master-0 kubenswrapper[33142]: I1204 01:02:56.031746 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:56.055579 master-0 kubenswrapper[33142]: I1204 01:02:56.055527 33142 scope.go:117] "RemoveContainer" containerID="84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b" Dec 04 01:02:56.056175 master-0 kubenswrapper[33142]: E1204 01:02:56.056130 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b\": container with ID starting with 84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b not found: ID does not exist" containerID="84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b" Dec 04 01:02:56.056230 master-0 kubenswrapper[33142]: I1204 01:02:56.056194 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b"} err="failed to get container status \"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b\": rpc error: code = NotFound desc = could not find container \"84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b\": container with ID starting with 84df9a6a7fb43ec4d6c0d8401522220735877a8b3dda28fa7e9b1b165653918b not found: ID does not exist" Dec 04 01:02:56.056276 master-0 kubenswrapper[33142]: I1204 01:02:56.056230 33142 scope.go:117] "RemoveContainer" containerID="617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95" Dec 04 01:02:56.056379 master-0 kubenswrapper[33142]: I1204 01:02:56.056353 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-67894fd4d5-kt7sx"] Dec 04 01:02:56.056546 master-0 kubenswrapper[33142]: E1204 01:02:56.056520 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95\": container with ID starting with 617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95 not found: ID does not exist" containerID="617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95" Dec 04 01:02:56.056589 master-0 kubenswrapper[33142]: I1204 01:02:56.056542 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95"} err="failed to get container status \"617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95\": rpc error: code = NotFound desc = could not find container \"617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95\": container with ID starting with 617df57ac3940a91760d5f680bc4244c48dfce18baf0af39758752c02a98dd95 not found: ID does not exist" Dec 04 01:02:56.064657 master-0 kubenswrapper[33142]: I1204 01:02:56.064568 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" podStartSLOduration=3.0645455520000002 podStartE2EDuration="3.064545552s" podCreationTimestamp="2025-12-04 01:02:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:02:56.041704138 +0000 UTC m=+948.443706018" watchObservedRunningTime="2025-12-04 01:02:56.064545552 +0000 UTC m=+948.466547402" Dec 04 01:02:57.027504 master-0 kubenswrapper[33142]: I1204 01:02:57.027411 33142 generic.go:334] "Generic (PLEG): container finished" podID="bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" containerID="97406cf5455ed24c46eba551e7c329b83da958b3d731f40612c67eb2cf228234" exitCode=0 Dec 04 01:02:57.028505 master-0 kubenswrapper[33142]: I1204 01:02:57.027537 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-qbvdt" event={"ID":"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba","Type":"ContainerDied","Data":"97406cf5455ed24c46eba551e7c329b83da958b3d731f40612c67eb2cf228234"} Dec 04 01:02:57.913606 master-0 kubenswrapper[33142]: I1204 01:02:57.913498 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" path="/var/lib/kubelet/pods/46c7acdf-5e23-4b36-b0b5-ac754c255f2f/volumes" Dec 04 01:02:58.530578 master-0 kubenswrapper[33142]: I1204 01:02:58.530482 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:58.656757 master-0 kubenswrapper[33142]: I1204 01:02:58.656662 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgr7x\" (UniqueName: \"kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x\") pod \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " Dec 04 01:02:58.657118 master-0 kubenswrapper[33142]: I1204 01:02:58.656911 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle\") pod \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " Dec 04 01:02:58.657300 master-0 kubenswrapper[33142]: I1204 01:02:58.657210 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data\") pod \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\" (UID: \"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba\") " Dec 04 01:02:58.660397 master-0 kubenswrapper[33142]: I1204 01:02:58.660314 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x" (OuterVolumeSpecName: "kube-api-access-sgr7x") pod "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" (UID: "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba"). InnerVolumeSpecName "kube-api-access-sgr7x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:02:58.692294 master-0 kubenswrapper[33142]: I1204 01:02:58.692190 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" (UID: "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:58.723861 master-0 kubenswrapper[33142]: I1204 01:02:58.723769 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data" (OuterVolumeSpecName: "config-data") pod "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" (UID: "bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:02:58.760630 master-0 kubenswrapper[33142]: I1204 01:02:58.760556 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sgr7x\" (UniqueName: \"kubernetes.io/projected/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-kube-api-access-sgr7x\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:58.760630 master-0 kubenswrapper[33142]: I1204 01:02:58.760628 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:58.760809 master-0 kubenswrapper[33142]: I1204 01:02:58.760649 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:02:59.058256 master-0 kubenswrapper[33142]: I1204 01:02:59.058044 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-qbvdt" event={"ID":"bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba","Type":"ContainerDied","Data":"45d2c94e6b950802750c088183ad241521719876f98d0e208a288c37b7490c75"} Dec 04 01:02:59.058256 master-0 kubenswrapper[33142]: I1204 01:02:59.058115 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45d2c94e6b950802750c088183ad241521719876f98d0e208a288c37b7490c75" Dec 04 01:02:59.058256 master-0 kubenswrapper[33142]: I1204 01:02:59.058213 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-qbvdt" Dec 04 01:02:59.378815 master-0 kubenswrapper[33142]: I1204 01:02:59.376751 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:02:59.378815 master-0 kubenswrapper[33142]: I1204 01:02:59.377067 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="dnsmasq-dns" containerID="cri-o://4c8105fbeb5f61d525680072c41356cc2a43d80d2295f3261b7d9861b0f5f526" gracePeriod=10 Dec 04 01:02:59.479462 master-0 kubenswrapper[33142]: I1204 01:02:59.476370 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-bootstrap-tqvcl"] Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: E1204 01:02:59.479457 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="dnsmasq-dns" Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: I1204 01:02:59.479494 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="dnsmasq-dns" Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: E1204 01:02:59.479519 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="init" Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: I1204 01:02:59.479526 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="init" Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: E1204 01:02:59.479583 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" containerName="keystone-db-sync" Dec 04 01:02:59.479694 master-0 kubenswrapper[33142]: I1204 01:02:59.479595 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" containerName="keystone-db-sync" Dec 04 01:02:59.486117 master-0 kubenswrapper[33142]: I1204 01:02:59.480069 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" containerName="keystone-db-sync" Dec 04 01:02:59.486117 master-0 kubenswrapper[33142]: I1204 01:02:59.480137 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="46c7acdf-5e23-4b36-b0b5-ac754c255f2f" containerName="dnsmasq-dns" Dec 04 01:02:59.486117 master-0 kubenswrapper[33142]: I1204 01:02:59.481547 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.489615 master-0 kubenswrapper[33142]: I1204 01:02:59.488109 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 01:02:59.489615 master-0 kubenswrapper[33142]: I1204 01:02:59.488253 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 01:02:59.489615 master-0 kubenswrapper[33142]: I1204 01:02:59.488573 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 01:02:59.490828 master-0 kubenswrapper[33142]: I1204 01:02:59.490769 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.696750 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2sc\" (UniqueName: \"kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.696823 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.696876 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.696979 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.697030 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.697097 master-0 kubenswrapper[33142]: I1204 01:02:59.697066 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.705570 master-0 kubenswrapper[33142]: I1204 01:02:59.700825 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-tqvcl"] Dec 04 01:02:59.721407 master-0 kubenswrapper[33142]: I1204 01:02:59.721306 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:02:59.724717 master-0 kubenswrapper[33142]: I1204 01:02:59.724682 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.815413 master-0 kubenswrapper[33142]: I1204 01:02:59.814095 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2sc\" (UniqueName: \"kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.816115 master-0 kubenswrapper[33142]: I1204 01:02:59.815934 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.816962 master-0 kubenswrapper[33142]: I1204 01:02:59.816858 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.817787 master-0 kubenswrapper[33142]: I1204 01:02:59.817753 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.820878 master-0 kubenswrapper[33142]: I1204 01:02:59.820017 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.820878 master-0 kubenswrapper[33142]: I1204 01:02:59.820864 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.823016 master-0 kubenswrapper[33142]: I1204 01:02:59.822962 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.839634 master-0 kubenswrapper[33142]: I1204 01:02:59.828505 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.862207 master-0 kubenswrapper[33142]: I1204 01:02:59.862131 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.868165 master-0 kubenswrapper[33142]: I1204 01:02:59.867889 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2sc\" (UniqueName: \"kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.868661 master-0 kubenswrapper[33142]: I1204 01:02:59.868619 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.870022 master-0 kubenswrapper[33142]: I1204 01:02:59.869990 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys\") pod \"keystone-bootstrap-tqvcl\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:02:59.923920 master-0 kubenswrapper[33142]: I1204 01:02:59.923752 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.923920 master-0 kubenswrapper[33142]: I1204 01:02:59.923874 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.924187 master-0 kubenswrapper[33142]: I1204 01:02:59.923956 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.924187 master-0 kubenswrapper[33142]: I1204 01:02:59.923995 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2qm\" (UniqueName: \"kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.924187 master-0 kubenswrapper[33142]: I1204 01:02:59.924067 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.924187 master-0 kubenswrapper[33142]: I1204 01:02:59.924102 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:02:59.926104 master-0 kubenswrapper[33142]: I1204 01:02:59.926061 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:02:59.926170 master-0 kubenswrapper[33142]: I1204 01:02:59.926120 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-db-create-m84rq"] Dec 04 01:02:59.927697 master-0 kubenswrapper[33142]: I1204 01:02:59.927628 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-m84rq" Dec 04 01:02:59.954054 master-0 kubenswrapper[33142]: I1204 01:02:59.945397 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-m84rq"] Dec 04 01:02:59.954386 master-0 kubenswrapper[33142]: I1204 01:02:59.954345 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-db-sync-2gqvs"] Dec 04 01:02:59.958099 master-0 kubenswrapper[33142]: I1204 01:02:59.958061 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:02:59.983456 master-0 kubenswrapper[33142]: I1204 01:02:59.983398 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-config-data" Dec 04 01:02:59.983696 master-0 kubenswrapper[33142]: I1204 01:02:59.983602 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-scripts" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.025836 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.025984 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026028 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2qm\" (UniqueName: \"kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026131 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5h8g\" (UniqueName: \"kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026173 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026207 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026229 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.026640 master-0 kubenswrapper[33142]: I1204 01:03:00.026280 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.028703 master-0 kubenswrapper[33142]: I1204 01:03:00.027585 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.028703 master-0 kubenswrapper[33142]: I1204 01:03:00.028510 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.030744 master-0 kubenswrapper[33142]: I1204 01:03:00.030658 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.031259 master-0 kubenswrapper[33142]: I1204 01:03:00.031194 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.033085 master-0 kubenswrapper[33142]: I1204 01:03:00.032783 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.062844 master-0 kubenswrapper[33142]: I1204 01:03:00.062289 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-db-sync-2gqvs"] Dec 04 01:03:00.065235 master-0 kubenswrapper[33142]: I1204 01:03:00.063640 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:03:00.097407 master-0 kubenswrapper[33142]: I1204 01:03:00.097348 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2qm\" (UniqueName: \"kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm\") pod \"dnsmasq-dns-d6d5595cc-xs4fh\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.124956 master-0 kubenswrapper[33142]: I1204 01:03:00.114350 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129191 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129299 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129334 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9j9m\" (UniqueName: \"kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129393 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129467 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129491 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.129660 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p5h8g\" (UniqueName: \"kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.152853 master-0 kubenswrapper[33142]: I1204 01:03:00.133048 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.167770 master-0 kubenswrapper[33142]: I1204 01:03:00.167666 33142 generic.go:334] "Generic (PLEG): container finished" podID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerID="4c8105fbeb5f61d525680072c41356cc2a43d80d2295f3261b7d9861b0f5f526" exitCode=0 Dec 04 01:03:00.168056 master-0 kubenswrapper[33142]: I1204 01:03:00.167761 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" event={"ID":"b85754d3-7863-4c16-990b-78c0b7e606cb","Type":"ContainerDied","Data":"4c8105fbeb5f61d525680072c41356cc2a43d80d2295f3261b7d9861b0f5f526"} Dec 04 01:03:00.173026 master-0 kubenswrapper[33142]: I1204 01:03:00.172969 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-f3f8-account-create-update-fk7gt"] Dec 04 01:03:00.174781 master-0 kubenswrapper[33142]: I1204 01:03:00.174702 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.177991 master-0 kubenswrapper[33142]: I1204 01:03:00.177945 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-db-secret" Dec 04 01:03:00.217150 master-0 kubenswrapper[33142]: I1204 01:03:00.192627 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-db-sync-sm4dc"] Dec 04 01:03:00.217150 master-0 kubenswrapper[33142]: I1204 01:03:00.196587 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.217150 master-0 kubenswrapper[33142]: I1204 01:03:00.209993 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-f3f8-account-create-update-fk7gt"] Dec 04 01:03:00.217150 master-0 kubenswrapper[33142]: I1204 01:03:00.212477 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-config" Dec 04 01:03:00.217150 master-0 kubenswrapper[33142]: I1204 01:03:00.212494 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-httpd-config" Dec 04 01:03:00.226508 master-0 kubenswrapper[33142]: I1204 01:03:00.223410 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-sync-sm4dc"] Dec 04 01:03:00.226508 master-0 kubenswrapper[33142]: I1204 01:03:00.225130 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5h8g\" (UniqueName: \"kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g\") pod \"ironic-db-create-m84rq\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.252320 master-0 kubenswrapper[33142]: I1204 01:03:00.252256 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:03:00.254225 master-0 kubenswrapper[33142]: I1204 01:03:00.254192 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.254428 master-0 kubenswrapper[33142]: I1204 01:03:00.254401 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t9j9m\" (UniqueName: \"kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.254568 master-0 kubenswrapper[33142]: I1204 01:03:00.254549 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.254717 master-0 kubenswrapper[33142]: I1204 01:03:00.254699 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.254829 master-0 kubenswrapper[33142]: I1204 01:03:00.254812 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.254973 master-0 kubenswrapper[33142]: I1204 01:03:00.254951 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.255180 master-0 kubenswrapper[33142]: I1204 01:03:00.255158 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.261010 master-0 kubenswrapper[33142]: I1204 01:03:00.260916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.267098 master-0 kubenswrapper[33142]: I1204 01:03:00.267003 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.267806 master-0 kubenswrapper[33142]: I1204 01:03:00.267719 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.270888 master-0 kubenswrapper[33142]: I1204 01:03:00.270500 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.278322 master-0 kubenswrapper[33142]: I1204 01:03:00.278242 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9j9m\" (UniqueName: \"kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m\") pod \"cinder-10f14-db-sync-2gqvs\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.311950 master-0 kubenswrapper[33142]: I1204 01:03:00.300539 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:00.329487 master-0 kubenswrapper[33142]: I1204 01:03:00.329341 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:00.370477 master-0 kubenswrapper[33142]: I1204 01:03:00.370342 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.370477 master-0 kubenswrapper[33142]: I1204 01:03:00.370411 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzsp\" (UniqueName: \"kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.370477 master-0 kubenswrapper[33142]: I1204 01:03:00.370486 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.370477 master-0 kubenswrapper[33142]: I1204 01:03:00.370510 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfq6p\" (UniqueName: \"kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.371616 master-0 kubenswrapper[33142]: I1204 01:03:00.370550 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.406938 master-0 kubenswrapper[33142]: I1204 01:03:00.406859 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-db-sync-58zcd"] Dec 04 01:03:00.409562 master-0 kubenswrapper[33142]: I1204 01:03:00.409510 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.426614 master-0 kubenswrapper[33142]: I1204 01:03:00.426414 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-config-data" Dec 04 01:03:00.427333 master-0 kubenswrapper[33142]: I1204 01:03:00.427233 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-scripts" Dec 04 01:03:00.440015 master-0 kubenswrapper[33142]: I1204 01:03:00.439184 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-sync-58zcd"] Dec 04 01:03:00.472650 master-0 kubenswrapper[33142]: I1204 01:03:00.472588 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:00.474956 master-0 kubenswrapper[33142]: I1204 01:03:00.474698 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477577 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477703 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477723 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477889 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477969 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzsp\" (UniqueName: \"kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.477991 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6299\" (UniqueName: \"kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.478063 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.478138 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.478268 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.478314 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hfq6p\" (UniqueName: \"kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.480073 master-0 kubenswrapper[33142]: I1204 01:03:00.479297 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.488417 master-0 kubenswrapper[33142]: I1204 01:03:00.485600 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.498935 master-0 kubenswrapper[33142]: I1204 01:03:00.489793 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.505908 master-0 kubenswrapper[33142]: I1204 01:03:00.504361 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfq6p\" (UniqueName: \"kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p\") pod \"neutron-db-sync-sm4dc\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.507668 master-0 kubenswrapper[33142]: I1204 01:03:00.507605 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:00.517734 master-0 kubenswrapper[33142]: I1204 01:03:00.517526 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:03:00.554117 master-0 kubenswrapper[33142]: I1204 01:03:00.553439 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzsp\" (UniqueName: \"kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp\") pod \"ironic-f3f8-account-create-update-fk7gt\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586008 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m6299\" (UniqueName: \"kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586140 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586227 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586410 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586530 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.586823 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.590565 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.591059 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.593241 master-0 kubenswrapper[33142]: I1204 01:03:00.591914 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.611570 master-0 kubenswrapper[33142]: I1204 01:03:00.609486 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:00.665982 master-0 kubenswrapper[33142]: I1204 01:03:00.642315 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:00.669654 master-0 kubenswrapper[33142]: I1204 01:03:00.669564 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6299\" (UniqueName: \"kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299\") pod \"placement-db-sync-58zcd\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.687687 master-0 kubenswrapper[33142]: I1204 01:03:00.687516 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h94m\" (UniqueName: \"kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.687947 master-0 kubenswrapper[33142]: I1204 01:03:00.687775 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.687947 master-0 kubenswrapper[33142]: I1204 01:03:00.687854 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.688048 master-0 kubenswrapper[33142]: I1204 01:03:00.688016 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.688083 master-0 kubenswrapper[33142]: I1204 01:03:00.688055 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.688158 master-0 kubenswrapper[33142]: I1204 01:03:00.688134 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc\") pod \"b85754d3-7863-4c16-990b-78c0b7e606cb\" (UID: \"b85754d3-7863-4c16-990b-78c0b7e606cb\") " Dec 04 01:03:00.688469 master-0 kubenswrapper[33142]: I1204 01:03:00.688368 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.688469 master-0 kubenswrapper[33142]: I1204 01:03:00.688437 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8j5\" (UniqueName: \"kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.689055 master-0 kubenswrapper[33142]: I1204 01:03:00.688472 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.689055 master-0 kubenswrapper[33142]: I1204 01:03:00.688520 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.689055 master-0 kubenswrapper[33142]: I1204 01:03:00.688633 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.689055 master-0 kubenswrapper[33142]: I1204 01:03:00.688698 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.697900 master-0 kubenswrapper[33142]: I1204 01:03:00.697781 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m" (OuterVolumeSpecName: "kube-api-access-2h94m") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "kube-api-access-2h94m". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:00.791659 master-0 kubenswrapper[33142]: I1204 01:03:00.791398 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.792782 master-0 kubenswrapper[33142]: I1204 01:03:00.792010 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.792782 master-0 kubenswrapper[33142]: I1204 01:03:00.792110 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8j5\" (UniqueName: \"kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.792782 master-0 kubenswrapper[33142]: I1204 01:03:00.792152 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.792782 master-0 kubenswrapper[33142]: I1204 01:03:00.792206 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.792782 master-0 kubenswrapper[33142]: I1204 01:03:00.792368 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.793304 master-0 kubenswrapper[33142]: I1204 01:03:00.793275 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.793966 master-0 kubenswrapper[33142]: I1204 01:03:00.793908 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2h94m\" (UniqueName: \"kubernetes.io/projected/b85754d3-7863-4c16-990b-78c0b7e606cb-kube-api-access-2h94m\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.796367 master-0 kubenswrapper[33142]: I1204 01:03:00.794757 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.796367 master-0 kubenswrapper[33142]: I1204 01:03:00.795691 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.796367 master-0 kubenswrapper[33142]: I1204 01:03:00.796208 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.799610 master-0 kubenswrapper[33142]: I1204 01:03:00.798842 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:00.809939 master-0 kubenswrapper[33142]: I1204 01:03:00.809857 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:00.810952 master-0 kubenswrapper[33142]: I1204 01:03:00.810841 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config" (OuterVolumeSpecName: "config") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:00.812296 master-0 kubenswrapper[33142]: I1204 01:03:00.811976 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:00.818224 master-0 kubenswrapper[33142]: I1204 01:03:00.818114 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:00.834363 master-0 kubenswrapper[33142]: I1204 01:03:00.834289 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:00.841718 master-0 kubenswrapper[33142]: I1204 01:03:00.841622 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "b85754d3-7863-4c16-990b-78c0b7e606cb" (UID: "b85754d3-7863-4c16-990b-78c0b7e606cb"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:00.904758 master-0 kubenswrapper[33142]: I1204 01:03:00.901987 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.904758 master-0 kubenswrapper[33142]: I1204 01:03:00.902065 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.904758 master-0 kubenswrapper[33142]: I1204 01:03:00.902087 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.904758 master-0 kubenswrapper[33142]: I1204 01:03:00.902099 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.904758 master-0 kubenswrapper[33142]: I1204 01:03:00.902113 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b85754d3-7863-4c16-990b-78c0b7e606cb-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:00.952600 master-0 kubenswrapper[33142]: I1204 01:03:00.938366 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8j5\" (UniqueName: \"kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5\") pod \"dnsmasq-dns-7f7dc596c7-vmmgv\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:01.013539 master-0 kubenswrapper[33142]: I1204 01:03:01.013243 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-tqvcl"] Dec 04 01:03:01.098348 master-0 kubenswrapper[33142]: I1204 01:03:01.095592 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:01.123977 master-0 kubenswrapper[33142]: I1204 01:03:01.123804 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:03:01.217299 master-0 kubenswrapper[33142]: I1204 01:03:01.214054 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-db-sync-2gqvs"] Dec 04 01:03:01.235072 master-0 kubenswrapper[33142]: I1204 01:03:01.231866 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-m84rq"] Dec 04 01:03:01.235072 master-0 kubenswrapper[33142]: I1204 01:03:01.235021 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-tqvcl" event={"ID":"002873a6-d2d1-488e-abee-b4fe2f025bb8","Type":"ContainerStarted","Data":"b497abd876f1f5cef00c6bf05ea381ef2bd704308262dfa37b9a2ec4e5652bd8"} Dec 04 01:03:01.242793 master-0 kubenswrapper[33142]: I1204 01:03:01.240522 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" event={"ID":"51a34a29-1ea8-4146-b170-2f6e1051a3d9","Type":"ContainerStarted","Data":"dadbef9100b70587859c335ab877d73331ae5ffd10f14ec42a2bf02a8bc23627"} Dec 04 01:03:01.254871 master-0 kubenswrapper[33142]: I1204 01:03:01.254805 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" event={"ID":"b85754d3-7863-4c16-990b-78c0b7e606cb","Type":"ContainerDied","Data":"a703449ba9ef99281e24c231fd16edbaf0fd215a55f88c421a68234a03704751"} Dec 04 01:03:01.255076 master-0 kubenswrapper[33142]: I1204 01:03:01.254889 33142 scope.go:117] "RemoveContainer" containerID="4c8105fbeb5f61d525680072c41356cc2a43d80d2295f3261b7d9861b0f5f526" Dec 04 01:03:01.255133 master-0 kubenswrapper[33142]: I1204 01:03:01.255102 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798856cd8c-tqmbp" Dec 04 01:03:01.319958 master-0 kubenswrapper[33142]: I1204 01:03:01.319891 33142 scope.go:117] "RemoveContainer" containerID="df2c156d19ab20ebac6c59b03637b1374b4008beeb41981139f73cdaae8b0434" Dec 04 01:03:01.338279 master-0 kubenswrapper[33142]: I1204 01:03:01.338195 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:03:01.360184 master-0 kubenswrapper[33142]: I1204 01:03:01.358049 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-798856cd8c-tqmbp"] Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: I1204 01:03:01.687109 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: E1204 01:03:01.688158 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="init" Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: I1204 01:03:01.688180 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="init" Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: E1204 01:03:01.688204 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="dnsmasq-dns" Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: I1204 01:03:01.688211 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="dnsmasq-dns" Dec 04 01:03:01.690328 master-0 kubenswrapper[33142]: I1204 01:03:01.688626 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" containerName="dnsmasq-dns" Dec 04 01:03:01.696572 master-0 kubenswrapper[33142]: I1204 01:03:01.692991 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.700630 master-0 kubenswrapper[33142]: I1204 01:03:01.697257 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-internal-config-data" Dec 04 01:03:01.700630 master-0 kubenswrapper[33142]: I1204 01:03:01.697476 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-scripts" Dec 04 01:03:01.700630 master-0 kubenswrapper[33142]: I1204 01:03:01.697555 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Dec 04 01:03:01.708311 master-0 kubenswrapper[33142]: I1204 01:03:01.708258 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-sync-58zcd"] Dec 04 01:03:01.716721 master-0 kubenswrapper[33142]: I1204 01:03:01.716672 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-f3f8-account-create-update-fk7gt"] Dec 04 01:03:01.744160 master-0 kubenswrapper[33142]: I1204 01:03:01.742504 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:01.793251 master-0 kubenswrapper[33142]: I1204 01:03:01.788407 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-sync-sm4dc"] Dec 04 01:03:01.809874 master-0 kubenswrapper[33142]: I1204 01:03:01.809814 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832212 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832279 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832321 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832371 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832402 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832437 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832459 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxg7\" (UniqueName: \"kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.838011 master-0 kubenswrapper[33142]: I1204 01:03:01.832479 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.926590 master-0 kubenswrapper[33142]: I1204 01:03:01.926517 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85754d3-7863-4c16-990b-78c0b7e606cb" path="/var/lib/kubelet/pods/b85754d3-7863-4c16-990b-78c0b7e606cb/volumes" Dec 04 01:03:01.935306 master-0 kubenswrapper[33142]: I1204 01:03:01.935216 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.935306 master-0 kubenswrapper[33142]: I1204 01:03:01.935301 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.935455 master-0 kubenswrapper[33142]: I1204 01:03:01.935352 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.935455 master-0 kubenswrapper[33142]: I1204 01:03:01.935401 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.935455 master-0 kubenswrapper[33142]: I1204 01:03:01.935447 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938045 master-0 kubenswrapper[33142]: I1204 01:03:01.935484 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938045 master-0 kubenswrapper[33142]: I1204 01:03:01.936497 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938045 master-0 kubenswrapper[33142]: I1204 01:03:01.936424 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938045 master-0 kubenswrapper[33142]: I1204 01:03:01.936536 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxg7\" (UniqueName: \"kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938045 master-0 kubenswrapper[33142]: I1204 01:03:01.936626 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.938595 master-0 kubenswrapper[33142]: I1204 01:03:01.938552 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:03:01.938652 master-0 kubenswrapper[33142]: I1204 01:03:01.938604 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/f9bf544312b95af1c4795a85459fe1441801d5371397986d7a3e19188458ab2e/globalmount\"" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.942578 master-0 kubenswrapper[33142]: I1204 01:03:01.942245 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.942578 master-0 kubenswrapper[33142]: I1204 01:03:01.942478 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.947277 master-0 kubenswrapper[33142]: I1204 01:03:01.947220 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.947633 master-0 kubenswrapper[33142]: I1204 01:03:01.947598 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:01.964304 master-0 kubenswrapper[33142]: I1204 01:03:01.964254 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxg7\" (UniqueName: \"kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:02.270041 master-0 kubenswrapper[33142]: I1204 01:03:02.269771 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f3f8-account-create-update-fk7gt" event={"ID":"125375c7-fdde-48fe-a995-35943901b8ca","Type":"ContainerStarted","Data":"69e482f6507dd5f7bf668aed885ef133880be78077ec89b76b6d71d764493dab"} Dec 04 01:03:02.271607 master-0 kubenswrapper[33142]: I1204 01:03:02.271570 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-db-sync-2gqvs" event={"ID":"59dae1eb-04ee-4e59-b07a-d50dd95bbca5","Type":"ContainerStarted","Data":"caecf5cab41938c05da068d16f62248a39c4fb89a0f7cb40d54742f884282486"} Dec 04 01:03:02.273910 master-0 kubenswrapper[33142]: I1204 01:03:02.273867 33142 generic.go:334] "Generic (PLEG): container finished" podID="29205676-7f10-4874-915c-b51cb930c167" containerID="5a7dc8a2c839a793f49bcb27969212972c083d3d12d184f2c543c34c2b4cbaad" exitCode=0 Dec 04 01:03:02.274040 master-0 kubenswrapper[33142]: I1204 01:03:02.273918 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-m84rq" event={"ID":"29205676-7f10-4874-915c-b51cb930c167","Type":"ContainerDied","Data":"5a7dc8a2c839a793f49bcb27969212972c083d3d12d184f2c543c34c2b4cbaad"} Dec 04 01:03:02.274040 master-0 kubenswrapper[33142]: I1204 01:03:02.274034 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-m84rq" event={"ID":"29205676-7f10-4874-915c-b51cb930c167","Type":"ContainerStarted","Data":"4b347c58d861e48f1b8c44577a03269e01de76fa9036095c08fd9c485e8469c6"} Dec 04 01:03:02.276391 master-0 kubenswrapper[33142]: I1204 01:03:02.276353 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-58zcd" event={"ID":"2a2beb48-192c-4487-8d69-6f673f6b2902","Type":"ContainerStarted","Data":"6edfe1688099cbe48fa0e3213dd59fcffe098ea51e90e71cc4f640be7b6e221b"} Dec 04 01:03:02.278942 master-0 kubenswrapper[33142]: I1204 01:03:02.278888 33142 generic.go:334] "Generic (PLEG): container finished" podID="51a34a29-1ea8-4146-b170-2f6e1051a3d9" containerID="8baf6d434affa930ff405d978cf70718e74038cbe4842f86de5142d5d4324fc0" exitCode=0 Dec 04 01:03:02.279002 master-0 kubenswrapper[33142]: I1204 01:03:02.278972 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" event={"ID":"51a34a29-1ea8-4146-b170-2f6e1051a3d9","Type":"ContainerDied","Data":"8baf6d434affa930ff405d978cf70718e74038cbe4842f86de5142d5d4324fc0"} Dec 04 01:03:02.297679 master-0 kubenswrapper[33142]: I1204 01:03:02.297584 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-tqvcl" event={"ID":"002873a6-d2d1-488e-abee-b4fe2f025bb8","Type":"ContainerStarted","Data":"0e6dfaf27ac90b0f6ca2302ccd5cbbd9907078df503f3aee5d36e1230393fe3b"} Dec 04 01:03:02.302075 master-0 kubenswrapper[33142]: I1204 01:03:02.301713 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-sm4dc" event={"ID":"c88cf271-c65e-4b97-8145-3b27c194747c","Type":"ContainerStarted","Data":"02da6988eb800fc5c67cf24206caaf43ab9e1889c0f5e2dca39ac6b9dfddcf14"} Dec 04 01:03:02.310009 master-0 kubenswrapper[33142]: I1204 01:03:02.309891 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" event={"ID":"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2","Type":"ContainerStarted","Data":"a2b8d3b94367aee76b487f3f0a85762b8dd27c6c14dd4ed0ae8c9e22ccb85220"} Dec 04 01:03:02.343165 master-0 kubenswrapper[33142]: E1204 01:03:02.343060 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29205676_7f10_4874_915c_b51cb930c167.slice/crio-conmon-5a7dc8a2c839a793f49bcb27969212972c083d3d12d184f2c543c34c2b4cbaad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29205676_7f10_4874_915c_b51cb930c167.slice/crio-5a7dc8a2c839a793f49bcb27969212972c083d3d12d184f2c543c34c2b4cbaad.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:03:02.443078 master-0 kubenswrapper[33142]: I1204 01:03:02.442124 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-bootstrap-tqvcl" podStartSLOduration=3.441967222 podStartE2EDuration="3.441967222s" podCreationTimestamp="2025-12-04 01:02:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:02.435043977 +0000 UTC m=+954.837045837" watchObservedRunningTime="2025-12-04 01:03:02.441967222 +0000 UTC m=+954.843969082" Dec 04 01:03:02.883816 master-0 kubenswrapper[33142]: I1204 01:03:02.883750 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:02.913961 master-0 kubenswrapper[33142]: I1204 01:03:02.913866 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:02.915875 master-0 kubenswrapper[33142]: I1204 01:03:02.915825 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:02.939859 master-0 kubenswrapper[33142]: I1204 01:03:02.939723 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:02.975409 master-0 kubenswrapper[33142]: I1204 01:03:02.975364 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-external-config-data" Dec 04 01:03:02.976029 master-0 kubenswrapper[33142]: I1204 01:03:02.976012 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Dec 04 01:03:03.109185 master-0 kubenswrapper[33142]: I1204 01:03:03.109109 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.109455 master-0 kubenswrapper[33142]: I1204 01:03:03.109216 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.109455 master-0 kubenswrapper[33142]: I1204 01:03:03.109277 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.109547 master-0 kubenswrapper[33142]: I1204 01:03:03.109507 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.110052 master-0 kubenswrapper[33142]: I1204 01:03:03.109612 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.110052 master-0 kubenswrapper[33142]: I1204 01:03:03.109680 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g2qm\" (UniqueName: \"kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm\") pod \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\" (UID: \"51a34a29-1ea8-4146-b170-2f6e1051a3d9\") " Dec 04 01:03:03.110504 master-0 kubenswrapper[33142]: I1204 01:03:03.110472 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvdm\" (UniqueName: \"kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110566 master-0 kubenswrapper[33142]: I1204 01:03:03.110519 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110615 master-0 kubenswrapper[33142]: I1204 01:03:03.110594 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110707 master-0 kubenswrapper[33142]: I1204 01:03:03.110674 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110750 master-0 kubenswrapper[33142]: I1204 01:03:03.110716 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110785 master-0 kubenswrapper[33142]: I1204 01:03:03.110762 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110816 master-0 kubenswrapper[33142]: I1204 01:03:03.110785 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.110816 master-0 kubenswrapper[33142]: I1204 01:03:03.110810 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.126165 master-0 kubenswrapper[33142]: I1204 01:03:03.125910 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm" (OuterVolumeSpecName: "kube-api-access-8g2qm") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "kube-api-access-8g2qm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:03.138028 master-0 kubenswrapper[33142]: I1204 01:03:03.137899 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:03.138028 master-0 kubenswrapper[33142]: I1204 01:03:03.137923 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:03.144296 master-0 kubenswrapper[33142]: I1204 01:03:03.144210 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:03.149063 master-0 kubenswrapper[33142]: I1204 01:03:03.148997 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:03.152871 master-0 kubenswrapper[33142]: I1204 01:03:03.152791 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config" (OuterVolumeSpecName: "config") pod "51a34a29-1ea8-4146-b170-2f6e1051a3d9" (UID: "51a34a29-1ea8-4146-b170-2f6e1051a3d9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:03.213180 master-0 kubenswrapper[33142]: I1204 01:03:03.212993 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213180 master-0 kubenswrapper[33142]: I1204 01:03:03.213104 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213180 master-0 kubenswrapper[33142]: I1204 01:03:03.213175 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213468 master-0 kubenswrapper[33142]: I1204 01:03:03.213202 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213468 master-0 kubenswrapper[33142]: I1204 01:03:03.213228 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213468 master-0 kubenswrapper[33142]: I1204 01:03:03.213449 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvdm\" (UniqueName: \"kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213665 master-0 kubenswrapper[33142]: I1204 01:03:03.213483 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.213665 master-0 kubenswrapper[33142]: I1204 01:03:03.213559 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.214647 master-0 kubenswrapper[33142]: I1204 01:03:03.214592 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.214647 master-0 kubenswrapper[33142]: I1204 01:03:03.214625 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8g2qm\" (UniqueName: \"kubernetes.io/projected/51a34a29-1ea8-4146-b170-2f6e1051a3d9-kube-api-access-8g2qm\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.214647 master-0 kubenswrapper[33142]: I1204 01:03:03.214643 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.214801 master-0 kubenswrapper[33142]: I1204 01:03:03.214657 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.214801 master-0 kubenswrapper[33142]: I1204 01:03:03.214675 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.214801 master-0 kubenswrapper[33142]: I1204 01:03:03.214688 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/51a34a29-1ea8-4146-b170-2f6e1051a3d9-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:03.215209 master-0 kubenswrapper[33142]: I1204 01:03:03.215144 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.215324 master-0 kubenswrapper[33142]: I1204 01:03:03.215286 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.215454 master-0 kubenswrapper[33142]: I1204 01:03:03.215420 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:03:03.215503 master-0 kubenswrapper[33142]: I1204 01:03:03.215462 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0d3ec47f3a51dd89bb2d1678494217721404d4aff31f2dde3036a53713dd9006/globalmount\"" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.219397 master-0 kubenswrapper[33142]: I1204 01:03:03.219182 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.219953 master-0 kubenswrapper[33142]: I1204 01:03:03.219872 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.221164 master-0 kubenswrapper[33142]: I1204 01:03:03.221127 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.224093 master-0 kubenswrapper[33142]: I1204 01:03:03.223991 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.235183 master-0 kubenswrapper[33142]: I1204 01:03:03.235121 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvdm\" (UniqueName: \"kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:03.335856 master-0 kubenswrapper[33142]: I1204 01:03:03.335779 33142 generic.go:334] "Generic (PLEG): container finished" podID="125375c7-fdde-48fe-a995-35943901b8ca" containerID="dfc658322c3522148f451458560f615c07f8acba09c6466b8378985bc947fe8f" exitCode=0 Dec 04 01:03:03.335856 master-0 kubenswrapper[33142]: I1204 01:03:03.335873 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f3f8-account-create-update-fk7gt" event={"ID":"125375c7-fdde-48fe-a995-35943901b8ca","Type":"ContainerDied","Data":"dfc658322c3522148f451458560f615c07f8acba09c6466b8378985bc947fe8f"} Dec 04 01:03:03.349919 master-0 kubenswrapper[33142]: I1204 01:03:03.349832 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" event={"ID":"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2","Type":"ContainerDied","Data":"1ea58279fa62fdfdf1596dd46d4b465ef6cfc0f3bbbf920b0146b76ae883ff71"} Dec 04 01:03:03.351082 master-0 kubenswrapper[33142]: I1204 01:03:03.351015 33142 generic.go:334] "Generic (PLEG): container finished" podID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerID="1ea58279fa62fdfdf1596dd46d4b465ef6cfc0f3bbbf920b0146b76ae883ff71" exitCode=0 Dec 04 01:03:03.361968 master-0 kubenswrapper[33142]: I1204 01:03:03.361901 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" Dec 04 01:03:03.362944 master-0 kubenswrapper[33142]: I1204 01:03:03.361900 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-d6d5595cc-xs4fh" event={"ID":"51a34a29-1ea8-4146-b170-2f6e1051a3d9","Type":"ContainerDied","Data":"dadbef9100b70587859c335ab877d73331ae5ffd10f14ec42a2bf02a8bc23627"} Dec 04 01:03:03.363010 master-0 kubenswrapper[33142]: I1204 01:03:03.362961 33142 scope.go:117] "RemoveContainer" containerID="8baf6d434affa930ff405d978cf70718e74038cbe4842f86de5142d5d4324fc0" Dec 04 01:03:03.365953 master-0 kubenswrapper[33142]: I1204 01:03:03.365750 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-sm4dc" event={"ID":"c88cf271-c65e-4b97-8145-3b27c194747c","Type":"ContainerStarted","Data":"2fe812c39cd76ac5b0fe8b278f98c8b8cb5339ce17113c310010895eee019184"} Dec 04 01:03:03.499648 master-0 kubenswrapper[33142]: I1204 01:03:03.499252 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-db-sync-sm4dc" podStartSLOduration=4.499228825 podStartE2EDuration="4.499228825s" podCreationTimestamp="2025-12-04 01:02:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:03.417062519 +0000 UTC m=+955.819064389" watchObservedRunningTime="2025-12-04 01:03:03.499228825 +0000 UTC m=+955.901230685" Dec 04 01:03:03.547582 master-0 kubenswrapper[33142]: I1204 01:03:03.547483 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:03:03.561954 master-0 kubenswrapper[33142]: I1204 01:03:03.558813 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-d6d5595cc-xs4fh"] Dec 04 01:03:03.635557 master-0 kubenswrapper[33142]: I1204 01:03:03.635506 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:03.912372 master-0 kubenswrapper[33142]: I1204 01:03:03.912314 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a34a29-1ea8-4146-b170-2f6e1051a3d9" path="/var/lib/kubelet/pods/51a34a29-1ea8-4146-b170-2f6e1051a3d9/volumes" Dec 04 01:03:03.916979 master-0 kubenswrapper[33142]: I1204 01:03:03.916668 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:04.074652 master-0 kubenswrapper[33142]: I1204 01:03:04.074588 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:04.168034 master-0 kubenswrapper[33142]: I1204 01:03:04.167877 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:04.170117 master-0 kubenswrapper[33142]: E1204 01:03:04.170023 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[glance], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/glance-10f14-default-external-api-0" podUID="867792c1-c9b0-4963-b6d6-c76f36029297" Dec 04 01:03:04.238742 master-0 kubenswrapper[33142]: I1204 01:03:04.237992 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts\") pod \"29205676-7f10-4874-915c-b51cb930c167\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " Dec 04 01:03:04.238742 master-0 kubenswrapper[33142]: I1204 01:03:04.238159 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5h8g\" (UniqueName: \"kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g\") pod \"29205676-7f10-4874-915c-b51cb930c167\" (UID: \"29205676-7f10-4874-915c-b51cb930c167\") " Dec 04 01:03:04.239795 master-0 kubenswrapper[33142]: I1204 01:03:04.239694 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "29205676-7f10-4874-915c-b51cb930c167" (UID: "29205676-7f10-4874-915c-b51cb930c167"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:04.252752 master-0 kubenswrapper[33142]: I1204 01:03:04.250700 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g" (OuterVolumeSpecName: "kube-api-access-p5h8g") pod "29205676-7f10-4874-915c-b51cb930c167" (UID: "29205676-7f10-4874-915c-b51cb930c167"). InnerVolumeSpecName "kube-api-access-p5h8g". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:04.261695 master-0 kubenswrapper[33142]: I1204 01:03:04.261617 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29205676-7f10-4874-915c-b51cb930c167-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.261695 master-0 kubenswrapper[33142]: I1204 01:03:04.261686 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p5h8g\" (UniqueName: \"kubernetes.io/projected/29205676-7f10-4874-915c-b51cb930c167-kube-api-access-p5h8g\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.379545 master-0 kubenswrapper[33142]: I1204 01:03:04.379145 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:04.411966 master-0 kubenswrapper[33142]: I1204 01:03:04.411120 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" event={"ID":"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2","Type":"ContainerStarted","Data":"8a4a32a68918c7c2c02dc4f9e4b1a913c917e1d22cd9c29e85df0da93e47f23b"} Dec 04 01:03:04.424028 master-0 kubenswrapper[33142]: I1204 01:03:04.423592 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:04.443715 master-0 kubenswrapper[33142]: I1204 01:03:04.443624 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-m84rq" event={"ID":"29205676-7f10-4874-915c-b51cb930c167","Type":"ContainerDied","Data":"4b347c58d861e48f1b8c44577a03269e01de76fa9036095c08fd9c485e8469c6"} Dec 04 01:03:04.443715 master-0 kubenswrapper[33142]: I1204 01:03:04.443716 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b347c58d861e48f1b8c44577a03269e01de76fa9036095c08fd9c485e8469c6" Dec 04 01:03:04.444459 master-0 kubenswrapper[33142]: I1204 01:03:04.443859 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-m84rq" Dec 04 01:03:04.561559 master-0 kubenswrapper[33142]: I1204 01:03:04.559758 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:04.576526 master-0 kubenswrapper[33142]: I1204 01:03:04.572483 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" podStartSLOduration=4.572455888 podStartE2EDuration="4.572455888s" podCreationTimestamp="2025-12-04 01:03:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:04.570680798 +0000 UTC m=+956.972682648" watchObservedRunningTime="2025-12-04 01:03:04.572455888 +0000 UTC m=+956.974457738" Dec 04 01:03:04.595546 master-0 kubenswrapper[33142]: I1204 01:03:04.592963 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:04.652910 master-0 kubenswrapper[33142]: I1204 01:03:04.652834 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653234 master-0 kubenswrapper[33142]: I1204 01:03:04.652913 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653234 master-0 kubenswrapper[33142]: I1204 01:03:04.653165 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzvdm\" (UniqueName: \"kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653304 master-0 kubenswrapper[33142]: I1204 01:03:04.653253 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653304 master-0 kubenswrapper[33142]: I1204 01:03:04.653299 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653391 master-0 kubenswrapper[33142]: I1204 01:03:04.653325 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653391 master-0 kubenswrapper[33142]: I1204 01:03:04.653376 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:04.653819 master-0 kubenswrapper[33142]: I1204 01:03:04.653248 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:04.654058 master-0 kubenswrapper[33142]: I1204 01:03:04.654029 33142 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.658065 master-0 kubenswrapper[33142]: I1204 01:03:04.657613 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs" (OuterVolumeSpecName: "logs") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:04.658065 master-0 kubenswrapper[33142]: I1204 01:03:04.657845 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:04.658820 master-0 kubenswrapper[33142]: I1204 01:03:04.658720 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:04.664254 master-0 kubenswrapper[33142]: I1204 01:03:04.662235 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts" (OuterVolumeSpecName: "scripts") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:04.664254 master-0 kubenswrapper[33142]: I1204 01:03:04.662409 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm" (OuterVolumeSpecName: "kube-api-access-pzvdm") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "kube-api-access-pzvdm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:04.666104 master-0 kubenswrapper[33142]: I1204 01:03:04.666064 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data" (OuterVolumeSpecName: "config-data") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:04.748691 master-0 kubenswrapper[33142]: I1204 01:03:04.748569 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:04.756093 master-0 kubenswrapper[33142]: I1204 01:03:04.756016 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.756093 master-0 kubenswrapper[33142]: I1204 01:03:04.756085 33142 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-public-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.756293 master-0 kubenswrapper[33142]: I1204 01:03:04.756102 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pzvdm\" (UniqueName: \"kubernetes.io/projected/867792c1-c9b0-4963-b6d6-c76f36029297-kube-api-access-pzvdm\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.756293 master-0 kubenswrapper[33142]: I1204 01:03:04.756116 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.756293 master-0 kubenswrapper[33142]: I1204 01:03:04.756128 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867792c1-c9b0-4963-b6d6-c76f36029297-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.756293 master-0 kubenswrapper[33142]: I1204 01:03:04.756140 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/867792c1-c9b0-4963-b6d6-c76f36029297-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:04.768182 master-0 kubenswrapper[33142]: W1204 01:03:04.764222 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f27bedc_f064_4fd2_bc9c_807a44cd377f.slice/crio-4e762fa6814aef883241e08e82abae82fa246a745d8b17e4d938d8b5267732a4 WatchSource:0}: Error finding container 4e762fa6814aef883241e08e82abae82fa246a745d8b17e4d938d8b5267732a4: Status 404 returned error can't find the container with id 4e762fa6814aef883241e08e82abae82fa246a745d8b17e4d938d8b5267732a4 Dec 04 01:03:05.057094 master-0 kubenswrapper[33142]: I1204 01:03:05.057004 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:05.060318 master-0 kubenswrapper[33142]: I1204 01:03:05.060258 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.070727 master-0 kubenswrapper[33142]: I1204 01:03:05.070649 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts\") pod \"125375c7-fdde-48fe-a995-35943901b8ca\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " Dec 04 01:03:05.093361 master-0 kubenswrapper[33142]: I1204 01:03:05.070811 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzsp\" (UniqueName: \"kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp\") pod \"125375c7-fdde-48fe-a995-35943901b8ca\" (UID: \"125375c7-fdde-48fe-a995-35943901b8ca\") " Dec 04 01:03:05.093361 master-0 kubenswrapper[33142]: I1204 01:03:05.071055 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"867792c1-c9b0-4963-b6d6-c76f36029297\" (UID: \"867792c1-c9b0-4963-b6d6-c76f36029297\") " Dec 04 01:03:05.093361 master-0 kubenswrapper[33142]: I1204 01:03:05.072071 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "125375c7-fdde-48fe-a995-35943901b8ca" (UID: "125375c7-fdde-48fe-a995-35943901b8ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:05.093361 master-0 kubenswrapper[33142]: I1204 01:03:05.075422 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp" (OuterVolumeSpecName: "kube-api-access-qpzsp") pod "125375c7-fdde-48fe-a995-35943901b8ca" (UID: "125375c7-fdde-48fe-a995-35943901b8ca"). InnerVolumeSpecName "kube-api-access-qpzsp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:05.105823 master-0 kubenswrapper[33142]: I1204 01:03:05.101001 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9" (OuterVolumeSpecName: "glance") pod "867792c1-c9b0-4963-b6d6-c76f36029297" (UID: "867792c1-c9b0-4963-b6d6-c76f36029297"). InnerVolumeSpecName "pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 01:03:05.173426 master-0 kubenswrapper[33142]: I1204 01:03:05.173220 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qpzsp\" (UniqueName: \"kubernetes.io/projected/125375c7-fdde-48fe-a995-35943901b8ca-kube-api-access-qpzsp\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:05.173426 master-0 kubenswrapper[33142]: I1204 01:03:05.173323 33142 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") on node \"master-0\" " Dec 04 01:03:05.173426 master-0 kubenswrapper[33142]: I1204 01:03:05.173336 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/125375c7-fdde-48fe-a995-35943901b8ca-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:05.223814 master-0 kubenswrapper[33142]: I1204 01:03:05.223739 33142 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 01:03:05.224179 master-0 kubenswrapper[33142]: I1204 01:03:05.224017 33142 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102" (UniqueName: "kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9") on node "master-0" Dec 04 01:03:05.275435 master-0 kubenswrapper[33142]: I1204 01:03:05.275241 33142 reconciler_common.go:293] "Volume detached for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:05.576789 master-0 kubenswrapper[33142]: I1204 01:03:05.576688 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerStarted","Data":"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd"} Dec 04 01:03:05.576789 master-0 kubenswrapper[33142]: I1204 01:03:05.576776 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerStarted","Data":"4e762fa6814aef883241e08e82abae82fa246a745d8b17e4d938d8b5267732a4"} Dec 04 01:03:05.578502 master-0 kubenswrapper[33142]: I1204 01:03:05.578437 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f3f8-account-create-update-fk7gt" event={"ID":"125375c7-fdde-48fe-a995-35943901b8ca","Type":"ContainerDied","Data":"69e482f6507dd5f7bf668aed885ef133880be78077ec89b76b6d71d764493dab"} Dec 04 01:03:05.578577 master-0 kubenswrapper[33142]: I1204 01:03:05.578519 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69e482f6507dd5f7bf668aed885ef133880be78077ec89b76b6d71d764493dab" Dec 04 01:03:05.578721 master-0 kubenswrapper[33142]: I1204 01:03:05.578698 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f3f8-account-create-update-fk7gt" Dec 04 01:03:05.578846 master-0 kubenswrapper[33142]: I1204 01:03:05.578827 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.663811 master-0 kubenswrapper[33142]: I1204 01:03:05.663725 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:05.679032 master-0 kubenswrapper[33142]: I1204 01:03:05.678916 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:05.729635 master-0 kubenswrapper[33142]: I1204 01:03:05.728008 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:05.729977 master-0 kubenswrapper[33142]: E1204 01:03:05.729952 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51a34a29-1ea8-4146-b170-2f6e1051a3d9" containerName="init" Dec 04 01:03:05.730040 master-0 kubenswrapper[33142]: I1204 01:03:05.729978 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a34a29-1ea8-4146-b170-2f6e1051a3d9" containerName="init" Dec 04 01:03:05.730193 master-0 kubenswrapper[33142]: E1204 01:03:05.730174 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="125375c7-fdde-48fe-a995-35943901b8ca" containerName="mariadb-account-create-update" Dec 04 01:03:05.730193 master-0 kubenswrapper[33142]: I1204 01:03:05.730192 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="125375c7-fdde-48fe-a995-35943901b8ca" containerName="mariadb-account-create-update" Dec 04 01:03:05.730543 master-0 kubenswrapper[33142]: E1204 01:03:05.730513 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29205676-7f10-4874-915c-b51cb930c167" containerName="mariadb-database-create" Dec 04 01:03:05.730735 master-0 kubenswrapper[33142]: I1204 01:03:05.730716 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="29205676-7f10-4874-915c-b51cb930c167" containerName="mariadb-database-create" Dec 04 01:03:05.731275 master-0 kubenswrapper[33142]: I1204 01:03:05.731253 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="125375c7-fdde-48fe-a995-35943901b8ca" containerName="mariadb-account-create-update" Dec 04 01:03:05.731448 master-0 kubenswrapper[33142]: I1204 01:03:05.731425 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="29205676-7f10-4874-915c-b51cb930c167" containerName="mariadb-database-create" Dec 04 01:03:05.731962 master-0 kubenswrapper[33142]: I1204 01:03:05.731575 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="51a34a29-1ea8-4146-b170-2f6e1051a3d9" containerName="init" Dec 04 01:03:05.737876 master-0 kubenswrapper[33142]: I1204 01:03:05.734251 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.739345 master-0 kubenswrapper[33142]: I1204 01:03:05.739239 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Dec 04 01:03:05.739430 master-0 kubenswrapper[33142]: I1204 01:03:05.739386 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-external-config-data" Dec 04 01:03:05.799301 master-0 kubenswrapper[33142]: I1204 01:03:05.799247 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:05.821572 master-0 kubenswrapper[33142]: I1204 01:03:05.821491 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.821794 master-0 kubenswrapper[33142]: I1204 01:03:05.821588 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.821794 master-0 kubenswrapper[33142]: I1204 01:03:05.821622 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.821794 master-0 kubenswrapper[33142]: I1204 01:03:05.821674 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.824142 master-0 kubenswrapper[33142]: I1204 01:03:05.821852 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nqhn\" (UniqueName: \"kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.824142 master-0 kubenswrapper[33142]: I1204 01:03:05.822065 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.824142 master-0 kubenswrapper[33142]: I1204 01:03:05.822241 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.824142 master-0 kubenswrapper[33142]: I1204 01:03:05.822451 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.913167 master-0 kubenswrapper[33142]: I1204 01:03:05.913103 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867792c1-c9b0-4963-b6d6-c76f36029297" path="/var/lib/kubelet/pods/867792c1-c9b0-4963-b6d6-c76f36029297/volumes" Dec 04 01:03:05.925178 master-0 kubenswrapper[33142]: I1204 01:03:05.925113 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.925450 master-0 kubenswrapper[33142]: I1204 01:03:05.925431 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.925591 master-0 kubenswrapper[33142]: I1204 01:03:05.925575 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.925699 master-0 kubenswrapper[33142]: I1204 01:03:05.925681 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7nqhn\" (UniqueName: \"kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926016 master-0 kubenswrapper[33142]: I1204 01:03:05.925995 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926160 master-0 kubenswrapper[33142]: I1204 01:03:05.926141 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926313 master-0 kubenswrapper[33142]: I1204 01:03:05.926293 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926418 master-0 kubenswrapper[33142]: I1204 01:03:05.926314 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926596 master-0 kubenswrapper[33142]: I1204 01:03:05.926558 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.926659 master-0 kubenswrapper[33142]: I1204 01:03:05.926597 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.930649 master-0 kubenswrapper[33142]: I1204 01:03:05.930604 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:03:05.930735 master-0 kubenswrapper[33142]: I1204 01:03:05.930667 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0d3ec47f3a51dd89bb2d1678494217721404d4aff31f2dde3036a53713dd9006/globalmount\"" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.931842 master-0 kubenswrapper[33142]: I1204 01:03:05.931795 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.932597 master-0 kubenswrapper[33142]: I1204 01:03:05.932575 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.932713 master-0 kubenswrapper[33142]: I1204 01:03:05.932578 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.947955 master-0 kubenswrapper[33142]: I1204 01:03:05.939840 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:05.966952 master-0 kubenswrapper[33142]: I1204 01:03:05.959702 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nqhn\" (UniqueName: \"kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:06.609618 master-0 kubenswrapper[33142]: I1204 01:03:06.609550 33142 generic.go:334] "Generic (PLEG): container finished" podID="002873a6-d2d1-488e-abee-b4fe2f025bb8" containerID="0e6dfaf27ac90b0f6ca2302ccd5cbbd9907078df503f3aee5d36e1230393fe3b" exitCode=0 Dec 04 01:03:06.610172 master-0 kubenswrapper[33142]: I1204 01:03:06.609668 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-tqvcl" event={"ID":"002873a6-d2d1-488e-abee-b4fe2f025bb8","Type":"ContainerDied","Data":"0e6dfaf27ac90b0f6ca2302ccd5cbbd9907078df503f3aee5d36e1230393fe3b"} Dec 04 01:03:07.192022 master-0 kubenswrapper[33142]: I1204 01:03:07.191971 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:07.274842 master-0 kubenswrapper[33142]: I1204 01:03:07.274753 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:08.248201 master-0 kubenswrapper[33142]: I1204 01:03:08.248105 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:03:08.325769 master-0 kubenswrapper[33142]: I1204 01:03:08.325678 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.325942 master-0 kubenswrapper[33142]: I1204 01:03:08.325839 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.326009 master-0 kubenswrapper[33142]: I1204 01:03:08.325994 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.326105 master-0 kubenswrapper[33142]: I1204 01:03:08.326072 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.326373 master-0 kubenswrapper[33142]: I1204 01:03:08.326321 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.326645 master-0 kubenswrapper[33142]: I1204 01:03:08.326616 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq2sc\" (UniqueName: \"kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc\") pod \"002873a6-d2d1-488e-abee-b4fe2f025bb8\" (UID: \"002873a6-d2d1-488e-abee-b4fe2f025bb8\") " Dec 04 01:03:08.329634 master-0 kubenswrapper[33142]: I1204 01:03:08.329559 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts" (OuterVolumeSpecName: "scripts") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:08.332499 master-0 kubenswrapper[33142]: I1204 01:03:08.332415 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc" (OuterVolumeSpecName: "kube-api-access-kq2sc") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "kube-api-access-kq2sc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:08.332862 master-0 kubenswrapper[33142]: I1204 01:03:08.332778 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:08.333418 master-0 kubenswrapper[33142]: I1204 01:03:08.333373 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:08.373642 master-0 kubenswrapper[33142]: I1204 01:03:08.373565 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:08.419206 master-0 kubenswrapper[33142]: I1204 01:03:08.404700 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data" (OuterVolumeSpecName: "config-data") pod "002873a6-d2d1-488e-abee-b4fe2f025bb8" (UID: "002873a6-d2d1-488e-abee-b4fe2f025bb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:08.429624 master-0 kubenswrapper[33142]: I1204 01:03:08.429556 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.429624 master-0 kubenswrapper[33142]: I1204 01:03:08.429611 33142 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-credential-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.429624 master-0 kubenswrapper[33142]: I1204 01:03:08.429626 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.429624 master-0 kubenswrapper[33142]: I1204 01:03:08.429635 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.429901 master-0 kubenswrapper[33142]: I1204 01:03:08.429644 33142 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/002873a6-d2d1-488e-abee-b4fe2f025bb8-fernet-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.429901 master-0 kubenswrapper[33142]: I1204 01:03:08.429657 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kq2sc\" (UniqueName: \"kubernetes.io/projected/002873a6-d2d1-488e-abee-b4fe2f025bb8-kube-api-access-kq2sc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:08.597482 master-0 kubenswrapper[33142]: I1204 01:03:08.597393 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:03:08.662664 master-0 kubenswrapper[33142]: I1204 01:03:08.662564 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-tqvcl" Dec 04 01:03:08.664141 master-0 kubenswrapper[33142]: I1204 01:03:08.664040 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-tqvcl" event={"ID":"002873a6-d2d1-488e-abee-b4fe2f025bb8","Type":"ContainerDied","Data":"b497abd876f1f5cef00c6bf05ea381ef2bd704308262dfa37b9a2ec4e5652bd8"} Dec 04 01:03:08.664255 master-0 kubenswrapper[33142]: I1204 01:03:08.664135 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b497abd876f1f5cef00c6bf05ea381ef2bd704308262dfa37b9a2ec4e5652bd8" Dec 04 01:03:08.666101 master-0 kubenswrapper[33142]: I1204 01:03:08.666043 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-58zcd" event={"ID":"2a2beb48-192c-4487-8d69-6f673f6b2902","Type":"ContainerStarted","Data":"553b25d966bb2fca72ed90c996b55eeb4147aad9853d8a7cf2abbf172ad44faf"} Dec 04 01:03:08.671542 master-0 kubenswrapper[33142]: I1204 01:03:08.671443 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerStarted","Data":"64c9b3eb48d0436afaa50415ad865b5538c7e453862ae60cbfbc946882abbe4c"} Dec 04 01:03:08.708955 master-0 kubenswrapper[33142]: I1204 01:03:08.696748 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-db-sync-58zcd" podStartSLOduration=2.451925152 podStartE2EDuration="8.696715345s" podCreationTimestamp="2025-12-04 01:03:00 +0000 UTC" firstStartedPulling="2025-12-04 01:03:01.801905835 +0000 UTC m=+954.203907685" lastFinishedPulling="2025-12-04 01:03:08.046696028 +0000 UTC m=+960.448697878" observedRunningTime="2025-12-04 01:03:08.69048401 +0000 UTC m=+961.092485870" watchObservedRunningTime="2025-12-04 01:03:08.696715345 +0000 UTC m=+961.098717205" Dec 04 01:03:09.060129 master-0 kubenswrapper[33142]: I1204 01:03:09.059990 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-bootstrap-tqvcl"] Dec 04 01:03:09.080550 master-0 kubenswrapper[33142]: I1204 01:03:09.072819 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-bootstrap-tqvcl"] Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.540752 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-bootstrap-lkjzz"] Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: E1204 01:03:09.541425 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="002873a6-d2d1-488e-abee-b4fe2f025bb8" containerName="keystone-bootstrap" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.541442 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="002873a6-d2d1-488e-abee-b4fe2f025bb8" containerName="keystone-bootstrap" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.541670 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="002873a6-d2d1-488e-abee-b4fe2f025bb8" containerName="keystone-bootstrap" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.542648 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.545040 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.546122 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.546270 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 01:03:09.549211 master-0 kubenswrapper[33142]: I1204 01:03:09.547213 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 01:03:09.570303 master-0 kubenswrapper[33142]: I1204 01:03:09.570239 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-lkjzz"] Dec 04 01:03:09.670808 master-0 kubenswrapper[33142]: I1204 01:03:09.670720 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.671082 master-0 kubenswrapper[33142]: I1204 01:03:09.670858 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.671082 master-0 kubenswrapper[33142]: I1204 01:03:09.670906 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgkzt\" (UniqueName: \"kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.671082 master-0 kubenswrapper[33142]: I1204 01:03:09.670963 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.671082 master-0 kubenswrapper[33142]: I1204 01:03:09.670991 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.671082 master-0 kubenswrapper[33142]: I1204 01:03:09.671050 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.695036 master-0 kubenswrapper[33142]: I1204 01:03:09.694948 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerStarted","Data":"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792"} Dec 04 01:03:09.695360 master-0 kubenswrapper[33142]: I1204 01:03:09.695126 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-internal-api-0" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-log" containerID="cri-o://6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" gracePeriod=30 Dec 04 01:03:09.697509 master-0 kubenswrapper[33142]: I1204 01:03:09.697417 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-internal-api-0" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-httpd" containerID="cri-o://b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" gracePeriod=30 Dec 04 01:03:09.701652 master-0 kubenswrapper[33142]: I1204 01:03:09.701557 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerStarted","Data":"78446d3325aec54ecb3e60f698657f74182c8fe8aa8837352b71aa034a22f212"} Dec 04 01:03:09.751496 master-0 kubenswrapper[33142]: I1204 01:03:09.751393 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-10f14-default-internal-api-0" podStartSLOduration=10.751361674 podStartE2EDuration="10.751361674s" podCreationTimestamp="2025-12-04 01:02:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:09.728233042 +0000 UTC m=+962.130234902" watchObservedRunningTime="2025-12-04 01:03:09.751361674 +0000 UTC m=+962.153363524" Dec 04 01:03:09.773699 master-0 kubenswrapper[33142]: I1204 01:03:09.773581 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.773699 master-0 kubenswrapper[33142]: I1204 01:03:09.773689 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.774025 master-0 kubenswrapper[33142]: I1204 01:03:09.773788 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.774096 master-0 kubenswrapper[33142]: I1204 01:03:09.774071 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.774257 master-0 kubenswrapper[33142]: I1204 01:03:09.774222 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.774316 master-0 kubenswrapper[33142]: I1204 01:03:09.774299 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dgkzt\" (UniqueName: \"kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.777005 master-0 kubenswrapper[33142]: I1204 01:03:09.776970 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.780534 master-0 kubenswrapper[33142]: I1204 01:03:09.780468 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.784178 master-0 kubenswrapper[33142]: I1204 01:03:09.784117 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.787678 master-0 kubenswrapper[33142]: I1204 01:03:09.787576 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.788051 master-0 kubenswrapper[33142]: I1204 01:03:09.788013 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.796100 master-0 kubenswrapper[33142]: I1204 01:03:09.796010 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgkzt\" (UniqueName: \"kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt\") pod \"keystone-bootstrap-lkjzz\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:09.927022 master-0 kubenswrapper[33142]: I1204 01:03:09.926274 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002873a6-d2d1-488e-abee-b4fe2f025bb8" path="/var/lib/kubelet/pods/002873a6-d2d1-488e-abee-b4fe2f025bb8/volumes" Dec 04 01:03:10.028672 master-0 kubenswrapper[33142]: I1204 01:03:10.028598 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:10.220563 master-0 kubenswrapper[33142]: I1204 01:03:10.220449 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-db-sync-7jmp5"] Dec 04 01:03:10.222883 master-0 kubenswrapper[33142]: I1204 01:03:10.222820 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.227814 master-0 kubenswrapper[33142]: I1204 01:03:10.226783 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-scripts" Dec 04 01:03:10.228308 master-0 kubenswrapper[33142]: I1204 01:03:10.228254 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-config-data" Dec 04 01:03:10.246679 master-0 kubenswrapper[33142]: I1204 01:03:10.246603 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-sync-7jmp5"] Dec 04 01:03:10.294991 master-0 kubenswrapper[33142]: I1204 01:03:10.294875 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.295251 master-0 kubenswrapper[33142]: I1204 01:03:10.295094 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.295251 master-0 kubenswrapper[33142]: I1204 01:03:10.295136 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.295489 master-0 kubenswrapper[33142]: I1204 01:03:10.295457 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scf68\" (UniqueName: \"kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.296259 master-0 kubenswrapper[33142]: I1204 01:03:10.295869 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.296259 master-0 kubenswrapper[33142]: I1204 01:03:10.295972 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400042 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400253 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400504 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-scf68\" (UniqueName: \"kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400539 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400592 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.400742 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.401215 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.404981 master-0 kubenswrapper[33142]: I1204 01:03:10.404897 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.410896 master-0 kubenswrapper[33142]: I1204 01:03:10.409371 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.411759 master-0 kubenswrapper[33142]: I1204 01:03:10.411727 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.418470 master-0 kubenswrapper[33142]: I1204 01:03:10.418428 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.428751 master-0 kubenswrapper[33142]: I1204 01:03:10.424897 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-scf68\" (UniqueName: \"kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68\") pod \"ironic-db-sync-7jmp5\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.584962 master-0 kubenswrapper[33142]: I1204 01:03:10.584852 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:10.685152 master-0 kubenswrapper[33142]: I1204 01:03:10.684679 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:10.695154 master-0 kubenswrapper[33142]: I1204 01:03:10.695080 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-lkjzz"] Dec 04 01:03:10.717252 master-0 kubenswrapper[33142]: W1204 01:03:10.717198 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2babf62_20c4_489b_9996_abb9a74b6fe0.slice/crio-44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007 WatchSource:0}: Error finding container 44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007: Status 404 returned error can't find the container with id 44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007 Dec 04 01:03:10.729685 master-0 kubenswrapper[33142]: I1204 01:03:10.729620 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerStarted","Data":"aa50042ecba39c07f14c6cf4387963475a006dc1bd7af76149e80e04659e09c9"} Dec 04 01:03:10.733492 master-0 kubenswrapper[33142]: I1204 01:03:10.733461 33142 generic.go:334] "Generic (PLEG): container finished" podID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerID="b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" exitCode=0 Dec 04 01:03:10.733492 master-0 kubenswrapper[33142]: I1204 01:03:10.733491 33142 generic.go:334] "Generic (PLEG): container finished" podID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerID="6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" exitCode=143 Dec 04 01:03:10.733630 master-0 kubenswrapper[33142]: I1204 01:03:10.733509 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerDied","Data":"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792"} Dec 04 01:03:10.733630 master-0 kubenswrapper[33142]: I1204 01:03:10.733529 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerDied","Data":"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd"} Dec 04 01:03:10.733630 master-0 kubenswrapper[33142]: I1204 01:03:10.733539 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"6f27bedc-f064-4fd2-bc9c-807a44cd377f","Type":"ContainerDied","Data":"4e762fa6814aef883241e08e82abae82fa246a745d8b17e4d938d8b5267732a4"} Dec 04 01:03:10.733630 master-0 kubenswrapper[33142]: I1204 01:03:10.733558 33142 scope.go:117] "RemoveContainer" containerID="b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" Dec 04 01:03:10.733754 master-0 kubenswrapper[33142]: I1204 01:03:10.733700 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:10.778639 master-0 kubenswrapper[33142]: I1204 01:03:10.775360 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-10f14-default-external-api-0" podStartSLOduration=5.775320189 podStartE2EDuration="5.775320189s" podCreationTimestamp="2025-12-04 01:03:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:10.763373542 +0000 UTC m=+963.165375412" watchObservedRunningTime="2025-12-04 01:03:10.775320189 +0000 UTC m=+963.177322039" Dec 04 01:03:10.805371 master-0 kubenswrapper[33142]: I1204 01:03:10.805283 33142 scope.go:117] "RemoveContainer" containerID="6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" Dec 04 01:03:10.825281 master-0 kubenswrapper[33142]: I1204 01:03:10.825199 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825281 master-0 kubenswrapper[33142]: I1204 01:03:10.825285 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825585 master-0 kubenswrapper[33142]: I1204 01:03:10.825320 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mxg7\" (UniqueName: \"kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825585 master-0 kubenswrapper[33142]: I1204 01:03:10.825427 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825585 master-0 kubenswrapper[33142]: I1204 01:03:10.825501 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825585 master-0 kubenswrapper[33142]: I1204 01:03:10.825526 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.825970 master-0 kubenswrapper[33142]: I1204 01:03:10.825942 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.826033 master-0 kubenswrapper[33142]: I1204 01:03:10.825998 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs\") pod \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\" (UID: \"6f27bedc-f064-4fd2-bc9c-807a44cd377f\") " Dec 04 01:03:10.827377 master-0 kubenswrapper[33142]: I1204 01:03:10.827334 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:10.829034 master-0 kubenswrapper[33142]: I1204 01:03:10.828700 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs" (OuterVolumeSpecName: "logs") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:10.833427 master-0 kubenswrapper[33142]: I1204 01:03:10.833074 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7" (OuterVolumeSpecName: "kube-api-access-2mxg7") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "kube-api-access-2mxg7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:10.833427 master-0 kubenswrapper[33142]: I1204 01:03:10.833078 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts" (OuterVolumeSpecName: "scripts") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:10.838800 master-0 kubenswrapper[33142]: I1204 01:03:10.838744 33142 scope.go:117] "RemoveContainer" containerID="b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" Dec 04 01:03:10.839716 master-0 kubenswrapper[33142]: E1204 01:03:10.839677 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792\": container with ID starting with b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792 not found: ID does not exist" containerID="b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" Dec 04 01:03:10.839794 master-0 kubenswrapper[33142]: I1204 01:03:10.839719 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792"} err="failed to get container status \"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792\": rpc error: code = NotFound desc = could not find container \"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792\": container with ID starting with b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792 not found: ID does not exist" Dec 04 01:03:10.839794 master-0 kubenswrapper[33142]: I1204 01:03:10.839752 33142 scope.go:117] "RemoveContainer" containerID="6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" Dec 04 01:03:10.840221 master-0 kubenswrapper[33142]: E1204 01:03:10.840180 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd\": container with ID starting with 6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd not found: ID does not exist" containerID="6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" Dec 04 01:03:10.840221 master-0 kubenswrapper[33142]: I1204 01:03:10.840215 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd"} err="failed to get container status \"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd\": rpc error: code = NotFound desc = could not find container \"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd\": container with ID starting with 6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd not found: ID does not exist" Dec 04 01:03:10.840338 master-0 kubenswrapper[33142]: I1204 01:03:10.840248 33142 scope.go:117] "RemoveContainer" containerID="b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792" Dec 04 01:03:10.840789 master-0 kubenswrapper[33142]: I1204 01:03:10.840734 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792"} err="failed to get container status \"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792\": rpc error: code = NotFound desc = could not find container \"b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792\": container with ID starting with b4ba10945c399abf94b29a15743a1b6ab74ef15abd9f2e8a2b9f89f283588792 not found: ID does not exist" Dec 04 01:03:10.840789 master-0 kubenswrapper[33142]: I1204 01:03:10.840786 33142 scope.go:117] "RemoveContainer" containerID="6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd" Dec 04 01:03:10.841237 master-0 kubenswrapper[33142]: I1204 01:03:10.841201 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd"} err="failed to get container status \"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd\": rpc error: code = NotFound desc = could not find container \"6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd\": container with ID starting with 6a40b7b5f6a5a1fbe156082b7c963972063b314e68694eafca5a3c0163547fcd not found: ID does not exist" Dec 04 01:03:10.863160 master-0 kubenswrapper[33142]: I1204 01:03:10.863102 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228" (OuterVolumeSpecName: "glance") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 01:03:10.878340 master-0 kubenswrapper[33142]: I1204 01:03:10.872240 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:10.901208 master-0 kubenswrapper[33142]: I1204 01:03:10.899155 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:10.911644 master-0 kubenswrapper[33142]: I1204 01:03:10.910642 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data" (OuterVolumeSpecName: "config-data") pod "6f27bedc-f064-4fd2-bc9c-807a44cd377f" (UID: "6f27bedc-f064-4fd2-bc9c-807a44cd377f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928503 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928611 33142 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928629 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928682 33142 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") on node \"master-0\" " Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928695 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928705 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f27bedc-f064-4fd2-bc9c-807a44cd377f-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928714 33142 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6f27bedc-f064-4fd2-bc9c-807a44cd377f-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.928859 master-0 kubenswrapper[33142]: I1204 01:03:10.928724 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2mxg7\" (UniqueName: \"kubernetes.io/projected/6f27bedc-f064-4fd2-bc9c-807a44cd377f-kube-api-access-2mxg7\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:10.956843 master-0 kubenswrapper[33142]: I1204 01:03:10.956740 33142 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 01:03:10.957066 master-0 kubenswrapper[33142]: I1204 01:03:10.956900 33142 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c" (UniqueName: "kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228") on node "master-0" Dec 04 01:03:11.035009 master-0 kubenswrapper[33142]: I1204 01:03:11.030664 33142 reconciler_common.go:293] "Volume detached for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:11.074530 master-0 kubenswrapper[33142]: W1204 01:03:11.074447 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58b60ff8_26fd_4896_966a_24078d04bfbf.slice/crio-8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53 WatchSource:0}: Error finding container 8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53: Status 404 returned error can't find the container with id 8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53 Dec 04 01:03:11.075989 master-0 kubenswrapper[33142]: I1204 01:03:11.075955 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-sync-7jmp5"] Dec 04 01:03:11.087186 master-0 kubenswrapper[33142]: I1204 01:03:11.087117 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:11.099335 master-0 kubenswrapper[33142]: I1204 01:03:11.099117 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:11.101445 master-0 kubenswrapper[33142]: I1204 01:03:11.100187 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:11.123421 master-0 kubenswrapper[33142]: I1204 01:03:11.123336 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:11.123996 master-0 kubenswrapper[33142]: E1204 01:03:11.123966 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-httpd" Dec 04 01:03:11.123996 master-0 kubenswrapper[33142]: I1204 01:03:11.123992 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-httpd" Dec 04 01:03:11.124074 master-0 kubenswrapper[33142]: E1204 01:03:11.124024 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-log" Dec 04 01:03:11.124074 master-0 kubenswrapper[33142]: I1204 01:03:11.124032 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-log" Dec 04 01:03:11.124330 master-0 kubenswrapper[33142]: I1204 01:03:11.124297 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-httpd" Dec 04 01:03:11.124408 master-0 kubenswrapper[33142]: I1204 01:03:11.124384 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" containerName="glance-log" Dec 04 01:03:11.125820 master-0 kubenswrapper[33142]: I1204 01:03:11.125784 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.127776 master-0 kubenswrapper[33142]: I1204 01:03:11.127711 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Dec 04 01:03:11.135536 master-0 kubenswrapper[33142]: I1204 01:03:11.128945 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-internal-config-data" Dec 04 01:03:11.186338 master-0 kubenswrapper[33142]: I1204 01:03:11.186266 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:11.237531 master-0 kubenswrapper[33142]: I1204 01:03:11.237459 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237531 master-0 kubenswrapper[33142]: I1204 01:03:11.237537 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237561 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltnr\" (UniqueName: \"kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237590 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237662 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237685 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237731 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.237816 master-0 kubenswrapper[33142]: I1204 01:03:11.237775 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.249834 master-0 kubenswrapper[33142]: I1204 01:03:11.249771 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:03:11.250468 master-0 kubenswrapper[33142]: I1204 01:03:11.250429 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" containerID="cri-o://a0f915aa0e41770f8e996eb658a71d56b9e90678a7943015f960a395d831f289" gracePeriod=10 Dec 04 01:03:11.343188 master-0 kubenswrapper[33142]: I1204 01:03:11.343111 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343370 master-0 kubenswrapper[33142]: I1204 01:03:11.343243 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343370 master-0 kubenswrapper[33142]: I1204 01:03:11.343360 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343499 master-0 kubenswrapper[33142]: I1204 01:03:11.343478 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343686 master-0 kubenswrapper[33142]: I1204 01:03:11.343666 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343747 master-0 kubenswrapper[33142]: I1204 01:03:11.343721 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343747 master-0 kubenswrapper[33142]: I1204 01:03:11.343743 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zltnr\" (UniqueName: \"kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.343845 master-0 kubenswrapper[33142]: I1204 01:03:11.343778 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.344419 master-0 kubenswrapper[33142]: I1204 01:03:11.344394 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.345345 master-0 kubenswrapper[33142]: I1204 01:03:11.345320 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.348688 master-0 kubenswrapper[33142]: I1204 01:03:11.348567 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.349858 master-0 kubenswrapper[33142]: I1204 01:03:11.349820 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.351328 master-0 kubenswrapper[33142]: I1204 01:03:11.351280 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:03:11.351432 master-0 kubenswrapper[33142]: I1204 01:03:11.351350 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/f9bf544312b95af1c4795a85459fe1441801d5371397986d7a3e19188458ab2e/globalmount\"" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.352753 master-0 kubenswrapper[33142]: I1204 01:03:11.352704 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.355485 master-0 kubenswrapper[33142]: I1204 01:03:11.355461 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.363752 master-0 kubenswrapper[33142]: I1204 01:03:11.363697 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltnr\" (UniqueName: \"kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:11.928412 master-0 kubenswrapper[33142]: I1204 01:03:11.928262 33142 generic.go:334] "Generic (PLEG): container finished" podID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerID="a0f915aa0e41770f8e996eb658a71d56b9e90678a7943015f960a395d831f289" exitCode=0 Dec 04 01:03:11.935679 master-0 kubenswrapper[33142]: I1204 01:03:11.935620 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f27bedc-f064-4fd2-bc9c-807a44cd377f" path="/var/lib/kubelet/pods/6f27bedc-f064-4fd2-bc9c-807a44cd377f/volumes" Dec 04 01:03:11.936608 master-0 kubenswrapper[33142]: I1204 01:03:11.936570 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-7jmp5" event={"ID":"58b60ff8-26fd-4896-966a-24078d04bfbf","Type":"ContainerStarted","Data":"8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53"} Dec 04 01:03:11.936695 master-0 kubenswrapper[33142]: I1204 01:03:11.936615 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" event={"ID":"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3","Type":"ContainerDied","Data":"a0f915aa0e41770f8e996eb658a71d56b9e90678a7943015f960a395d831f289"} Dec 04 01:03:11.936695 master-0 kubenswrapper[33142]: I1204 01:03:11.936635 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-lkjzz" event={"ID":"d2babf62-20c4-489b-9996-abb9a74b6fe0","Type":"ContainerStarted","Data":"a2fee84d6d01ffcdcf4710e79b29cedb8137be5e626cc00a124da408bd00f405"} Dec 04 01:03:11.936695 master-0 kubenswrapper[33142]: I1204 01:03:11.936651 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-lkjzz" event={"ID":"d2babf62-20c4-489b-9996-abb9a74b6fe0","Type":"ContainerStarted","Data":"44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007"} Dec 04 01:03:11.985762 master-0 kubenswrapper[33142]: I1204 01:03:11.985621 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-bootstrap-lkjzz" podStartSLOduration=2.985587954 podStartE2EDuration="2.985587954s" podCreationTimestamp="2025-12-04 01:03:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:11.95173445 +0000 UTC m=+964.353736320" watchObservedRunningTime="2025-12-04 01:03:11.985587954 +0000 UTC m=+964.387589814" Dec 04 01:03:12.573212 master-0 kubenswrapper[33142]: I1204 01:03:12.571563 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:12.715571 master-0 kubenswrapper[33142]: I1204 01:03:12.715371 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:12.945789 master-0 kubenswrapper[33142]: I1204 01:03:12.945719 33142 generic.go:334] "Generic (PLEG): container finished" podID="2a2beb48-192c-4487-8d69-6f673f6b2902" containerID="553b25d966bb2fca72ed90c996b55eeb4147aad9853d8a7cf2abbf172ad44faf" exitCode=0 Dec 04 01:03:12.946343 master-0 kubenswrapper[33142]: I1204 01:03:12.945861 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-58zcd" event={"ID":"2a2beb48-192c-4487-8d69-6f673f6b2902","Type":"ContainerDied","Data":"553b25d966bb2fca72ed90c996b55eeb4147aad9853d8a7cf2abbf172ad44faf"} Dec 04 01:03:14.978956 master-0 kubenswrapper[33142]: E1204 01:03:14.977313 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2babf62_20c4_489b_9996_abb9a74b6fe0.slice/crio-conmon-a2fee84d6d01ffcdcf4710e79b29cedb8137be5e626cc00a124da408bd00f405.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:03:14.996707 master-0 kubenswrapper[33142]: I1204 01:03:14.996631 33142 generic.go:334] "Generic (PLEG): container finished" podID="d2babf62-20c4-489b-9996-abb9a74b6fe0" containerID="a2fee84d6d01ffcdcf4710e79b29cedb8137be5e626cc00a124da408bd00f405" exitCode=0 Dec 04 01:03:14.996707 master-0 kubenswrapper[33142]: I1204 01:03:14.996709 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-lkjzz" event={"ID":"d2babf62-20c4-489b-9996-abb9a74b6fe0","Type":"ContainerDied","Data":"a2fee84d6d01ffcdcf4710e79b29cedb8137be5e626cc00a124da408bd00f405"} Dec 04 01:03:17.277044 master-0 kubenswrapper[33142]: I1204 01:03:17.276870 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:17.277044 master-0 kubenswrapper[33142]: I1204 01:03:17.277002 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:17.318811 master-0 kubenswrapper[33142]: I1204 01:03:17.318752 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:17.320979 master-0 kubenswrapper[33142]: I1204 01:03:17.320890 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:17.644511 master-0 kubenswrapper[33142]: I1204 01:03:17.644423 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.0.194:5353: i/o timeout" Dec 04 01:03:18.048457 master-0 kubenswrapper[33142]: I1204 01:03:18.048320 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:18.048457 master-0 kubenswrapper[33142]: I1204 01:03:18.048382 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:20.336474 master-0 kubenswrapper[33142]: I1204 01:03:20.336282 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:20.336474 master-0 kubenswrapper[33142]: I1204 01:03:20.336460 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 01:03:20.340939 master-0 kubenswrapper[33142]: I1204 01:03:20.340884 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:03:21.936313 master-0 kubenswrapper[33142]: I1204 01:03:21.936236 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:21.972892 master-0 kubenswrapper[33142]: I1204 01:03:21.961505 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:03:21.972892 master-0 kubenswrapper[33142]: I1204 01:03:21.971499 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032643 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6299\" (UniqueName: \"kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299\") pod \"2a2beb48-192c-4487-8d69-6f673f6b2902\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032751 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb\") pod \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032779 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data\") pod \"2a2beb48-192c-4487-8d69-6f673f6b2902\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032823 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032851 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs\") pod \"2a2beb48-192c-4487-8d69-6f673f6b2902\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " Dec 04 01:03:22.032970 master-0 kubenswrapper[33142]: I1204 01:03:22.032901 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033037 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc\") pod \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033080 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb\") pod \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033207 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvv2x\" (UniqueName: \"kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x\") pod \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033227 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033251 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033283 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.033375 master-0 kubenswrapper[33142]: I1204 01:03:22.033353 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgkzt\" (UniqueName: \"kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt\") pod \"d2babf62-20c4-489b-9996-abb9a74b6fe0\" (UID: \"d2babf62-20c4-489b-9996-abb9a74b6fe0\") " Dec 04 01:03:22.033584 master-0 kubenswrapper[33142]: I1204 01:03:22.033391 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle\") pod \"2a2beb48-192c-4487-8d69-6f673f6b2902\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " Dec 04 01:03:22.033584 master-0 kubenswrapper[33142]: I1204 01:03:22.033429 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config\") pod \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\" (UID: \"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3\") " Dec 04 01:03:22.033584 master-0 kubenswrapper[33142]: I1204 01:03:22.033521 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts\") pod \"2a2beb48-192c-4487-8d69-6f673f6b2902\" (UID: \"2a2beb48-192c-4487-8d69-6f673f6b2902\") " Dec 04 01:03:22.038406 master-0 kubenswrapper[33142]: I1204 01:03:22.038340 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x" (OuterVolumeSpecName: "kube-api-access-nvv2x") pod "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" (UID: "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3"). InnerVolumeSpecName "kube-api-access-nvv2x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:22.047135 master-0 kubenswrapper[33142]: I1204 01:03:22.047071 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts" (OuterVolumeSpecName: "scripts") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.047906 master-0 kubenswrapper[33142]: I1204 01:03:22.047819 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts" (OuterVolumeSpecName: "scripts") pod "2a2beb48-192c-4487-8d69-6f673f6b2902" (UID: "2a2beb48-192c-4487-8d69-6f673f6b2902"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.050186 master-0 kubenswrapper[33142]: I1204 01:03:22.050130 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs" (OuterVolumeSpecName: "logs") pod "2a2beb48-192c-4487-8d69-6f673f6b2902" (UID: "2a2beb48-192c-4487-8d69-6f673f6b2902"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:22.053453 master-0 kubenswrapper[33142]: I1204 01:03:22.053384 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.069806 master-0 kubenswrapper[33142]: I1204 01:03:22.069643 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt" (OuterVolumeSpecName: "kube-api-access-dgkzt") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "kube-api-access-dgkzt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:22.084504 master-0 kubenswrapper[33142]: I1204 01:03:22.084404 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.086062 master-0 kubenswrapper[33142]: I1204 01:03:22.086012 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data" (OuterVolumeSpecName: "config-data") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.088601 master-0 kubenswrapper[33142]: I1204 01:03:22.088364 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d2babf62-20c4-489b-9996-abb9a74b6fe0" (UID: "d2babf62-20c4-489b-9996-abb9a74b6fe0"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.094522 master-0 kubenswrapper[33142]: I1204 01:03:22.094439 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299" (OuterVolumeSpecName: "kube-api-access-m6299") pod "2a2beb48-192c-4487-8d69-6f673f6b2902" (UID: "2a2beb48-192c-4487-8d69-6f673f6b2902"). InnerVolumeSpecName "kube-api-access-m6299". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:22.098804 master-0 kubenswrapper[33142]: I1204 01:03:22.098738 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" (UID: "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:22.111273 master-0 kubenswrapper[33142]: I1204 01:03:22.111012 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-58zcd" Dec 04 01:03:22.111273 master-0 kubenswrapper[33142]: I1204 01:03:22.111046 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config" (OuterVolumeSpecName: "config") pod "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" (UID: "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:22.111273 master-0 kubenswrapper[33142]: I1204 01:03:22.111050 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-58zcd" event={"ID":"2a2beb48-192c-4487-8d69-6f673f6b2902","Type":"ContainerDied","Data":"6edfe1688099cbe48fa0e3213dd59fcffe098ea51e90e71cc4f640be7b6e221b"} Dec 04 01:03:22.111273 master-0 kubenswrapper[33142]: I1204 01:03:22.111187 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6edfe1688099cbe48fa0e3213dd59fcffe098ea51e90e71cc4f640be7b6e221b" Dec 04 01:03:22.119270 master-0 kubenswrapper[33142]: I1204 01:03:22.119192 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" Dec 04 01:03:22.120394 master-0 kubenswrapper[33142]: I1204 01:03:22.120336 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" event={"ID":"b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3","Type":"ContainerDied","Data":"3fe6746a3c02ddb67fd5af20515f438a45d170d6340b0e02c2b2341c4982259d"} Dec 04 01:03:22.120476 master-0 kubenswrapper[33142]: I1204 01:03:22.120458 33142 scope.go:117] "RemoveContainer" containerID="a0f915aa0e41770f8e996eb658a71d56b9e90678a7943015f960a395d831f289" Dec 04 01:03:22.123677 master-0 kubenswrapper[33142]: I1204 01:03:22.123615 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-lkjzz" event={"ID":"d2babf62-20c4-489b-9996-abb9a74b6fe0","Type":"ContainerDied","Data":"44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007"} Dec 04 01:03:22.123744 master-0 kubenswrapper[33142]: I1204 01:03:22.123697 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44c159a5c5a06ce02ebfba3f7d3dd1a39d3b2403915ec78622759ab282523007" Dec 04 01:03:22.123781 master-0 kubenswrapper[33142]: I1204 01:03:22.123719 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-lkjzz" Dec 04 01:03:22.129643 master-0 kubenswrapper[33142]: I1204 01:03:22.129585 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data" (OuterVolumeSpecName: "config-data") pod "2a2beb48-192c-4487-8d69-6f673f6b2902" (UID: "2a2beb48-192c-4487-8d69-6f673f6b2902"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.131416 master-0 kubenswrapper[33142]: I1204 01:03:22.131344 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2a2beb48-192c-4487-8d69-6f673f6b2902" (UID: "2a2beb48-192c-4487-8d69-6f673f6b2902"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:22.138406 master-0 kubenswrapper[33142]: I1204 01:03:22.138350 33142 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-credential-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138406 master-0 kubenswrapper[33142]: I1204 01:03:22.138393 33142 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-fernet-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138406 master-0 kubenswrapper[33142]: I1204 01:03:22.138405 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dgkzt\" (UniqueName: \"kubernetes.io/projected/d2babf62-20c4-489b-9996-abb9a74b6fe0-kube-api-access-dgkzt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138406 master-0 kubenswrapper[33142]: I1204 01:03:22.138420 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138432 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138441 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138451 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m6299\" (UniqueName: \"kubernetes.io/projected/2a2beb48-192c-4487-8d69-6f673f6b2902-kube-api-access-m6299\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138459 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a2beb48-192c-4487-8d69-6f673f6b2902-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138468 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a2beb48-192c-4487-8d69-6f673f6b2902-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138477 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138486 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138495 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138504 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nvv2x\" (UniqueName: \"kubernetes.io/projected/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-kube-api-access-nvv2x\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.138691 master-0 kubenswrapper[33142]: I1204 01:03:22.138514 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2babf62-20c4-489b-9996-abb9a74b6fe0-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.143988 master-0 kubenswrapper[33142]: I1204 01:03:22.143883 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" (UID: "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:22.155435 master-0 kubenswrapper[33142]: I1204 01:03:22.155148 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" (UID: "b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:22.252724 master-0 kubenswrapper[33142]: I1204 01:03:22.252607 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.252724 master-0 kubenswrapper[33142]: I1204 01:03:22.252719 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:22.478133 master-0 kubenswrapper[33142]: I1204 01:03:22.478080 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:03:22.491100 master-0 kubenswrapper[33142]: I1204 01:03:22.491024 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-5789dc4cf-p6nnc"] Dec 04 01:03:22.644887 master-0 kubenswrapper[33142]: I1204 01:03:22.644804 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-5789dc4cf-p6nnc" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.0.194:5353: i/o timeout" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.169890 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-74cd467f4b-dmpnn"] Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: E1204 01:03:23.170573 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2a2beb48-192c-4487-8d69-6f673f6b2902" containerName="placement-db-sync" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.170594 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2beb48-192c-4487-8d69-6f673f6b2902" containerName="placement-db-sync" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: E1204 01:03:23.170644 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2babf62-20c4-489b-9996-abb9a74b6fe0" containerName="keystone-bootstrap" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.170656 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2babf62-20c4-489b-9996-abb9a74b6fe0" containerName="keystone-bootstrap" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: E1204 01:03:23.170727 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.170738 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: E1204 01:03:23.170769 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="init" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.170779 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="init" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.171107 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2babf62-20c4-489b-9996-abb9a74b6fe0" containerName="keystone-bootstrap" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.171156 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2a2beb48-192c-4487-8d69-6f673f6b2902" containerName="placement-db-sync" Dec 04 01:03:23.171709 master-0 kubenswrapper[33142]: I1204 01:03:23.171174 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" containerName="dnsmasq-dns" Dec 04 01:03:23.172715 master-0 kubenswrapper[33142]: I1204 01:03:23.172264 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.179807 master-0 kubenswrapper[33142]: I1204 01:03:23.176523 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 01:03:23.179807 master-0 kubenswrapper[33142]: I1204 01:03:23.176820 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 01:03:23.179807 master-0 kubenswrapper[33142]: I1204 01:03:23.176951 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 01:03:23.179807 master-0 kubenswrapper[33142]: I1204 01:03:23.177177 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-internal-svc" Dec 04 01:03:23.179807 master-0 kubenswrapper[33142]: I1204 01:03:23.177302 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-public-svc" Dec 04 01:03:23.200973 master-0 kubenswrapper[33142]: I1204 01:03:23.197300 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-5856c94c7d-wbwzp"] Dec 04 01:03:23.200973 master-0 kubenswrapper[33142]: I1204 01:03:23.199463 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.217808 master-0 kubenswrapper[33142]: I1204 01:03:23.207709 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-config-data" Dec 04 01:03:23.217808 master-0 kubenswrapper[33142]: I1204 01:03:23.207918 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-scripts" Dec 04 01:03:23.217808 master-0 kubenswrapper[33142]: I1204 01:03:23.208179 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-public-svc" Dec 04 01:03:23.217808 master-0 kubenswrapper[33142]: I1204 01:03:23.208463 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-internal-svc" Dec 04 01:03:23.217808 master-0 kubenswrapper[33142]: I1204 01:03:23.217256 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-74cd467f4b-dmpnn"] Dec 04 01:03:23.246107 master-0 kubenswrapper[33142]: I1204 01:03:23.246062 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-5856c94c7d-wbwzp"] Dec 04 01:03:23.293946 master-0 kubenswrapper[33142]: I1204 01:03:23.293347 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-config-data\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.294302 master-0 kubenswrapper[33142]: I1204 01:03:23.294281 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-fernet-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.294423 master-0 kubenswrapper[33142]: I1204 01:03:23.294406 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-combined-ca-bundle\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.294515 master-0 kubenswrapper[33142]: I1204 01:03:23.294501 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-credential-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.294623 master-0 kubenswrapper[33142]: I1204 01:03:23.294608 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjd2\" (UniqueName: \"kubernetes.io/projected/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-kube-api-access-5pjd2\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.294861 master-0 kubenswrapper[33142]: I1204 01:03:23.294786 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4jnj\" (UniqueName: \"kubernetes.io/projected/261f8cf7-8737-4364-8723-c8a8e3a57557-kube-api-access-w4jnj\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.295048 master-0 kubenswrapper[33142]: I1204 01:03:23.295009 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-scripts\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.295104 master-0 kubenswrapper[33142]: I1204 01:03:23.295089 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-scripts\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.295343 master-0 kubenswrapper[33142]: I1204 01:03:23.295286 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-internal-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.295500 master-0 kubenswrapper[33142]: I1204 01:03:23.295482 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-config-data\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.295608 master-0 kubenswrapper[33142]: I1204 01:03:23.295590 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-combined-ca-bundle\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.295726 master-0 kubenswrapper[33142]: I1204 01:03:23.295710 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-public-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.295920 master-0 kubenswrapper[33142]: I1204 01:03:23.295853 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/261f8cf7-8737-4364-8723-c8a8e3a57557-logs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.296368 master-0 kubenswrapper[33142]: I1204 01:03:23.296335 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-public-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.296454 master-0 kubenswrapper[33142]: I1204 01:03:23.296382 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-internal-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398285 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-config-data\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398368 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-combined-ca-bundle\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398411 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-public-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398439 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/261f8cf7-8737-4364-8723-c8a8e3a57557-logs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398476 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-public-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398503 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-internal-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398580 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-config-data\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398622 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-fernet-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398651 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-combined-ca-bundle\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398673 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-credential-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398701 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjd2\" (UniqueName: \"kubernetes.io/projected/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-kube-api-access-5pjd2\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398726 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w4jnj\" (UniqueName: \"kubernetes.io/projected/261f8cf7-8737-4364-8723-c8a8e3a57557-kube-api-access-w4jnj\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398776 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-scripts\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398809 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-scripts\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.399676 master-0 kubenswrapper[33142]: I1204 01:03:23.398858 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-internal-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.404129 master-0 kubenswrapper[33142]: I1204 01:03:23.404068 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/261f8cf7-8737-4364-8723-c8a8e3a57557-logs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.406226 master-0 kubenswrapper[33142]: I1204 01:03:23.406103 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-internal-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.406226 master-0 kubenswrapper[33142]: I1204 01:03:23.406141 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-config-data\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.409961 master-0 kubenswrapper[33142]: I1204 01:03:23.409852 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-combined-ca-bundle\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.411675 master-0 kubenswrapper[33142]: I1204 01:03:23.411628 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-scripts\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.415900 master-0 kubenswrapper[33142]: I1204 01:03:23.415849 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-credential-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.417488 master-0 kubenswrapper[33142]: I1204 01:03:23.417313 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-public-tls-certs\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.417488 master-0 kubenswrapper[33142]: I1204 01:03:23.417436 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-internal-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.417908 master-0 kubenswrapper[33142]: I1204 01:03:23.417846 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-fernet-keys\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.418577 master-0 kubenswrapper[33142]: I1204 01:03:23.418548 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-config-data\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.421326 master-0 kubenswrapper[33142]: I1204 01:03:23.421280 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4jnj\" (UniqueName: \"kubernetes.io/projected/261f8cf7-8737-4364-8723-c8a8e3a57557-kube-api-access-w4jnj\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.422388 master-0 kubenswrapper[33142]: I1204 01:03:23.422304 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-combined-ca-bundle\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.423612 master-0 kubenswrapper[33142]: I1204 01:03:23.423334 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/261f8cf7-8737-4364-8723-c8a8e3a57557-scripts\") pod \"placement-5856c94c7d-wbwzp\" (UID: \"261f8cf7-8737-4364-8723-c8a8e3a57557\") " pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.423914 master-0 kubenswrapper[33142]: I1204 01:03:23.423883 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjd2\" (UniqueName: \"kubernetes.io/projected/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-kube-api-access-5pjd2\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.431646 master-0 kubenswrapper[33142]: I1204 01:03:23.431617 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b527e25-e6cc-4b38-8d4a-bb30ed33c990-public-tls-certs\") pod \"keystone-74cd467f4b-dmpnn\" (UID: \"9b527e25-e6cc-4b38-8d4a-bb30ed33c990\") " pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.523254 master-0 kubenswrapper[33142]: I1204 01:03:23.523158 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:23.555338 master-0 kubenswrapper[33142]: I1204 01:03:23.553812 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:23.919380 master-0 kubenswrapper[33142]: I1204 01:03:23.919277 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3" path="/var/lib/kubelet/pods/b7bb6a1c-2ec3-4c8f-a142-8256ff90d9c3/volumes" Dec 04 01:03:26.136096 master-0 kubenswrapper[33142]: I1204 01:03:26.135495 33142 scope.go:117] "RemoveContainer" containerID="db79ce2db76e6d95e811c6c6d364f6c4a398706dad19b7034ad9b3572d41e89b" Dec 04 01:03:26.759282 master-0 kubenswrapper[33142]: I1204 01:03:26.759219 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-74cd467f4b-dmpnn"] Dec 04 01:03:26.857244 master-0 kubenswrapper[33142]: I1204 01:03:26.857110 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:03:26.956831 master-0 kubenswrapper[33142]: I1204 01:03:26.956625 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-5856c94c7d-wbwzp"] Dec 04 01:03:27.283849 master-0 kubenswrapper[33142]: I1204 01:03:27.283728 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerStarted","Data":"98a4e36bbddae8bd7e301fe4e29bba5b107c6769fef8dcfce2f324fd311ea48b"} Dec 04 01:03:27.292001 master-0 kubenswrapper[33142]: I1204 01:03:27.291843 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5856c94c7d-wbwzp" event={"ID":"261f8cf7-8737-4364-8723-c8a8e3a57557","Type":"ContainerStarted","Data":"29bb275790067fe93a45af6784b84d6a530209037c3489343e22101d12605184"} Dec 04 01:03:27.292001 master-0 kubenswrapper[33142]: I1204 01:03:27.291936 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5856c94c7d-wbwzp" event={"ID":"261f8cf7-8737-4364-8723-c8a8e3a57557","Type":"ContainerStarted","Data":"6b5009406e258de5631fa39d873c1594d4990bf5d4fc42ecea5a5f40ab03a45d"} Dec 04 01:03:27.295172 master-0 kubenswrapper[33142]: I1204 01:03:27.295027 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-74cd467f4b-dmpnn" event={"ID":"9b527e25-e6cc-4b38-8d4a-bb30ed33c990","Type":"ContainerStarted","Data":"4ba6869d8c8995e0b0880dd57b367cecefc49b83462faa84b786dd0bc7c02a57"} Dec 04 01:03:27.295172 master-0 kubenswrapper[33142]: I1204 01:03:27.295075 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-74cd467f4b-dmpnn" event={"ID":"9b527e25-e6cc-4b38-8d4a-bb30ed33c990","Type":"ContainerStarted","Data":"6c419ea9b79e69240fcc77cd64719e81daabba43b46c053fcfa9b4b3efa6ebe9"} Dec 04 01:03:27.295320 master-0 kubenswrapper[33142]: I1204 01:03:27.295190 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:27.298884 master-0 kubenswrapper[33142]: I1204 01:03:27.298695 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-db-sync-2gqvs" event={"ID":"59dae1eb-04ee-4e59-b07a-d50dd95bbca5","Type":"ContainerStarted","Data":"65b2c8662a5081c12f6c8cbc2ca0fbbc3b9f28f33769ca04ced16a18ea3ac440"} Dec 04 01:03:27.303455 master-0 kubenswrapper[33142]: I1204 01:03:27.301064 33142 generic.go:334] "Generic (PLEG): container finished" podID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerID="85b7e26c17dcfe2624defd6e1dc1ae0f6985a68ef47cda7e1a7ead51b8149e0d" exitCode=0 Dec 04 01:03:27.303455 master-0 kubenswrapper[33142]: I1204 01:03:27.301181 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-7jmp5" event={"ID":"58b60ff8-26fd-4896-966a-24078d04bfbf","Type":"ContainerDied","Data":"85b7e26c17dcfe2624defd6e1dc1ae0f6985a68ef47cda7e1a7ead51b8149e0d"} Dec 04 01:03:27.346631 master-0 kubenswrapper[33142]: I1204 01:03:27.346532 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-74cd467f4b-dmpnn" podStartSLOduration=4.346501492 podStartE2EDuration="4.346501492s" podCreationTimestamp="2025-12-04 01:03:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:27.315638433 +0000 UTC m=+979.717640293" watchObservedRunningTime="2025-12-04 01:03:27.346501492 +0000 UTC m=+979.748503342" Dec 04 01:03:27.362886 master-0 kubenswrapper[33142]: I1204 01:03:27.362151 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-db-sync-2gqvs" podStartSLOduration=3.343348787 podStartE2EDuration="28.362108891s" podCreationTimestamp="2025-12-04 01:02:59 +0000 UTC" firstStartedPulling="2025-12-04 01:03:01.235786293 +0000 UTC m=+953.637788143" lastFinishedPulling="2025-12-04 01:03:26.254546397 +0000 UTC m=+978.656548247" observedRunningTime="2025-12-04 01:03:27.349407393 +0000 UTC m=+979.751409253" watchObservedRunningTime="2025-12-04 01:03:27.362108891 +0000 UTC m=+979.764110741" Dec 04 01:03:28.319589 master-0 kubenswrapper[33142]: I1204 01:03:28.319478 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-7jmp5" event={"ID":"58b60ff8-26fd-4896-966a-24078d04bfbf","Type":"ContainerStarted","Data":"9b2b8f16edfb8779700075ee642590335913fc12d212a5a35429654ecd4b23cf"} Dec 04 01:03:28.332535 master-0 kubenswrapper[33142]: I1204 01:03:28.326027 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerStarted","Data":"f92f468b06abae32967732cdab4b6eff79962702650c607048fb0dee2940e8dc"} Dec 04 01:03:28.332535 master-0 kubenswrapper[33142]: I1204 01:03:28.326080 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerStarted","Data":"277c85e648a74edd30139d98bebab240f369fd35c40b9a3d8312033a87233cb2"} Dec 04 01:03:28.332535 master-0 kubenswrapper[33142]: I1204 01:03:28.330258 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-5856c94c7d-wbwzp" event={"ID":"261f8cf7-8737-4364-8723-c8a8e3a57557","Type":"ContainerStarted","Data":"05ea83fa2520a4c6aac32250d9e20c01fb0ebe1eb872decc859d112a829d3125"} Dec 04 01:03:28.349828 master-0 kubenswrapper[33142]: I1204 01:03:28.349661 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-db-sync-7jmp5" podStartSLOduration=3.16211447 podStartE2EDuration="18.349638607s" podCreationTimestamp="2025-12-04 01:03:10 +0000 UTC" firstStartedPulling="2025-12-04 01:03:11.079300815 +0000 UTC m=+963.481302655" lastFinishedPulling="2025-12-04 01:03:26.266824942 +0000 UTC m=+978.668826792" observedRunningTime="2025-12-04 01:03:28.344115121 +0000 UTC m=+980.746116991" watchObservedRunningTime="2025-12-04 01:03:28.349638607 +0000 UTC m=+980.751640457" Dec 04 01:03:28.393438 master-0 kubenswrapper[33142]: I1204 01:03:28.393224 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-5856c94c7d-wbwzp" podStartSLOduration=5.393131492 podStartE2EDuration="5.393131492s" podCreationTimestamp="2025-12-04 01:03:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:28.370611157 +0000 UTC m=+980.772613017" watchObservedRunningTime="2025-12-04 01:03:28.393131492 +0000 UTC m=+980.795133342" Dec 04 01:03:28.407369 master-0 kubenswrapper[33142]: I1204 01:03:28.406814 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-10f14-default-internal-api-0" podStartSLOduration=17.406783646 podStartE2EDuration="17.406783646s" podCreationTimestamp="2025-12-04 01:03:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:28.403511264 +0000 UTC m=+980.805513124" watchObservedRunningTime="2025-12-04 01:03:28.406783646 +0000 UTC m=+980.808785496" Dec 04 01:03:29.350861 master-0 kubenswrapper[33142]: I1204 01:03:29.350804 33142 generic.go:334] "Generic (PLEG): container finished" podID="c88cf271-c65e-4b97-8145-3b27c194747c" containerID="2fe812c39cd76ac5b0fe8b278f98c8b8cb5339ce17113c310010895eee019184" exitCode=0 Dec 04 01:03:29.351602 master-0 kubenswrapper[33142]: I1204 01:03:29.350874 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-sm4dc" event={"ID":"c88cf271-c65e-4b97-8145-3b27c194747c","Type":"ContainerDied","Data":"2fe812c39cd76ac5b0fe8b278f98c8b8cb5339ce17113c310010895eee019184"} Dec 04 01:03:29.355612 master-0 kubenswrapper[33142]: I1204 01:03:29.355585 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:29.355758 master-0 kubenswrapper[33142]: I1204 01:03:29.355746 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:30.915217 master-0 kubenswrapper[33142]: I1204 01:03:30.915160 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:31.001626 master-0 kubenswrapper[33142]: I1204 01:03:31.001546 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfq6p\" (UniqueName: \"kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p\") pod \"c88cf271-c65e-4b97-8145-3b27c194747c\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " Dec 04 01:03:31.001955 master-0 kubenswrapper[33142]: I1204 01:03:31.001733 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle\") pod \"c88cf271-c65e-4b97-8145-3b27c194747c\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " Dec 04 01:03:31.003403 master-0 kubenswrapper[33142]: I1204 01:03:31.003373 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config\") pod \"c88cf271-c65e-4b97-8145-3b27c194747c\" (UID: \"c88cf271-c65e-4b97-8145-3b27c194747c\") " Dec 04 01:03:31.006734 master-0 kubenswrapper[33142]: I1204 01:03:31.006637 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p" (OuterVolumeSpecName: "kube-api-access-hfq6p") pod "c88cf271-c65e-4b97-8145-3b27c194747c" (UID: "c88cf271-c65e-4b97-8145-3b27c194747c"). InnerVolumeSpecName "kube-api-access-hfq6p". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:31.041155 master-0 kubenswrapper[33142]: I1204 01:03:31.041058 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config" (OuterVolumeSpecName: "config") pod "c88cf271-c65e-4b97-8145-3b27c194747c" (UID: "c88cf271-c65e-4b97-8145-3b27c194747c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:31.043079 master-0 kubenswrapper[33142]: I1204 01:03:31.042906 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c88cf271-c65e-4b97-8145-3b27c194747c" (UID: "c88cf271-c65e-4b97-8145-3b27c194747c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:31.107483 master-0 kubenswrapper[33142]: I1204 01:03:31.107417 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:31.107483 master-0 kubenswrapper[33142]: I1204 01:03:31.107472 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c88cf271-c65e-4b97-8145-3b27c194747c-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:31.107483 master-0 kubenswrapper[33142]: I1204 01:03:31.107485 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hfq6p\" (UniqueName: \"kubernetes.io/projected/c88cf271-c65e-4b97-8145-3b27c194747c-kube-api-access-hfq6p\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:31.581085 master-0 kubenswrapper[33142]: I1204 01:03:31.581018 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-sm4dc" event={"ID":"c88cf271-c65e-4b97-8145-3b27c194747c","Type":"ContainerDied","Data":"02da6988eb800fc5c67cf24206caaf43ab9e1889c0f5e2dca39ac6b9dfddcf14"} Dec 04 01:03:31.581717 master-0 kubenswrapper[33142]: I1204 01:03:31.581694 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02da6988eb800fc5c67cf24206caaf43ab9e1889c0f5e2dca39ac6b9dfddcf14" Dec 04 01:03:31.581815 master-0 kubenswrapper[33142]: I1204 01:03:31.581433 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-sm4dc" Dec 04 01:03:31.964819 master-0 kubenswrapper[33142]: I1204 01:03:31.964745 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:31.965459 master-0 kubenswrapper[33142]: E1204 01:03:31.965393 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c88cf271-c65e-4b97-8145-3b27c194747c" containerName="neutron-db-sync" Dec 04 01:03:31.965459 master-0 kubenswrapper[33142]: I1204 01:03:31.965411 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88cf271-c65e-4b97-8145-3b27c194747c" containerName="neutron-db-sync" Dec 04 01:03:31.977784 master-0 kubenswrapper[33142]: I1204 01:03:31.965624 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="c88cf271-c65e-4b97-8145-3b27c194747c" containerName="neutron-db-sync" Dec 04 01:03:31.977784 master-0 kubenswrapper[33142]: I1204 01:03:31.974267 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:31.977784 master-0 kubenswrapper[33142]: I1204 01:03:31.975713 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:32.086956 master-0 kubenswrapper[33142]: I1204 01:03:32.078447 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:03:32.086956 master-0 kubenswrapper[33142]: I1204 01:03:32.080515 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.086956 master-0 kubenswrapper[33142]: I1204 01:03:32.086354 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-httpd-config" Dec 04 01:03:32.092852 master-0 kubenswrapper[33142]: I1204 01:03:32.092800 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-ovndbs" Dec 04 01:03:32.107046 master-0 kubenswrapper[33142]: I1204 01:03:32.093823 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-config" Dec 04 01:03:32.119957 master-0 kubenswrapper[33142]: I1204 01:03:32.100623 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.120610 master-0 kubenswrapper[33142]: I1204 01:03:32.120560 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.120724 master-0 kubenswrapper[33142]: I1204 01:03:32.120700 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q654l\" (UniqueName: \"kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.120894 master-0 kubenswrapper[33142]: I1204 01:03:32.120879 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.121021 master-0 kubenswrapper[33142]: I1204 01:03:32.121006 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.121181 master-0 kubenswrapper[33142]: I1204 01:03:32.121168 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.121286 master-0 kubenswrapper[33142]: I1204 01:03:32.121271 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.125984 master-0 kubenswrapper[33142]: I1204 01:03:32.121582 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.125984 master-0 kubenswrapper[33142]: I1204 01:03:32.121647 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.125984 master-0 kubenswrapper[33142]: I1204 01:03:32.121749 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.125984 master-0 kubenswrapper[33142]: I1204 01:03:32.121784 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2qm2\" (UniqueName: \"kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.190634 master-0 kubenswrapper[33142]: I1204 01:03:32.190584 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224223 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224290 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224336 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224357 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v2qm2\" (UniqueName: \"kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224404 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224432 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224454 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q654l\" (UniqueName: \"kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224489 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224509 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224551 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.227067 master-0 kubenswrapper[33142]: I1204 01:03:32.224579 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.241958 master-0 kubenswrapper[33142]: I1204 01:03:32.234282 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.241958 master-0 kubenswrapper[33142]: I1204 01:03:32.235155 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.241958 master-0 kubenswrapper[33142]: I1204 01:03:32.236074 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.241958 master-0 kubenswrapper[33142]: I1204 01:03:32.239555 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.241958 master-0 kubenswrapper[33142]: I1204 01:03:32.240174 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.243775 master-0 kubenswrapper[33142]: I1204 01:03:32.243738 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.253954 master-0 kubenswrapper[33142]: I1204 01:03:32.245769 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.253954 master-0 kubenswrapper[33142]: I1204 01:03:32.246142 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.253954 master-0 kubenswrapper[33142]: I1204 01:03:32.246762 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.274954 master-0 kubenswrapper[33142]: I1204 01:03:32.274859 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2qm2\" (UniqueName: \"kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2\") pod \"neutron-5fc8c54796-fmv8m\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.297952 master-0 kubenswrapper[33142]: I1204 01:03:32.288949 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q654l\" (UniqueName: \"kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l\") pod \"dnsmasq-dns-67844cd4d5-9lv8k\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.386106 master-0 kubenswrapper[33142]: I1204 01:03:32.384251 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:32.529690 master-0 kubenswrapper[33142]: I1204 01:03:32.529540 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:32.716380 master-0 kubenswrapper[33142]: I1204 01:03:32.716277 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:32.718488 master-0 kubenswrapper[33142]: I1204 01:03:32.718400 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:32.769840 master-0 kubenswrapper[33142]: I1204 01:03:32.769802 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:32.785425 master-0 kubenswrapper[33142]: I1204 01:03:32.785303 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:33.064356 master-0 kubenswrapper[33142]: I1204 01:03:33.064095 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:03:33.105852 master-0 kubenswrapper[33142]: I1204 01:03:33.105778 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:33.644775 master-0 kubenswrapper[33142]: I1204 01:03:33.644713 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerStarted","Data":"622cde4b83e16256af7693cdba26edf8bad9d86603b2aa977694b60b73b9cdda"} Dec 04 01:03:33.644919 master-0 kubenswrapper[33142]: I1204 01:03:33.644789 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerStarted","Data":"7fbb1a39f3dc21b2c09e608be29b17f203c637b83d6585a52bcd8dd413935922"} Dec 04 01:03:33.650879 master-0 kubenswrapper[33142]: I1204 01:03:33.650829 33142 generic.go:334] "Generic (PLEG): container finished" podID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerID="688b602cc68b0ec9d9678f32b9d7bb24adc6f0123af2c73940447410f3c137e6" exitCode=0 Dec 04 01:03:33.652149 master-0 kubenswrapper[33142]: I1204 01:03:33.651792 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" event={"ID":"1594c0bf-04d6-4835-abdf-6b6798fdedf7","Type":"ContainerDied","Data":"688b602cc68b0ec9d9678f32b9d7bb24adc6f0123af2c73940447410f3c137e6"} Dec 04 01:03:33.652149 master-0 kubenswrapper[33142]: I1204 01:03:33.651884 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" event={"ID":"1594c0bf-04d6-4835-abdf-6b6798fdedf7","Type":"ContainerStarted","Data":"c3cc75ccc5e8a5d96db7e43f31badb5a50c4f3188b20f3d47d19940657af426f"} Dec 04 01:03:33.652149 master-0 kubenswrapper[33142]: I1204 01:03:33.651984 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:33.652149 master-0 kubenswrapper[33142]: I1204 01:03:33.652017 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:34.667280 master-0 kubenswrapper[33142]: I1204 01:03:34.667196 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerStarted","Data":"12383da18f488dfa2fa6fbee65225b2530aeb8162869b0ba020285e843fdd9d1"} Dec 04 01:03:34.669242 master-0 kubenswrapper[33142]: I1204 01:03:34.669173 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:03:34.674020 master-0 kubenswrapper[33142]: I1204 01:03:34.673580 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" event={"ID":"1594c0bf-04d6-4835-abdf-6b6798fdedf7","Type":"ContainerStarted","Data":"19980fa79e02474f53f87e5025bd64ad0fe851dc17035344316e5015e517447f"} Dec 04 01:03:34.709643 master-0 kubenswrapper[33142]: I1204 01:03:34.709532 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-5fc8c54796-fmv8m" podStartSLOduration=3.709505279 podStartE2EDuration="3.709505279s" podCreationTimestamp="2025-12-04 01:03:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:34.688513108 +0000 UTC m=+987.090514968" watchObservedRunningTime="2025-12-04 01:03:34.709505279 +0000 UTC m=+987.111507129" Dec 04 01:03:34.718989 master-0 kubenswrapper[33142]: I1204 01:03:34.718874 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" podStartSLOduration=3.718850282 podStartE2EDuration="3.718850282s" podCreationTimestamp="2025-12-04 01:03:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:34.71699337 +0000 UTC m=+987.118995240" watchObservedRunningTime="2025-12-04 01:03:34.718850282 +0000 UTC m=+987.120852132" Dec 04 01:03:34.872182 master-0 kubenswrapper[33142]: I1204 01:03:34.871504 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-7f7cdd4b75-tvgpk"] Dec 04 01:03:34.875080 master-0 kubenswrapper[33142]: I1204 01:03:34.875025 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:34.882288 master-0 kubenswrapper[33142]: I1204 01:03:34.879014 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-public-svc" Dec 04 01:03:34.882288 master-0 kubenswrapper[33142]: I1204 01:03:34.879642 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-internal-svc" Dec 04 01:03:34.892107 master-0 kubenswrapper[33142]: I1204 01:03:34.892032 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-7f7cdd4b75-tvgpk"] Dec 04 01:03:35.060717 master-0 kubenswrapper[33142]: I1204 01:03:35.060482 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-internal-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.060717 master-0 kubenswrapper[33142]: I1204 01:03:35.060618 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb2tn\" (UniqueName: \"kubernetes.io/projected/b85c44e3-58e6-48ab-81cc-0bf924992ad7-kube-api-access-hb2tn\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.061024 master-0 kubenswrapper[33142]: I1204 01:03:35.060728 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-ovndb-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.061024 master-0 kubenswrapper[33142]: I1204 01:03:35.060774 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.061024 master-0 kubenswrapper[33142]: I1204 01:03:35.060807 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-httpd-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.061024 master-0 kubenswrapper[33142]: I1204 01:03:35.060886 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-combined-ca-bundle\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.064634 master-0 kubenswrapper[33142]: I1204 01:03:35.064560 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-public-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166627 master-0 kubenswrapper[33142]: I1204 01:03:35.166547 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166627 master-0 kubenswrapper[33142]: I1204 01:03:35.166619 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-httpd-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166922 master-0 kubenswrapper[33142]: I1204 01:03:35.166675 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-combined-ca-bundle\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166922 master-0 kubenswrapper[33142]: I1204 01:03:35.166736 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-public-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166922 master-0 kubenswrapper[33142]: I1204 01:03:35.166818 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-internal-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166922 master-0 kubenswrapper[33142]: I1204 01:03:35.166845 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hb2tn\" (UniqueName: \"kubernetes.io/projected/b85c44e3-58e6-48ab-81cc-0bf924992ad7-kube-api-access-hb2tn\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.166922 master-0 kubenswrapper[33142]: I1204 01:03:35.166881 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-ovndb-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.172256 master-0 kubenswrapper[33142]: I1204 01:03:35.172199 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-httpd-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.172256 master-0 kubenswrapper[33142]: I1204 01:03:35.172202 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-public-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.172504 master-0 kubenswrapper[33142]: I1204 01:03:35.172438 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-internal-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.172755 master-0 kubenswrapper[33142]: I1204 01:03:35.172710 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-ovndb-tls-certs\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.172755 master-0 kubenswrapper[33142]: I1204 01:03:35.172731 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-combined-ca-bundle\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.174103 master-0 kubenswrapper[33142]: I1204 01:03:35.174035 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b85c44e3-58e6-48ab-81cc-0bf924992ad7-config\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.191246 master-0 kubenswrapper[33142]: I1204 01:03:35.188689 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb2tn\" (UniqueName: \"kubernetes.io/projected/b85c44e3-58e6-48ab-81cc-0bf924992ad7-kube-api-access-hb2tn\") pod \"neutron-7f7cdd4b75-tvgpk\" (UID: \"b85c44e3-58e6-48ab-81cc-0bf924992ad7\") " pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.198413 master-0 kubenswrapper[33142]: I1204 01:03:35.196828 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:35.688939 master-0 kubenswrapper[33142]: I1204 01:03:35.688855 33142 generic.go:334] "Generic (PLEG): container finished" podID="59dae1eb-04ee-4e59-b07a-d50dd95bbca5" containerID="65b2c8662a5081c12f6c8cbc2ca0fbbc3b9f28f33769ca04ced16a18ea3ac440" exitCode=0 Dec 04 01:03:35.689565 master-0 kubenswrapper[33142]: I1204 01:03:35.688979 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 01:03:35.689565 master-0 kubenswrapper[33142]: I1204 01:03:35.688993 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 01:03:35.690312 master-0 kubenswrapper[33142]: I1204 01:03:35.689840 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-db-sync-2gqvs" event={"ID":"59dae1eb-04ee-4e59-b07a-d50dd95bbca5","Type":"ContainerDied","Data":"65b2c8662a5081c12f6c8cbc2ca0fbbc3b9f28f33769ca04ced16a18ea3ac440"} Dec 04 01:03:35.690312 master-0 kubenswrapper[33142]: I1204 01:03:35.690253 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:35.926966 master-0 kubenswrapper[33142]: I1204 01:03:35.926908 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-7f7cdd4b75-tvgpk"] Dec 04 01:03:35.934953 master-0 kubenswrapper[33142]: I1204 01:03:35.934872 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:35.943235 master-0 kubenswrapper[33142]: I1204 01:03:35.937290 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:03:36.702888 master-0 kubenswrapper[33142]: I1204 01:03:36.702489 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-7f7cdd4b75-tvgpk" event={"ID":"b85c44e3-58e6-48ab-81cc-0bf924992ad7","Type":"ContainerStarted","Data":"0b145ca16bc5af0a0ca31be26db741ec099de07c10d5252b50ed70c435ff8c42"} Dec 04 01:03:36.702888 master-0 kubenswrapper[33142]: I1204 01:03:36.702580 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-7f7cdd4b75-tvgpk" event={"ID":"b85c44e3-58e6-48ab-81cc-0bf924992ad7","Type":"ContainerStarted","Data":"05c8b0ff041deb5e6b7e210261ac0978c4f9186231afc549955a72f59915278a"} Dec 04 01:03:36.702888 master-0 kubenswrapper[33142]: I1204 01:03:36.702594 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-7f7cdd4b75-tvgpk" event={"ID":"b85c44e3-58e6-48ab-81cc-0bf924992ad7","Type":"ContainerStarted","Data":"98e9bcac71c29323d60268f7824fe7a7975c0d55782853bbf85cb4c6c454a6f8"} Dec 04 01:03:36.775864 master-0 kubenswrapper[33142]: I1204 01:03:36.775682 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-7f7cdd4b75-tvgpk" podStartSLOduration=2.7756486750000002 podStartE2EDuration="2.775648675s" podCreationTimestamp="2025-12-04 01:03:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:36.756130265 +0000 UTC m=+989.158132115" watchObservedRunningTime="2025-12-04 01:03:36.775648675 +0000 UTC m=+989.177650545" Dec 04 01:03:37.197114 master-0 kubenswrapper[33142]: I1204 01:03:37.197048 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.350596 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.350769 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.350823 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.350995 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9j9m\" (UniqueName: \"kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.351029 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.351151 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id\") pod \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\" (UID: \"59dae1eb-04ee-4e59-b07a-d50dd95bbca5\") " Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.351813 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:37.355509 master-0 kubenswrapper[33142]: I1204 01:03:37.352796 33142 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.356359 master-0 kubenswrapper[33142]: I1204 01:03:37.356261 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:37.358067 master-0 kubenswrapper[33142]: I1204 01:03:37.356816 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m" (OuterVolumeSpecName: "kube-api-access-t9j9m") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "kube-api-access-t9j9m". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:37.358067 master-0 kubenswrapper[33142]: I1204 01:03:37.357138 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts" (OuterVolumeSpecName: "scripts") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:37.386883 master-0 kubenswrapper[33142]: I1204 01:03:37.386607 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:37.414911 master-0 kubenswrapper[33142]: I1204 01:03:37.414844 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data" (OuterVolumeSpecName: "config-data") pod "59dae1eb-04ee-4e59-b07a-d50dd95bbca5" (UID: "59dae1eb-04ee-4e59-b07a-d50dd95bbca5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:37.455157 master-0 kubenswrapper[33142]: I1204 01:03:37.454886 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t9j9m\" (UniqueName: \"kubernetes.io/projected/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-kube-api-access-t9j9m\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.455157 master-0 kubenswrapper[33142]: I1204 01:03:37.455028 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.455157 master-0 kubenswrapper[33142]: I1204 01:03:37.455040 33142 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-db-sync-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.455157 master-0 kubenswrapper[33142]: I1204 01:03:37.455052 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.455157 master-0 kubenswrapper[33142]: I1204 01:03:37.455061 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/59dae1eb-04ee-4e59-b07a-d50dd95bbca5-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:37.720324 master-0 kubenswrapper[33142]: I1204 01:03:37.720114 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-db-sync-2gqvs" Dec 04 01:03:37.721293 master-0 kubenswrapper[33142]: I1204 01:03:37.720379 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-db-sync-2gqvs" event={"ID":"59dae1eb-04ee-4e59-b07a-d50dd95bbca5","Type":"ContainerDied","Data":"caecf5cab41938c05da068d16f62248a39c4fb89a0f7cb40d54742f884282486"} Dec 04 01:03:37.721293 master-0 kubenswrapper[33142]: I1204 01:03:37.720429 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caecf5cab41938c05da068d16f62248a39c4fb89a0f7cb40d54742f884282486" Dec 04 01:03:37.721293 master-0 kubenswrapper[33142]: I1204 01:03:37.720816 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:03:38.156358 master-0 kubenswrapper[33142]: I1204 01:03:38.156278 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:38.158542 master-0 kubenswrapper[33142]: E1204 01:03:38.157694 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="59dae1eb-04ee-4e59-b07a-d50dd95bbca5" containerName="cinder-10f14-db-sync" Dec 04 01:03:38.158542 master-0 kubenswrapper[33142]: I1204 01:03:38.157721 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dae1eb-04ee-4e59-b07a-d50dd95bbca5" containerName="cinder-10f14-db-sync" Dec 04 01:03:38.158542 master-0 kubenswrapper[33142]: I1204 01:03:38.158254 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="59dae1eb-04ee-4e59-b07a-d50dd95bbca5" containerName="cinder-10f14-db-sync" Dec 04 01:03:38.161616 master-0 kubenswrapper[33142]: I1204 01:03:38.160638 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.191956 master-0 kubenswrapper[33142]: I1204 01:03:38.183066 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-scripts" Dec 04 01:03:38.191956 master-0 kubenswrapper[33142]: I1204 01:03:38.183326 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-scheduler-config-data" Dec 04 01:03:38.197702 master-0 kubenswrapper[33142]: I1204 01:03:38.193955 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-config-data" Dec 04 01:03:38.209207 master-0 kubenswrapper[33142]: I1204 01:03:38.205811 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.327777 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.328004 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.328096 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.328145 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.328270 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qdlw\" (UniqueName: \"kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.328413 master-0 kubenswrapper[33142]: I1204 01:03:38.328308 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.334699 master-0 kubenswrapper[33142]: I1204 01:03:38.334601 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:38.335071 master-0 kubenswrapper[33142]: I1204 01:03:38.335006 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="dnsmasq-dns" containerID="cri-o://19980fa79e02474f53f87e5025bd64ad0fe851dc17035344316e5015e517447f" gracePeriod=10 Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.429718 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.429837 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.429880 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.429909 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.429979 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4qdlw\" (UniqueName: \"kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.430161 master-0 kubenswrapper[33142]: I1204 01:03:38.430002 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.444570 master-0 kubenswrapper[33142]: I1204 01:03:38.435602 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.444570 master-0 kubenswrapper[33142]: I1204 01:03:38.435694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.444570 master-0 kubenswrapper[33142]: I1204 01:03:38.438708 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.444570 master-0 kubenswrapper[33142]: I1204 01:03:38.443294 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.460138 master-0 kubenswrapper[33142]: I1204 01:03:38.450624 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:38.460138 master-0 kubenswrapper[33142]: I1204 01:03:38.454011 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.460138 master-0 kubenswrapper[33142]: I1204 01:03:38.454205 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.460138 master-0 kubenswrapper[33142]: I1204 01:03:38.456891 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-volume-lvm-iscsi-config-data" Dec 04 01:03:38.476450 master-0 kubenswrapper[33142]: I1204 01:03:38.468722 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:38.499191 master-0 kubenswrapper[33142]: I1204 01:03:38.488863 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:38.499191 master-0 kubenswrapper[33142]: I1204 01:03:38.492250 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.512055 master-0 kubenswrapper[33142]: I1204 01:03:38.511093 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:38.515807 master-0 kubenswrapper[33142]: I1204 01:03:38.515260 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.520595 master-0 kubenswrapper[33142]: I1204 01:03:38.520548 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qdlw\" (UniqueName: \"kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw\") pod \"cinder-10f14-scheduler-0\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.521103 master-0 kubenswrapper[33142]: I1204 01:03:38.520968 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-backup-config-data" Dec 04 01:03:38.521457 master-0 kubenswrapper[33142]: I1204 01:03:38.521422 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532546 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532635 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532718 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532795 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532813 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532843 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532869 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfq82\" (UniqueName: \"kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532893 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532958 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.532981 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.533018 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.533117 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.533146 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.533303 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.533491 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.544076 master-0 kubenswrapper[33142]: I1204 01:03:38.539204 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:38.555895 master-0 kubenswrapper[33142]: I1204 01:03:38.555525 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636074 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636160 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636217 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636243 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636298 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636327 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636350 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636372 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636392 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636416 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636436 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636506 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636584 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636654 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636953 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.636982 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjgl7\" (UniqueName: \"kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637110 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637133 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637243 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637291 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637327 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637362 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tfjf\" (UniqueName: \"kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637413 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tfq82\" (UniqueName: \"kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637442 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637484 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637533 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637644 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637666 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637685 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637709 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637745 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637820 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637841 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637857 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637892 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637949 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.637994 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.638037 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.638042 master-0 kubenswrapper[33142]: I1204 01:03:38.638072 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.638289 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.638506 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.638916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.639588 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.639625 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.639741 master-0 kubenswrapper[33142]: I1204 01:03:38.639733 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.641938 master-0 kubenswrapper[33142]: I1204 01:03:38.640244 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.641938 master-0 kubenswrapper[33142]: I1204 01:03:38.641528 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.641938 master-0 kubenswrapper[33142]: I1204 01:03:38.641585 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.646169 master-0 kubenswrapper[33142]: I1204 01:03:38.645477 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.667784 master-0 kubenswrapper[33142]: I1204 01:03:38.666695 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741264 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741341 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741381 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741439 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741491 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741544 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741575 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741626 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741735 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741772 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741802 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741831 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741868 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741898 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.743171 master-0 kubenswrapper[33142]: I1204 01:03:38.741988 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.742016 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pjgl7\" (UniqueName: \"kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.745953 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.745994 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.746050 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9tfjf\" (UniqueName: \"kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.746124 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.746227 master-0 kubenswrapper[33142]: I1204 01:03:38.746186 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.748535 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.748624 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.749464 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.749548 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.749597 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.749658 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.749709 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.753698 master-0 kubenswrapper[33142]: I1204 01:03:38.753222 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.754398 master-0 kubenswrapper[33142]: I1204 01:03:38.753698 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.754398 master-0 kubenswrapper[33142]: I1204 01:03:38.753815 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.754398 master-0 kubenswrapper[33142]: I1204 01:03:38.754037 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.754398 master-0 kubenswrapper[33142]: I1204 01:03:38.754307 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.754859 master-0 kubenswrapper[33142]: I1204 01:03:38.754680 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.754859 master-0 kubenswrapper[33142]: I1204 01:03:38.754831 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.756404 master-0 kubenswrapper[33142]: I1204 01:03:38.756368 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.760438 master-0 kubenswrapper[33142]: I1204 01:03:38.760367 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.761777 master-0 kubenswrapper[33142]: I1204 01:03:38.761713 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:38.762598 master-0 kubenswrapper[33142]: I1204 01:03:38.762533 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:38.765204 master-0 kubenswrapper[33142]: I1204 01:03:38.763314 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:39.011114 master-0 kubenswrapper[33142]: I1204 01:03:38.795980 33142 generic.go:334] "Generic (PLEG): container finished" podID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerID="19980fa79e02474f53f87e5025bd64ad0fe851dc17035344316e5015e517447f" exitCode=0 Dec 04 01:03:39.011114 master-0 kubenswrapper[33142]: I1204 01:03:38.797173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" event={"ID":"1594c0bf-04d6-4835-abdf-6b6798fdedf7","Type":"ContainerDied","Data":"19980fa79e02474f53f87e5025bd64ad0fe851dc17035344316e5015e517447f"} Dec 04 01:03:39.011114 master-0 kubenswrapper[33142]: I1204 01:03:38.803381 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjgl7\" (UniqueName: \"kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7\") pod \"cinder-10f14-backup-0\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:39.011114 master-0 kubenswrapper[33142]: I1204 01:03:38.803744 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfq82\" (UniqueName: \"kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:39.011114 master-0 kubenswrapper[33142]: I1204 01:03:38.803905 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tfjf\" (UniqueName: \"kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf\") pod \"dnsmasq-dns-68c967d787-w87gv\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:39.041967 master-0 kubenswrapper[33142]: I1204 01:03:39.028418 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:39.052370 master-0 kubenswrapper[33142]: I1204 01:03:39.052111 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:39.102074 master-0 kubenswrapper[33142]: I1204 01:03:39.099463 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:39.124373 master-0 kubenswrapper[33142]: I1204 01:03:39.124252 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:39.138235 master-0 kubenswrapper[33142]: I1204 01:03:39.138141 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.144526 master-0 kubenswrapper[33142]: I1204 01:03:39.144457 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-api-config-data" Dec 04 01:03:39.155807 master-0 kubenswrapper[33142]: I1204 01:03:39.155730 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:39.360610 master-0 kubenswrapper[33142]: I1204 01:03:39.360555 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360630 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360690 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lg5h\" (UniqueName: \"kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360719 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360780 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360831 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.361287 master-0 kubenswrapper[33142]: I1204 01:03:39.360879 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.396965 master-0 kubenswrapper[33142]: I1204 01:03:39.396857 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:39.464796 master-0 kubenswrapper[33142]: I1204 01:03:39.464713 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.464796 master-0 kubenswrapper[33142]: I1204 01:03:39.464819 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.465221 master-0 kubenswrapper[33142]: I1204 01:03:39.464867 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.465221 master-0 kubenswrapper[33142]: I1204 01:03:39.464905 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.465221 master-0 kubenswrapper[33142]: I1204 01:03:39.464983 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.465221 master-0 kubenswrapper[33142]: I1204 01:03:39.465049 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7lg5h\" (UniqueName: \"kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.465221 master-0 kubenswrapper[33142]: I1204 01:03:39.465087 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.467466 master-0 kubenswrapper[33142]: I1204 01:03:39.467356 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.467851 master-0 kubenswrapper[33142]: I1204 01:03:39.467825 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.473572 master-0 kubenswrapper[33142]: I1204 01:03:39.473487 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.499683 master-0 kubenswrapper[33142]: I1204 01:03:39.499618 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.501547 master-0 kubenswrapper[33142]: I1204 01:03:39.501268 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.517101 master-0 kubenswrapper[33142]: I1204 01:03:39.517039 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lg5h\" (UniqueName: \"kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.517531 master-0 kubenswrapper[33142]: I1204 01:03:39.517116 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.787095 master-0 kubenswrapper[33142]: I1204 01:03:39.786815 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:39.809502 master-0 kubenswrapper[33142]: I1204 01:03:39.807778 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:39.908909 master-0 kubenswrapper[33142]: I1204 01:03:39.908401 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.908909 master-0 kubenswrapper[33142]: I1204 01:03:39.908603 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.908909 master-0 kubenswrapper[33142]: I1204 01:03:39.908658 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.908909 master-0 kubenswrapper[33142]: I1204 01:03:39.908699 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q654l\" (UniqueName: \"kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.909372 master-0 kubenswrapper[33142]: I1204 01:03:39.908967 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.909372 master-0 kubenswrapper[33142]: I1204 01:03:39.909051 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0\") pod \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\" (UID: \"1594c0bf-04d6-4835-abdf-6b6798fdedf7\") " Dec 04 01:03:39.952639 master-0 kubenswrapper[33142]: I1204 01:03:39.952058 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l" (OuterVolumeSpecName: "kube-api-access-q654l") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "kube-api-access-q654l". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:39.998587 master-0 kubenswrapper[33142]: I1204 01:03:39.997835 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" Dec 04 01:03:40.026740 master-0 kubenswrapper[33142]: I1204 01:03:40.023885 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q654l\" (UniqueName: \"kubernetes.io/projected/1594c0bf-04d6-4835-abdf-6b6798fdedf7-kube-api-access-q654l\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.078816 master-0 kubenswrapper[33142]: W1204 01:03:40.074184 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod641fed3d_838b_4515_8ce7_ec745a137916.slice/crio-567447a8cdd83d1c411478b9f753626735091a795a07883974b275ab3f013828 WatchSource:0}: Error finding container 567447a8cdd83d1c411478b9f753626735091a795a07883974b275ab3f013828: Status 404 returned error can't find the container with id 567447a8cdd83d1c411478b9f753626735091a795a07883974b275ab3f013828 Dec 04 01:03:40.099388 master-0 kubenswrapper[33142]: W1204 01:03:40.099309 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94883560_4b58_4914_ae45_e7c8f78c4a18.slice/crio-b6d9e481fe3169334485a056ca6ef134f5c69c98bd8d70def255500d7da43c4d WatchSource:0}: Error finding container b6d9e481fe3169334485a056ca6ef134f5c69c98bd8d70def255500d7da43c4d: Status 404 returned error can't find the container with id b6d9e481fe3169334485a056ca6ef134f5c69c98bd8d70def255500d7da43c4d Dec 04 01:03:40.120211 master-0 kubenswrapper[33142]: I1204 01:03:40.110002 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config" (OuterVolumeSpecName: "config") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:40.126234 master-0 kubenswrapper[33142]: I1204 01:03:40.126188 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.131299 master-0 kubenswrapper[33142]: I1204 01:03:40.131218 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:40.139561 master-0 kubenswrapper[33142]: I1204 01:03:40.139409 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:40.149723 master-0 kubenswrapper[33142]: I1204 01:03:40.149643 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:40.154363 master-0 kubenswrapper[33142]: I1204 01:03:40.154291 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "1594c0bf-04d6-4835-abdf-6b6798fdedf7" (UID: "1594c0bf-04d6-4835-abdf-6b6798fdedf7"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:40.230437 master-0 kubenswrapper[33142]: I1204 01:03:40.230362 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.230437 master-0 kubenswrapper[33142]: I1204 01:03:40.230433 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.230437 master-0 kubenswrapper[33142]: I1204 01:03:40.230449 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.230843 master-0 kubenswrapper[33142]: I1204 01:03:40.230463 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1594c0bf-04d6-4835-abdf-6b6798fdedf7-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:40.244452 master-0 kubenswrapper[33142]: I1204 01:03:40.244331 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-67844cd4d5-9lv8k" event={"ID":"1594c0bf-04d6-4835-abdf-6b6798fdedf7","Type":"ContainerDied","Data":"c3cc75ccc5e8a5d96db7e43f31badb5a50c4f3188b20f3d47d19940657af426f"} Dec 04 01:03:40.244745 master-0 kubenswrapper[33142]: I1204 01:03:40.244470 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerStarted","Data":"9684ceda41498f4a3b3cb780887f2c79d7ad5a69ea9b7120f1caa7f178fe1563"} Dec 04 01:03:40.244745 master-0 kubenswrapper[33142]: I1204 01:03:40.244521 33142 scope.go:117] "RemoveContainer" containerID="19980fa79e02474f53f87e5025bd64ad0fe851dc17035344316e5015e517447f" Dec 04 01:03:40.259571 master-0 kubenswrapper[33142]: I1204 01:03:40.259510 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:40.325225 master-0 kubenswrapper[33142]: I1204 01:03:40.324719 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:40.372393 master-0 kubenswrapper[33142]: I1204 01:03:40.372319 33142 scope.go:117] "RemoveContainer" containerID="688b602cc68b0ec9d9678f32b9d7bb24adc6f0123af2c73940447410f3c137e6" Dec 04 01:03:40.391443 master-0 kubenswrapper[33142]: I1204 01:03:40.387494 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:40.426056 master-0 kubenswrapper[33142]: I1204 01:03:40.425974 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:40.437139 master-0 kubenswrapper[33142]: I1204 01:03:40.437079 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-67844cd4d5-9lv8k"] Dec 04 01:03:40.537758 master-0 kubenswrapper[33142]: I1204 01:03:40.537689 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:40.539197 master-0 kubenswrapper[33142]: W1204 01:03:40.539149 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11581bcf_13c1_4dd1_8fb0_637da0f19987.slice/crio-a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc WatchSource:0}: Error finding container a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc: Status 404 returned error can't find the container with id a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc Dec 04 01:03:41.029532 master-0 kubenswrapper[33142]: I1204 01:03:41.029036 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerStarted","Data":"0b3311f7a1b486b8ce3870df31d31f1a538b40486924d053e58c343d951f324e"} Dec 04 01:03:41.034032 master-0 kubenswrapper[33142]: I1204 01:03:41.033878 33142 generic.go:334] "Generic (PLEG): container finished" podID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerID="76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147" exitCode=0 Dec 04 01:03:41.034158 master-0 kubenswrapper[33142]: I1204 01:03:41.034083 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68c967d787-w87gv" event={"ID":"94883560-4b58-4914-ae45-e7c8f78c4a18","Type":"ContainerDied","Data":"76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147"} Dec 04 01:03:41.034205 master-0 kubenswrapper[33142]: I1204 01:03:41.034187 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68c967d787-w87gv" event={"ID":"94883560-4b58-4914-ae45-e7c8f78c4a18","Type":"ContainerStarted","Data":"b6d9e481fe3169334485a056ca6ef134f5c69c98bd8d70def255500d7da43c4d"} Dec 04 01:03:41.045659 master-0 kubenswrapper[33142]: I1204 01:03:41.044780 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerStarted","Data":"567447a8cdd83d1c411478b9f753626735091a795a07883974b275ab3f013828"} Dec 04 01:03:41.064811 master-0 kubenswrapper[33142]: I1204 01:03:41.064629 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerStarted","Data":"a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc"} Dec 04 01:03:41.917534 master-0 kubenswrapper[33142]: I1204 01:03:41.917436 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" path="/var/lib/kubelet/pods/1594c0bf-04d6-4835-abdf-6b6798fdedf7/volumes" Dec 04 01:03:42.108885 master-0 kubenswrapper[33142]: I1204 01:03:42.108801 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerStarted","Data":"c95f5cd2ee4faef7f39bb5ee350add098b202d68175c9f2586aa5695c11976f0"} Dec 04 01:03:42.116304 master-0 kubenswrapper[33142]: I1204 01:03:42.111606 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerStarted","Data":"00de5c54fd07cdc1ace4c54dbb61570d9bfa9ac46b5b1365c9554a309116ce8b"} Dec 04 01:03:43.132017 master-0 kubenswrapper[33142]: I1204 01:03:43.131746 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerStarted","Data":"101a56872548c49880477917a27fb329e7cc2f55da6dc7baf4f946bdd8feb2d4"} Dec 04 01:03:43.135582 master-0 kubenswrapper[33142]: I1204 01:03:43.135516 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68c967d787-w87gv" event={"ID":"94883560-4b58-4914-ae45-e7c8f78c4a18","Type":"ContainerStarted","Data":"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3"} Dec 04 01:03:43.135704 master-0 kubenswrapper[33142]: I1204 01:03:43.135616 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:43.138664 master-0 kubenswrapper[33142]: I1204 01:03:43.138606 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerStarted","Data":"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765"} Dec 04 01:03:44.182202 master-0 kubenswrapper[33142]: I1204 01:03:44.182132 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerStarted","Data":"da050ddaa4ed1e2db4495bc2b353eab7873cc1dbbedaed9122cd3c852f5cd95f"} Dec 04 01:03:44.200954 master-0 kubenswrapper[33142]: I1204 01:03:44.195462 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerStarted","Data":"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181"} Dec 04 01:03:44.208959 master-0 kubenswrapper[33142]: I1204 01:03:44.207976 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-68c967d787-w87gv" podStartSLOduration=6.207951824 podStartE2EDuration="6.207951824s" podCreationTimestamp="2025-12-04 01:03:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:43.573128469 +0000 UTC m=+995.975130329" watchObservedRunningTime="2025-12-04 01:03:44.207951824 +0000 UTC m=+996.609953684" Dec 04 01:03:44.212946 master-0 kubenswrapper[33142]: I1204 01:03:44.211409 33142 generic.go:334] "Generic (PLEG): container finished" podID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerID="9b2b8f16edfb8779700075ee642590335913fc12d212a5a35429654ecd4b23cf" exitCode=0 Dec 04 01:03:44.212946 master-0 kubenswrapper[33142]: I1204 01:03:44.211853 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-7jmp5" event={"ID":"58b60ff8-26fd-4896-966a-24078d04bfbf","Type":"ContainerDied","Data":"9b2b8f16edfb8779700075ee642590335913fc12d212a5a35429654ecd4b23cf"} Dec 04 01:03:44.212946 master-0 kubenswrapper[33142]: I1204 01:03:44.212951 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:44.222841 master-0 kubenswrapper[33142]: I1204 01:03:44.221495 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:44.256327 master-0 kubenswrapper[33142]: I1204 01:03:44.253994 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-scheduler-0" podStartSLOduration=5.162016563 podStartE2EDuration="6.253956149s" podCreationTimestamp="2025-12-04 01:03:38 +0000 UTC" firstStartedPulling="2025-12-04 01:03:39.427480811 +0000 UTC m=+991.829482661" lastFinishedPulling="2025-12-04 01:03:40.519420397 +0000 UTC m=+992.921422247" observedRunningTime="2025-12-04 01:03:44.218719727 +0000 UTC m=+996.620721587" watchObservedRunningTime="2025-12-04 01:03:44.253956149 +0000 UTC m=+996.655957999" Dec 04 01:03:44.312768 master-0 kubenswrapper[33142]: I1204 01:03:44.312644 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" podStartSLOduration=5.394587164 podStartE2EDuration="6.312611971s" podCreationTimestamp="2025-12-04 01:03:38 +0000 UTC" firstStartedPulling="2025-12-04 01:03:40.079864711 +0000 UTC m=+992.481866561" lastFinishedPulling="2025-12-04 01:03:40.997889518 +0000 UTC m=+993.399891368" observedRunningTime="2025-12-04 01:03:44.252680383 +0000 UTC m=+996.654682243" watchObservedRunningTime="2025-12-04 01:03:44.312611971 +0000 UTC m=+996.714613821" Dec 04 01:03:44.338952 master-0 kubenswrapper[33142]: I1204 01:03:44.338084 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-api-0" podStartSLOduration=5.338055737 podStartE2EDuration="5.338055737s" podCreationTimestamp="2025-12-04 01:03:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:44.291904278 +0000 UTC m=+996.693906158" watchObservedRunningTime="2025-12-04 01:03:44.338055737 +0000 UTC m=+996.740057587" Dec 04 01:03:45.228993 master-0 kubenswrapper[33142]: I1204 01:03:45.228859 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerStarted","Data":"e0eed37c497b958c717ce5eed9824e22c12d86670983266a6716a95a0198b977"} Dec 04 01:03:45.228993 master-0 kubenswrapper[33142]: I1204 01:03:45.228963 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerStarted","Data":"55cfabe1e9f12151e6a25f49d3b7f521bc3945f4cd91a724e62e5bc524a54af0"} Dec 04 01:03:45.288208 master-0 kubenswrapper[33142]: I1204 01:03:45.270632 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-backup-0" podStartSLOduration=4.102400628 podStartE2EDuration="7.270606364s" podCreationTimestamp="2025-12-04 01:03:38 +0000 UTC" firstStartedPulling="2025-12-04 01:03:40.464967494 +0000 UTC m=+992.866969344" lastFinishedPulling="2025-12-04 01:03:43.63317323 +0000 UTC m=+996.035175080" observedRunningTime="2025-12-04 01:03:45.256759464 +0000 UTC m=+997.658761334" watchObservedRunningTime="2025-12-04 01:03:45.270606364 +0000 UTC m=+997.672608214" Dec 04 01:03:45.766060 master-0 kubenswrapper[33142]: I1204 01:03:45.766008 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:45.951923 master-0 kubenswrapper[33142]: I1204 01:03:45.951719 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.952257 master-0 kubenswrapper[33142]: I1204 01:03:45.951965 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scf68\" (UniqueName: \"kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.952607 master-0 kubenswrapper[33142]: I1204 01:03:45.952584 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.952685 master-0 kubenswrapper[33142]: I1204 01:03:45.952661 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.953071 master-0 kubenswrapper[33142]: I1204 01:03:45.953049 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.953343 master-0 kubenswrapper[33142]: I1204 01:03:45.953317 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle\") pod \"58b60ff8-26fd-4896-966a-24078d04bfbf\" (UID: \"58b60ff8-26fd-4896-966a-24078d04bfbf\") " Dec 04 01:03:45.961519 master-0 kubenswrapper[33142]: I1204 01:03:45.959784 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts" (OuterVolumeSpecName: "scripts") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:45.961519 master-0 kubenswrapper[33142]: I1204 01:03:45.960627 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 01:03:45.962495 master-0 kubenswrapper[33142]: I1204 01:03:45.960321 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged" (OuterVolumeSpecName: "config-data-merged") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "config-data-merged". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:45.977419 master-0 kubenswrapper[33142]: I1204 01:03:45.964828 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68" (OuterVolumeSpecName: "kube-api-access-scf68") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "kube-api-access-scf68". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:46.004960 master-0 kubenswrapper[33142]: I1204 01:03:45.990237 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.004960 master-0 kubenswrapper[33142]: I1204 01:03:45.990316 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data-merged\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.004960 master-0 kubenswrapper[33142]: I1204 01:03:45.990354 33142 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b60ff8-26fd-4896-966a-24078d04bfbf-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.004960 master-0 kubenswrapper[33142]: I1204 01:03:45.990372 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-scf68\" (UniqueName: \"kubernetes.io/projected/58b60ff8-26fd-4896-966a-24078d04bfbf-kube-api-access-scf68\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.017319 master-0 kubenswrapper[33142]: I1204 01:03:46.017206 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data" (OuterVolumeSpecName: "config-data") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:46.053421 master-0 kubenswrapper[33142]: I1204 01:03:46.053325 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "58b60ff8-26fd-4896-966a-24078d04bfbf" (UID: "58b60ff8-26fd-4896-966a-24078d04bfbf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:46.093565 master-0 kubenswrapper[33142]: I1204 01:03:46.093499 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.093565 master-0 kubenswrapper[33142]: I1204 01:03:46.093553 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b60ff8-26fd-4896-966a-24078d04bfbf-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:46.243357 master-0 kubenswrapper[33142]: I1204 01:03:46.243182 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-7jmp5" event={"ID":"58b60ff8-26fd-4896-966a-24078d04bfbf","Type":"ContainerDied","Data":"8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53"} Dec 04 01:03:46.243357 master-0 kubenswrapper[33142]: I1204 01:03:46.243275 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8164df82cd403fc3a3d900251fb37c8ca6592911703c476a04b975d26314cd53" Dec 04 01:03:46.243855 master-0 kubenswrapper[33142]: I1204 01:03:46.243406 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-7jmp5" Dec 04 01:03:46.244730 master-0 kubenswrapper[33142]: I1204 01:03:46.244651 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-api-0" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-10f14-api-log" containerID="cri-o://c95f5cd2ee4faef7f39bb5ee350add098b202d68175c9f2586aa5695c11976f0" gracePeriod=30 Dec 04 01:03:46.245497 master-0 kubenswrapper[33142]: I1204 01:03:46.245455 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-api-0" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-api" containerID="cri-o://101a56872548c49880477917a27fb329e7cc2f55da6dc7baf4f946bdd8feb2d4" gracePeriod=30 Dec 04 01:03:46.765621 master-0 kubenswrapper[33142]: I1204 01:03:46.765481 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-db-create-dqvwx"] Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: E1204 01:03:46.766349 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="init" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766385 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="init" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: E1204 01:03:46.766410 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerName="init" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766419 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerName="init" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: E1204 01:03:46.766450 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="dnsmasq-dns" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766456 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="dnsmasq-dns" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: E1204 01:03:46.766471 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerName="ironic-db-sync" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766479 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerName="ironic-db-sync" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766697 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1594c0bf-04d6-4835-abdf-6b6798fdedf7" containerName="dnsmasq-dns" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.766739 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" containerName="ironic-db-sync" Dec 04 01:03:46.768188 master-0 kubenswrapper[33142]: I1204 01:03:46.767507 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:46.837827 master-0 kubenswrapper[33142]: I1204 01:03:46.828715 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-create-dqvwx"] Dec 04 01:03:46.933952 master-0 kubenswrapper[33142]: I1204 01:03:46.933144 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:46.953961 master-0 kubenswrapper[33142]: I1204 01:03:46.946380 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95gv\" (UniqueName: \"kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.097652 master-0 kubenswrapper[33142]: I1204 01:03:47.096387 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.097652 master-0 kubenswrapper[33142]: I1204 01:03:47.096456 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f95gv\" (UniqueName: \"kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.099231 master-0 kubenswrapper[33142]: I1204 01:03:47.099188 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.101885 master-0 kubenswrapper[33142]: I1204 01:03:47.101848 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-neutron-agent-6cddc778dc-52tq5"] Dec 04 01:03:47.139667 master-0 kubenswrapper[33142]: I1204 01:03:47.126487 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-neutron-agent-6cddc778dc-52tq5"] Dec 04 01:03:47.139667 master-0 kubenswrapper[33142]: I1204 01:03:47.126980 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.146121 master-0 kubenswrapper[33142]: I1204 01:03:47.145168 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-ironic-neutron-agent-config-data" Dec 04 01:03:47.177361 master-0 kubenswrapper[33142]: I1204 01:03:47.177281 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95gv\" (UniqueName: \"kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv\") pod \"ironic-inspector-db-create-dqvwx\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.177693 master-0 kubenswrapper[33142]: I1204 01:03:47.177517 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:47.178262 master-0 kubenswrapper[33142]: I1204 01:03:47.178221 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-68c967d787-w87gv" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="dnsmasq-dns" containerID="cri-o://66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3" gracePeriod=10 Dec 04 01:03:47.181596 master-0 kubenswrapper[33142]: I1204 01:03:47.181555 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:47.200181 master-0 kubenswrapper[33142]: I1204 01:03:47.199919 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjfpc\" (UniqueName: \"kubernetes.io/projected/adc15fbc-accb-467e-9fd9-25ffb68a297e-kube-api-access-kjfpc\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.200181 master-0 kubenswrapper[33142]: I1204 01:03:47.200092 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-combined-ca-bundle\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.200181 master-0 kubenswrapper[33142]: I1204 01:03:47.200155 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-config\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.217213 master-0 kubenswrapper[33142]: I1204 01:03:47.210723 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:47.217213 master-0 kubenswrapper[33142]: I1204 01:03:47.215761 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-05b7-account-create-update-9pb5q"] Dec 04 01:03:47.229393 master-0 kubenswrapper[33142]: I1204 01:03:47.228399 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.234342 master-0 kubenswrapper[33142]: I1204 01:03:47.234273 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-db-secret" Dec 04 01:03:47.246781 master-0 kubenswrapper[33142]: I1204 01:03:47.246564 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-05b7-account-create-update-9pb5q"] Dec 04 01:03:47.264523 master-0 kubenswrapper[33142]: I1204 01:03:47.264470 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:03:47.267340 master-0 kubenswrapper[33142]: I1204 01:03:47.267300 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.280999 33142 generic.go:334] "Generic (PLEG): container finished" podID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerID="101a56872548c49880477917a27fb329e7cc2f55da6dc7baf4f946bdd8feb2d4" exitCode=0 Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.281044 33142 generic.go:334] "Generic (PLEG): container finished" podID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerID="c95f5cd2ee4faef7f39bb5ee350add098b202d68175c9f2586aa5695c11976f0" exitCode=143 Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.281067 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerDied","Data":"101a56872548c49880477917a27fb329e7cc2f55da6dc7baf4f946bdd8feb2d4"} Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.281126 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerDied","Data":"c95f5cd2ee4faef7f39bb5ee350add098b202d68175c9f2586aa5695c11976f0"} Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.281139 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"11581bcf-13c1-4dd1-8fb0-637da0f19987","Type":"ContainerDied","Data":"a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc"} Dec 04 01:03:47.281666 master-0 kubenswrapper[33142]: I1204 01:03:47.281149 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a12e6fab2b1a5481a0a87cc8f154f7d7fe1d1564b04128eda2a2460921a413fc" Dec 04 01:03:47.287075 master-0 kubenswrapper[33142]: I1204 01:03:47.287016 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:03:47.310325 master-0 kubenswrapper[33142]: I1204 01:03:47.310255 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310347 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310402 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kjfpc\" (UniqueName: \"kubernetes.io/projected/adc15fbc-accb-467e-9fd9-25ffb68a297e-kube-api-access-kjfpc\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310454 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdhgz\" (UniqueName: \"kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310492 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8x78\" (UniqueName: \"kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310555 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-combined-ca-bundle\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310591 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310619 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310635 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.310674 master-0 kubenswrapper[33142]: I1204 01:03:47.310665 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-config\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.316377 master-0 kubenswrapper[33142]: I1204 01:03:47.316302 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.335575 master-0 kubenswrapper[33142]: I1204 01:03:47.318025 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:03:47.335575 master-0 kubenswrapper[33142]: I1204 01:03:47.335498 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:03:47.335575 master-0 kubenswrapper[33142]: I1204 01:03:47.333890 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-config\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.336005 master-0 kubenswrapper[33142]: I1204 01:03:47.333804 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adc15fbc-accb-467e-9fd9-25ffb68a297e-combined-ca-bundle\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.337867 master-0 kubenswrapper[33142]: I1204 01:03:47.337809 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 01:03:47.338137 master-0 kubenswrapper[33142]: I1204 01:03:47.338049 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-scripts" Dec 04 01:03:47.338622 master-0 kubenswrapper[33142]: I1204 01:03:47.338583 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-transport" Dec 04 01:03:47.338958 master-0 kubenswrapper[33142]: I1204 01:03:47.338923 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-config-data" Dec 04 01:03:47.339464 master-0 kubenswrapper[33142]: I1204 01:03:47.339432 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjfpc\" (UniqueName: \"kubernetes.io/projected/adc15fbc-accb-467e-9fd9-25ffb68a297e-kube-api-access-kjfpc\") pod \"ironic-neutron-agent-6cddc778dc-52tq5\" (UID: \"adc15fbc-accb-467e-9fd9-25ffb68a297e\") " pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.345252 master-0 kubenswrapper[33142]: I1204 01:03:47.342392 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-config-data" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419542 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419694 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419727 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zdhgz\" (UniqueName: \"kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419786 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t8x78\" (UniqueName: \"kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419844 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419869 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419942 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419967 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.419991 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420026 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420052 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420101 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420137 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420237 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420283 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqjx\" (UniqueName: \"kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.420319 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.421522 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.423291 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.425979 master-0 kubenswrapper[33142]: I1204 01:03:47.424497 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.426985 master-0 kubenswrapper[33142]: I1204 01:03:47.426078 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.426985 master-0 kubenswrapper[33142]: I1204 01:03:47.426283 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.426985 master-0 kubenswrapper[33142]: I1204 01:03:47.426799 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.442424 master-0 kubenswrapper[33142]: I1204 01:03:47.442326 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8x78\" (UniqueName: \"kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78\") pod \"ironic-inspector-05b7-account-create-update-9pb5q\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.449790 master-0 kubenswrapper[33142]: I1204 01:03:47.449734 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:47.450614 master-0 kubenswrapper[33142]: I1204 01:03:47.450578 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdhgz\" (UniqueName: \"kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz\") pod \"dnsmasq-dns-559c48b76f-hnvxg\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.471235 master-0 kubenswrapper[33142]: I1204 01:03:47.469691 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:47.474484 master-0 kubenswrapper[33142]: I1204 01:03:47.474023 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:47.487100 master-0 kubenswrapper[33142]: I1204 01:03:47.486905 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.542588 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.542699 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.542799 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.542853 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.543014 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.543064 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.543315 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lg5h\" (UniqueName: \"kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.552379 master-0 kubenswrapper[33142]: I1204 01:03:47.543372 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs" (OuterVolumeSpecName: "logs") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:03:47.561903 master-0 kubenswrapper[33142]: I1204 01:03:47.555621 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h" (OuterVolumeSpecName: "kube-api-access-7lg5h") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "kube-api-access-7lg5h". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:47.573626 master-0 kubenswrapper[33142]: I1204 01:03:47.573518 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:47.575300 master-0 kubenswrapper[33142]: I1204 01:03:47.575189 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts" (OuterVolumeSpecName: "scripts") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:47.575566 master-0 kubenswrapper[33142]: I1204 01:03:47.575532 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data\") pod \"11581bcf-13c1-4dd1-8fb0-637da0f19987\" (UID: \"11581bcf-13c1-4dd1-8fb0-637da0f19987\") " Dec 04 01:03:47.576888 master-0 kubenswrapper[33142]: I1204 01:03:47.576847 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-swqjx\" (UniqueName: \"kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.577032 master-0 kubenswrapper[33142]: I1204 01:03:47.577010 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.578852 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.579075 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.579195 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.579530 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.579867 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.579970 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.580188 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7lg5h\" (UniqueName: \"kubernetes.io/projected/11581bcf-13c1-4dd1-8fb0-637da0f19987-kube-api-access-7lg5h\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.580214 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.580226 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11581bcf-13c1-4dd1-8fb0-637da0f19987-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.580236 33142 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/11581bcf-13c1-4dd1-8fb0-637da0f19987-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.583484 master-0 kubenswrapper[33142]: I1204 01:03:47.580247 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.595784 master-0 kubenswrapper[33142]: I1204 01:03:47.594575 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.602263 master-0 kubenswrapper[33142]: I1204 01:03:47.600662 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.602263 master-0 kubenswrapper[33142]: I1204 01:03:47.600758 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.602263 master-0 kubenswrapper[33142]: I1204 01:03:47.601433 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.602263 master-0 kubenswrapper[33142]: I1204 01:03:47.602200 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.604722 master-0 kubenswrapper[33142]: I1204 01:03:47.604699 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.627766 master-0 kubenswrapper[33142]: I1204 01:03:47.625752 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.631198 master-0 kubenswrapper[33142]: I1204 01:03:47.631051 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqjx\" (UniqueName: \"kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx\") pod \"ironic-594b84b4f-dpqbk\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.709588 master-0 kubenswrapper[33142]: I1204 01:03:47.695309 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:47.718199 master-0 kubenswrapper[33142]: I1204 01:03:47.714649 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:47.841824 master-0 kubenswrapper[33142]: I1204 01:03:47.841738 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:47.853072 master-0 kubenswrapper[33142]: I1204 01:03:47.851174 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data" (OuterVolumeSpecName: "config-data") pod "11581bcf-13c1-4dd1-8fb0-637da0f19987" (UID: "11581bcf-13c1-4dd1-8fb0-637da0f19987"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:47.934908 master-0 kubenswrapper[33142]: I1204 01:03:47.934817 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11581bcf-13c1-4dd1-8fb0-637da0f19987-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:48.058626 master-0 kubenswrapper[33142]: I1204 01:03:48.058569 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-create-dqvwx"] Dec 04 01:03:48.207955 master-0 kubenswrapper[33142]: I1204 01:03:48.202841 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:48.314180 master-0 kubenswrapper[33142]: I1204 01:03:48.313624 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-dqvwx" event={"ID":"9316ecfd-a283-41ed-a77e-225a9e118d4e","Type":"ContainerStarted","Data":"236e28feb8205f13810d59d06f9825f20c4ea7258313afccbbbf062dff2713bc"} Dec 04 01:03:48.321272 master-0 kubenswrapper[33142]: I1204 01:03:48.320659 33142 generic.go:334] "Generic (PLEG): container finished" podID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerID="66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3" exitCode=0 Dec 04 01:03:48.321272 master-0 kubenswrapper[33142]: I1204 01:03:48.320788 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.321970 master-0 kubenswrapper[33142]: I1204 01:03:48.321909 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68c967d787-w87gv" Dec 04 01:03:48.322113 master-0 kubenswrapper[33142]: I1204 01:03:48.321956 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68c967d787-w87gv" event={"ID":"94883560-4b58-4914-ae45-e7c8f78c4a18","Type":"ContainerDied","Data":"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3"} Dec 04 01:03:48.322235 master-0 kubenswrapper[33142]: I1204 01:03:48.322215 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68c967d787-w87gv" event={"ID":"94883560-4b58-4914-ae45-e7c8f78c4a18","Type":"ContainerDied","Data":"b6d9e481fe3169334485a056ca6ef134f5c69c98bd8d70def255500d7da43c4d"} Dec 04 01:03:48.322333 master-0 kubenswrapper[33142]: I1204 01:03:48.322315 33142 scope.go:117] "RemoveContainer" containerID="66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3" Dec 04 01:03:48.342069 master-0 kubenswrapper[33142]: I1204 01:03:48.341491 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.342069 master-0 kubenswrapper[33142]: I1204 01:03:48.341545 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.342069 master-0 kubenswrapper[33142]: I1204 01:03:48.341670 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.342069 master-0 kubenswrapper[33142]: I1204 01:03:48.341704 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tfjf\" (UniqueName: \"kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.342069 master-0 kubenswrapper[33142]: I1204 01:03:48.341780 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.348068 master-0 kubenswrapper[33142]: I1204 01:03:48.348015 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb\") pod \"94883560-4b58-4914-ae45-e7c8f78c4a18\" (UID: \"94883560-4b58-4914-ae45-e7c8f78c4a18\") " Dec 04 01:03:48.350248 master-0 kubenswrapper[33142]: I1204 01:03:48.350197 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf" (OuterVolumeSpecName: "kube-api-access-9tfjf") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "kube-api-access-9tfjf". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:48.384363 master-0 kubenswrapper[33142]: I1204 01:03:48.381745 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:48.411172 master-0 kubenswrapper[33142]: I1204 01:03:48.410825 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.434790 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.435019 33142 scope.go:117] "RemoveContainer" containerID="76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: E1204 01:03:48.435541 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-10f14-api-log" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.435559 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-10f14-api-log" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: E1204 01:03:48.435589 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="init" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.435595 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="init" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: E1204 01:03:48.435634 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-api" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.435640 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-api" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: E1204 01:03:48.435657 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="dnsmasq-dns" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.435663 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="dnsmasq-dns" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.436061 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" containerName="dnsmasq-dns" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.436103 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-10f14-api-log" Dec 04 01:03:48.437312 master-0 kubenswrapper[33142]: I1204 01:03:48.436134 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" containerName="cinder-api" Dec 04 01:03:48.460043 master-0 kubenswrapper[33142]: I1204 01:03:48.458942 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.464913 master-0 kubenswrapper[33142]: I1204 01:03:48.464535 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-public-svc" Dec 04 01:03:48.464913 master-0 kubenswrapper[33142]: I1204 01:03:48.464759 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-api-config-data" Dec 04 01:03:48.476340 master-0 kubenswrapper[33142]: I1204 01:03:48.471499 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9tfjf\" (UniqueName: \"kubernetes.io/projected/94883560-4b58-4914-ae45-e7c8f78c4a18-kube-api-access-9tfjf\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:48.476340 master-0 kubenswrapper[33142]: I1204 01:03:48.471580 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-internal-svc" Dec 04 01:03:48.513324 master-0 kubenswrapper[33142]: I1204 01:03:48.507394 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:48.528550 master-0 kubenswrapper[33142]: I1204 01:03:48.527148 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583715 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-internal-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583766 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583796 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583847 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-scripts\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583891 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbw7b\" (UniqueName: \"kubernetes.io/projected/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-kube-api-access-dbw7b\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583959 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583979 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.583995 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-public-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.586978 master-0 kubenswrapper[33142]: I1204 01:03:48.584070 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-logs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.685976 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-scripts\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686054 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbw7b\" (UniqueName: \"kubernetes.io/projected/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-kube-api-access-dbw7b\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686115 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686134 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686152 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-public-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686260 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-logs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686293 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-internal-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686315 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.686338 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.687189 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-etc-machine-id\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.689218 master-0 kubenswrapper[33142]: I1204 01:03:48.688312 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-logs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.706224 master-0 kubenswrapper[33142]: I1204 01:03:48.695885 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-05b7-account-create-update-9pb5q"] Dec 04 01:03:48.756830 master-0 kubenswrapper[33142]: I1204 01:03:48.753021 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:03:48.879126 master-0 kubenswrapper[33142]: I1204 01:03:48.851022 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-neutron-agent-6cddc778dc-52tq5"] Dec 04 01:03:48.881281 master-0 kubenswrapper[33142]: I1204 01:03:48.881227 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-internal-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.882278 master-0 kubenswrapper[33142]: I1204 01:03:48.882221 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-combined-ca-bundle\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.882365 master-0 kubenswrapper[33142]: I1204 01:03:48.882316 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data-custom\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.882756 master-0 kubenswrapper[33142]: I1204 01:03:48.882697 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-scripts\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.883854 master-0 kubenswrapper[33142]: I1204 01:03:48.883798 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-config-data\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.884625 master-0 kubenswrapper[33142]: I1204 01:03:48.884597 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-public-tls-certs\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.886137 master-0 kubenswrapper[33142]: I1204 01:03:48.886085 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbw7b\" (UniqueName: \"kubernetes.io/projected/2761ce07-ecd2-4a5d-b6ba-e2a63971b932-kube-api-access-dbw7b\") pod \"cinder-10f14-api-0\" (UID: \"2761ce07-ecd2-4a5d-b6ba-e2a63971b932\") " pod="openstack/cinder-10f14-api-0" Dec 04 01:03:48.924201 master-0 kubenswrapper[33142]: I1204 01:03:48.924144 33142 scope.go:117] "RemoveContainer" containerID="66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3" Dec 04 01:03:48.925027 master-0 kubenswrapper[33142]: E1204 01:03:48.924780 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3\": container with ID starting with 66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3 not found: ID does not exist" containerID="66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3" Dec 04 01:03:48.925027 master-0 kubenswrapper[33142]: I1204 01:03:48.924823 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3"} err="failed to get container status \"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3\": rpc error: code = NotFound desc = could not find container \"66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3\": container with ID starting with 66098f6bf588735432ca01034ce1501bf32dc6f390b75754a35d308f34dfa2b3 not found: ID does not exist" Dec 04 01:03:48.925027 master-0 kubenswrapper[33142]: I1204 01:03:48.924846 33142 scope.go:117] "RemoveContainer" containerID="76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147" Dec 04 01:03:48.926967 master-0 kubenswrapper[33142]: I1204 01:03:48.926879 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:03:48.928316 master-0 kubenswrapper[33142]: E1204 01:03:48.928211 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147\": container with ID starting with 76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147 not found: ID does not exist" containerID="76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147" Dec 04 01:03:48.928316 master-0 kubenswrapper[33142]: I1204 01:03:48.928258 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147"} err="failed to get container status \"76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147\": rpc error: code = NotFound desc = could not find container \"76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147\": container with ID starting with 76c9dfad8ee7e3216fa27457ca8ffc3456cd62cf0dbaf062882f291063fc8147 not found: ID does not exist" Dec 04 01:03:48.940311 master-0 kubenswrapper[33142]: I1204 01:03:48.940139 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 01:03:48.947267 master-0 kubenswrapper[33142]: W1204 01:03:48.947190 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796ef01_4e44_44ef_8509_7e13a0562449.slice/crio-1a3ea49fe7e39385dee40163c6e6b5d2cc08999e6b3d81f09310347633f90db5 WatchSource:0}: Error finding container 1a3ea49fe7e39385dee40163c6e6b5d2cc08999e6b3d81f09310347633f90db5: Status 404 returned error can't find the container with id 1a3ea49fe7e39385dee40163c6e6b5d2cc08999e6b3d81f09310347633f90db5 Dec 04 01:03:48.948422 master-0 kubenswrapper[33142]: I1204 01:03:48.948378 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-conductor-0" Dec 04 01:03:48.961498 master-0 kubenswrapper[33142]: W1204 01:03:48.961110 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadc15fbc_accb_467e_9fd9_25ffb68a297e.slice/crio-86f76d491c568d5b2fe9257c3626aea9faefbdcd3b55544276dc696499a650e8 WatchSource:0}: Error finding container 86f76d491c568d5b2fe9257c3626aea9faefbdcd3b55544276dc696499a650e8: Status 404 returned error can't find the container with id 86f76d491c568d5b2fe9257c3626aea9faefbdcd3b55544276dc696499a650e8 Dec 04 01:03:48.962465 master-0 kubenswrapper[33142]: I1204 01:03:48.962379 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-conductor-config-data" Dec 04 01:03:48.962615 master-0 kubenswrapper[33142]: I1204 01:03:48.962588 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-conductor-scripts" Dec 04 01:03:48.991551 master-0 kubenswrapper[33142]: I1204 01:03:48.986163 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 01:03:49.025216 master-0 kubenswrapper[33142]: I1204 01:03:49.023620 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:49.030148 master-0 kubenswrapper[33142]: I1204 01:03:49.030081 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:49.045835 master-0 kubenswrapper[33142]: I1204 01:03:49.045765 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76p6l\" (UniqueName: \"kubernetes.io/projected/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-kube-api-access-76p6l\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.045966 master-0 kubenswrapper[33142]: I1204 01:03:49.045883 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046441 master-0 kubenswrapper[33142]: I1204 01:03:49.046404 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-scripts\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046491 master-0 kubenswrapper[33142]: I1204 01:03:49.046460 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-74b902de-7b83-4083-b3e3-49126b9e3e59\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4a402b50-7331-4060-9ffe-8e9beeafdee1\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046523 master-0 kubenswrapper[33142]: I1204 01:03:49.046510 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046562 master-0 kubenswrapper[33142]: I1204 01:03:49.046547 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046605 master-0 kubenswrapper[33142]: I1204 01:03:49.046587 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046676 master-0 kubenswrapper[33142]: I1204 01:03:49.046647 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.046766 master-0 kubenswrapper[33142]: I1204 01:03:49.046736 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:49.089280 master-0 kubenswrapper[33142]: I1204 01:03:49.088329 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:49.090532 master-0 kubenswrapper[33142]: I1204 01:03:49.090393 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:49.091015 master-0 kubenswrapper[33142]: I1204 01:03:49.090948 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:49.100080 master-0 kubenswrapper[33142]: I1204 01:03:49.100032 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:49.106664 master-0 kubenswrapper[33142]: I1204 01:03:49.106596 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:49.138391 master-0 kubenswrapper[33142]: I1204 01:03:49.138308 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config" (OuterVolumeSpecName: "config") pod "94883560-4b58-4914-ae45-e7c8f78c4a18" (UID: "94883560-4b58-4914-ae45-e7c8f78c4a18"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.148870 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149173 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-scripts\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149236 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-74b902de-7b83-4083-b3e3-49126b9e3e59\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4a402b50-7331-4060-9ffe-8e9beeafdee1\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149292 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149350 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149420 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149477 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149520 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76p6l\" (UniqueName: \"kubernetes.io/projected/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-kube-api-access-76p6l\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149622 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149641 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149656 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.149670 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/94883560-4b58-4914-ae45-e7c8f78c4a18-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.150485 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.153829 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.155770 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.155830 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-74b902de-7b83-4083-b3e3-49126b9e3e59\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4a402b50-7331-4060-9ffe-8e9beeafdee1\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/284a93acd874b16cef1d2f06ddfc0730c4ade0f75684097ffd9691001634c6a9/globalmount\"" pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.156299 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.156747 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-scripts\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.162568 master-0 kubenswrapper[33142]: I1204 01:03:49.158780 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-config-data\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.175619 master-0 kubenswrapper[33142]: I1204 01:03:49.175430 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:49.178520 master-0 kubenswrapper[33142]: I1204 01:03:49.176239 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.182219 master-0 kubenswrapper[33142]: I1204 01:03:49.182115 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76p6l\" (UniqueName: \"kubernetes.io/projected/1cbaa187-8869-4d39-8ce7-c4fad127b6d5-kube-api-access-76p6l\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:49.359549 master-0 kubenswrapper[33142]: I1204 01:03:49.359466 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" event={"ID":"15a3bddd-ade5-4f66-995d-ce71f0a04b5f","Type":"ContainerStarted","Data":"3973934a9f87ee9be16ea6dc6abb8795dc353c28247f097f98af04d4870958f1"} Dec 04 01:03:49.363526 master-0 kubenswrapper[33142]: I1204 01:03:49.363394 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:49.374961 master-0 kubenswrapper[33142]: I1204 01:03:49.374845 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerStarted","Data":"86f76d491c568d5b2fe9257c3626aea9faefbdcd3b55544276dc696499a650e8"} Dec 04 01:03:49.378430 master-0 kubenswrapper[33142]: I1204 01:03:49.378406 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" event={"ID":"f796ef01-4e44-44ef-8509-7e13a0562449","Type":"ContainerStarted","Data":"1a3ea49fe7e39385dee40163c6e6b5d2cc08999e6b3d81f09310347633f90db5"} Dec 04 01:03:49.403371 master-0 kubenswrapper[33142]: I1204 01:03:49.393397 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-dqvwx" event={"ID":"9316ecfd-a283-41ed-a77e-225a9e118d4e","Type":"ContainerStarted","Data":"8cbb2f1dc31ebb1f1e0a69df6ac0be55d3e04892e565bcff8bd3af318ada64d8"} Dec 04 01:03:49.403371 master-0 kubenswrapper[33142]: I1204 01:03:49.402114 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerStarted","Data":"d68eb0fdfeffc1e8fd2b13a65ff85b8555a134cc7f2ecf84ef7105044b79992d"} Dec 04 01:03:49.570839 master-0 kubenswrapper[33142]: I1204 01:03:49.570755 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:49.580956 master-0 kubenswrapper[33142]: I1204 01:03:49.576396 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-inspector-db-create-dqvwx" podStartSLOduration=3.57636732 podStartE2EDuration="3.57636732s" podCreationTimestamp="2025-12-04 01:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:49.564577708 +0000 UTC m=+1001.966579558" watchObservedRunningTime="2025-12-04 01:03:49.57636732 +0000 UTC m=+1001.978369170" Dec 04 01:03:49.665696 master-0 kubenswrapper[33142]: I1204 01:03:49.665624 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:49.731362 master-0 kubenswrapper[33142]: I1204 01:03:49.731159 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:49.757664 master-0 kubenswrapper[33142]: I1204 01:03:49.752282 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:49.775727 master-0 kubenswrapper[33142]: I1204 01:03:49.772657 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-68c967d787-w87gv"] Dec 04 01:03:49.819304 master-0 kubenswrapper[33142]: I1204 01:03:49.819058 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-api-0"] Dec 04 01:03:49.897002 master-0 kubenswrapper[33142]: I1204 01:03:49.896916 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:49.921355 master-0 kubenswrapper[33142]: I1204 01:03:49.919423 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11581bcf-13c1-4dd1-8fb0-637da0f19987" path="/var/lib/kubelet/pods/11581bcf-13c1-4dd1-8fb0-637da0f19987/volumes" Dec 04 01:03:49.921355 master-0 kubenswrapper[33142]: I1204 01:03:49.920198 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94883560-4b58-4914-ae45-e7c8f78c4a18" path="/var/lib/kubelet/pods/94883560-4b58-4914-ae45-e7c8f78c4a18/volumes" Dec 04 01:03:50.383441 master-0 kubenswrapper[33142]: I1204 01:03:50.383321 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-6676b8487-sp52q"] Dec 04 01:03:50.388122 master-0 kubenswrapper[33142]: I1204 01:03:50.387902 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.391881 master-0 kubenswrapper[33142]: I1204 01:03:50.391841 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-internal-svc" Dec 04 01:03:50.392129 master-0 kubenswrapper[33142]: I1204 01:03:50.392107 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-public-svc" Dec 04 01:03:50.397752 master-0 kubenswrapper[33142]: I1204 01:03:50.396839 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-6676b8487-sp52q"] Dec 04 01:03:50.423128 master-0 kubenswrapper[33142]: I1204 01:03:50.422247 33142 generic.go:334] "Generic (PLEG): container finished" podID="f796ef01-4e44-44ef-8509-7e13a0562449" containerID="7a4a6710873a5c83130f8ed2518ad6f719263f621dea402e6f986bca6be3b9f7" exitCode=0 Dec 04 01:03:50.423128 master-0 kubenswrapper[33142]: I1204 01:03:50.422348 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" event={"ID":"f796ef01-4e44-44ef-8509-7e13a0562449","Type":"ContainerDied","Data":"7a4a6710873a5c83130f8ed2518ad6f719263f621dea402e6f986bca6be3b9f7"} Dec 04 01:03:50.430276 master-0 kubenswrapper[33142]: I1204 01:03:50.430187 33142 generic.go:334] "Generic (PLEG): container finished" podID="9316ecfd-a283-41ed-a77e-225a9e118d4e" containerID="8cbb2f1dc31ebb1f1e0a69df6ac0be55d3e04892e565bcff8bd3af318ada64d8" exitCode=0 Dec 04 01:03:50.430385 master-0 kubenswrapper[33142]: I1204 01:03:50.430283 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-dqvwx" event={"ID":"9316ecfd-a283-41ed-a77e-225a9e118d4e","Type":"ContainerDied","Data":"8cbb2f1dc31ebb1f1e0a69df6ac0be55d3e04892e565bcff8bd3af318ada64d8"} Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.432714 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-custom\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.432858 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-logs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433005 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-internal-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433046 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-combined-ca-bundle\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433100 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-merged\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433128 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90226e52-15b9-4157-ab25-332ec172dfb6-etc-podinfo\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433188 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433343 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq69v\" (UniqueName: \"kubernetes.io/projected/90226e52-15b9-4157-ab25-332ec172dfb6-kube-api-access-gq69v\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433510 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-scripts\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.434108 master-0 kubenswrapper[33142]: I1204 01:03:50.433563 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-public-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.435773 master-0 kubenswrapper[33142]: I1204 01:03:50.435412 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"2761ce07-ecd2-4a5d-b6ba-e2a63971b932","Type":"ContainerStarted","Data":"4571cb1dd656fbbdaf6e98f6f28c4e185f3c3f3316699422adf5c3ee264a2a89"} Dec 04 01:03:50.445418 master-0 kubenswrapper[33142]: I1204 01:03:50.445350 33142 generic.go:334] "Generic (PLEG): container finished" podID="15a3bddd-ade5-4f66-995d-ce71f0a04b5f" containerID="104f0fda26869ae0955d8751b2df4164c625dbef7a3a6bbcbf286cde410ced76" exitCode=0 Dec 04 01:03:50.445687 master-0 kubenswrapper[33142]: I1204 01:03:50.445654 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-scheduler-0" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="cinder-scheduler" containerID="cri-o://00de5c54fd07cdc1ace4c54dbb61570d9bfa9ac46b5b1365c9554a309116ce8b" gracePeriod=30 Dec 04 01:03:50.446163 master-0 kubenswrapper[33142]: I1204 01:03:50.446132 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" event={"ID":"15a3bddd-ade5-4f66-995d-ce71f0a04b5f","Type":"ContainerDied","Data":"104f0fda26869ae0955d8751b2df4164c625dbef7a3a6bbcbf286cde410ced76"} Dec 04 01:03:50.446349 master-0 kubenswrapper[33142]: I1204 01:03:50.446295 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="cinder-volume" containerID="cri-o://1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765" gracePeriod=30 Dec 04 01:03:50.446689 master-0 kubenswrapper[33142]: I1204 01:03:50.446660 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-scheduler-0" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="probe" containerID="cri-o://da050ddaa4ed1e2db4495bc2b353eab7873cc1dbbedaed9122cd3c852f5cd95f" gracePeriod=30 Dec 04 01:03:50.446842 master-0 kubenswrapper[33142]: I1204 01:03:50.446760 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="probe" containerID="cri-o://8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181" gracePeriod=30 Dec 04 01:03:50.447470 master-0 kubenswrapper[33142]: I1204 01:03:50.447437 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-backup-0" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="cinder-backup" containerID="cri-o://55cfabe1e9f12151e6a25f49d3b7f521bc3945f4cd91a724e62e5bc524a54af0" gracePeriod=30 Dec 04 01:03:50.447581 master-0 kubenswrapper[33142]: I1204 01:03:50.447557 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-10f14-backup-0" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="probe" containerID="cri-o://e0eed37c497b958c717ce5eed9824e22c12d86670983266a6716a95a0198b977" gracePeriod=30 Dec 04 01:03:50.536781 master-0 kubenswrapper[33142]: I1204 01:03:50.536639 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-merged\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.536781 master-0 kubenswrapper[33142]: I1204 01:03:50.536710 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90226e52-15b9-4157-ab25-332ec172dfb6-etc-podinfo\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.536781 master-0 kubenswrapper[33142]: I1204 01:03:50.536771 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.537316 master-0 kubenswrapper[33142]: I1204 01:03:50.537057 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gq69v\" (UniqueName: \"kubernetes.io/projected/90226e52-15b9-4157-ab25-332ec172dfb6-kube-api-access-gq69v\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.537316 master-0 kubenswrapper[33142]: I1204 01:03:50.537226 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-merged\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.537473 master-0 kubenswrapper[33142]: I1204 01:03:50.537421 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-scripts\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.537557 master-0 kubenswrapper[33142]: I1204 01:03:50.537521 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-public-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.537808 master-0 kubenswrapper[33142]: I1204 01:03:50.537768 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-custom\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.538201 master-0 kubenswrapper[33142]: I1204 01:03:50.538161 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-logs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.538468 master-0 kubenswrapper[33142]: I1204 01:03:50.538432 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-internal-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.538528 master-0 kubenswrapper[33142]: I1204 01:03:50.538498 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-combined-ca-bundle\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.538619 master-0 kubenswrapper[33142]: I1204 01:03:50.538542 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90226e52-15b9-4157-ab25-332ec172dfb6-logs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.543152 master-0 kubenswrapper[33142]: I1204 01:03:50.543097 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-public-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.543394 master-0 kubenswrapper[33142]: I1204 01:03:50.543315 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.543728 master-0 kubenswrapper[33142]: I1204 01:03:50.543694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-internal-tls-certs\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.544024 master-0 kubenswrapper[33142]: I1204 01:03:50.543989 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-config-data-custom\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.544884 master-0 kubenswrapper[33142]: I1204 01:03:50.544853 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-scripts\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.551797 master-0 kubenswrapper[33142]: I1204 01:03:50.551735 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90226e52-15b9-4157-ab25-332ec172dfb6-etc-podinfo\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.555207 master-0 kubenswrapper[33142]: I1204 01:03:50.555154 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90226e52-15b9-4157-ab25-332ec172dfb6-combined-ca-bundle\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.570602 master-0 kubenswrapper[33142]: I1204 01:03:50.570330 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq69v\" (UniqueName: \"kubernetes.io/projected/90226e52-15b9-4157-ab25-332ec172dfb6-kube-api-access-gq69v\") pod \"ironic-6676b8487-sp52q\" (UID: \"90226e52-15b9-4157-ab25-332ec172dfb6\") " pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:50.634485 master-0 kubenswrapper[33142]: I1204 01:03:50.634346 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-74b902de-7b83-4083-b3e3-49126b9e3e59\" (UniqueName: \"kubernetes.io/csi/topolvm.io^4a402b50-7331-4060-9ffe-8e9beeafdee1\") pod \"ironic-conductor-0\" (UID: \"1cbaa187-8869-4d39-8ce7-c4fad127b6d5\") " pod="openstack/ironic-conductor-0" Dec 04 01:03:50.700407 master-0 kubenswrapper[33142]: I1204 01:03:50.700348 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-conductor-0" Dec 04 01:03:50.718954 master-0 kubenswrapper[33142]: I1204 01:03:50.718170 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:51.459118 master-0 kubenswrapper[33142]: I1204 01:03:51.459034 33142 generic.go:334] "Generic (PLEG): container finished" podID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerID="da050ddaa4ed1e2db4495bc2b353eab7873cc1dbbedaed9122cd3c852f5cd95f" exitCode=0 Dec 04 01:03:51.459118 master-0 kubenswrapper[33142]: I1204 01:03:51.459121 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerDied","Data":"da050ddaa4ed1e2db4495bc2b353eab7873cc1dbbedaed9122cd3c852f5cd95f"} Dec 04 01:03:51.463067 master-0 kubenswrapper[33142]: I1204 01:03:51.462968 33142 generic.go:334] "Generic (PLEG): container finished" podID="641fed3d-838b-4515-8ce7-ec745a137916" containerID="1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765" exitCode=0 Dec 04 01:03:51.463350 master-0 kubenswrapper[33142]: I1204 01:03:51.463078 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerDied","Data":"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765"} Dec 04 01:03:51.469953 master-0 kubenswrapper[33142]: I1204 01:03:51.469867 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"2761ce07-ecd2-4a5d-b6ba-e2a63971b932","Type":"ContainerStarted","Data":"4a1a6038e134c8b98330d67c2f1b33f551c25b6c808c7c9649a5b279d595f7ec"} Dec 04 01:03:51.472524 master-0 kubenswrapper[33142]: I1204 01:03:51.472485 33142 generic.go:334] "Generic (PLEG): container finished" podID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerID="e0eed37c497b958c717ce5eed9824e22c12d86670983266a6716a95a0198b977" exitCode=0 Dec 04 01:03:51.472607 master-0 kubenswrapper[33142]: I1204 01:03:51.472527 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerDied","Data":"e0eed37c497b958c717ce5eed9824e22c12d86670983266a6716a95a0198b977"} Dec 04 01:03:52.000000 master-0 kubenswrapper[33142]: I1204 01:03:51.999880 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:52.088565 master-0 kubenswrapper[33142]: I1204 01:03:52.086991 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f95gv\" (UniqueName: \"kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv\") pod \"9316ecfd-a283-41ed-a77e-225a9e118d4e\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " Dec 04 01:03:52.088565 master-0 kubenswrapper[33142]: I1204 01:03:52.087172 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts\") pod \"9316ecfd-a283-41ed-a77e-225a9e118d4e\" (UID: \"9316ecfd-a283-41ed-a77e-225a9e118d4e\") " Dec 04 01:03:52.088565 master-0 kubenswrapper[33142]: I1204 01:03:52.087756 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9316ecfd-a283-41ed-a77e-225a9e118d4e" (UID: "9316ecfd-a283-41ed-a77e-225a9e118d4e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:52.095056 master-0 kubenswrapper[33142]: I1204 01:03:52.094893 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv" (OuterVolumeSpecName: "kube-api-access-f95gv") pod "9316ecfd-a283-41ed-a77e-225a9e118d4e" (UID: "9316ecfd-a283-41ed-a77e-225a9e118d4e"). InnerVolumeSpecName "kube-api-access-f95gv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:52.213082 master-0 kubenswrapper[33142]: I1204 01:03:52.209107 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9316ecfd-a283-41ed-a77e-225a9e118d4e-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.213082 master-0 kubenswrapper[33142]: I1204 01:03:52.209156 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f95gv\" (UniqueName: \"kubernetes.io/projected/9316ecfd-a283-41ed-a77e-225a9e118d4e-kube-api-access-f95gv\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.380513 master-0 kubenswrapper[33142]: I1204 01:03:52.380417 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:52.396059 master-0 kubenswrapper[33142]: I1204 01:03:52.395977 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:52.413672 master-0 kubenswrapper[33142]: I1204 01:03:52.413576 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfq82\" (UniqueName: \"kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.413828 master-0 kubenswrapper[33142]: I1204 01:03:52.413764 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.414786 master-0 kubenswrapper[33142]: I1204 01:03:52.414695 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.414881 master-0 kubenswrapper[33142]: I1204 01:03:52.414794 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.414946 master-0 kubenswrapper[33142]: I1204 01:03:52.414892 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415007 master-0 kubenswrapper[33142]: I1204 01:03:52.414976 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts\") pod \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " Dec 04 01:03:52.415272 master-0 kubenswrapper[33142]: I1204 01:03:52.415236 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415355 master-0 kubenswrapper[33142]: I1204 01:03:52.415287 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys" (OuterVolumeSpecName: "sys") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "sys". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.415400 master-0 kubenswrapper[33142]: I1204 01:03:52.415316 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi" (OuterVolumeSpecName: "etc-iscsi") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "etc-iscsi". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.415400 master-0 kubenswrapper[33142]: I1204 01:03:52.415315 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8x78\" (UniqueName: \"kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78\") pod \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\" (UID: \"15a3bddd-ade5-4f66-995d-ce71f0a04b5f\") " Dec 04 01:03:52.415523 master-0 kubenswrapper[33142]: I1204 01:03:52.415498 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415577 master-0 kubenswrapper[33142]: I1204 01:03:52.415543 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415634 master-0 kubenswrapper[33142]: I1204 01:03:52.415616 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415745 master-0 kubenswrapper[33142]: I1204 01:03:52.415722 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415827 master-0 kubenswrapper[33142]: I1204 01:03:52.415806 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415908 master-0 kubenswrapper[33142]: I1204 01:03:52.415857 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415908 master-0 kubenswrapper[33142]: I1204 01:03:52.415876 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.415908 master-0 kubenswrapper[33142]: I1204 01:03:52.415897 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.416061 master-0 kubenswrapper[33142]: I1204 01:03:52.415920 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416061 master-0 kubenswrapper[33142]: I1204 01:03:52.416033 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder" (OuterVolumeSpecName: "var-lib-cinder") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "var-lib-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416152 master-0 kubenswrapper[33142]: I1204 01:03:52.416083 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts\") pod \"641fed3d-838b-4515-8ce7-ec745a137916\" (UID: \"641fed3d-838b-4515-8ce7-ec745a137916\") " Dec 04 01:03:52.416152 master-0 kubenswrapper[33142]: I1204 01:03:52.416091 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run" (OuterVolumeSpecName: "run") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416152 master-0 kubenswrapper[33142]: I1204 01:03:52.416127 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder" (OuterVolumeSpecName: "var-locks-cinder") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "var-locks-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416248 master-0 kubenswrapper[33142]: I1204 01:03:52.416219 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "15a3bddd-ade5-4f66-995d-ce71f0a04b5f" (UID: "15a3bddd-ade5-4f66-995d-ce71f0a04b5f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:52.416312 master-0 kubenswrapper[33142]: I1204 01:03:52.416284 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick" (OuterVolumeSpecName: "var-locks-brick") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "var-locks-brick". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416368 master-0 kubenswrapper[33142]: I1204 01:03:52.416327 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416368 master-0 kubenswrapper[33142]: I1204 01:03:52.416331 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev" (OuterVolumeSpecName: "dev") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "dev". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.416587 master-0 kubenswrapper[33142]: I1204 01:03:52.416517 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme" (OuterVolumeSpecName: "etc-nvme") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "etc-nvme". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.417595 master-0 kubenswrapper[33142]: I1204 01:03:52.417552 33142 reconciler_common.go:293] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417595 master-0 kubenswrapper[33142]: I1204 01:03:52.417582 33142 reconciler_common.go:293] "Volume detached for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417595 master-0 kubenswrapper[33142]: I1204 01:03:52.417592 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-lib-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417604 33142 reconciler_common.go:293] "Volume detached for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-dev\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417617 33142 reconciler_common.go:293] "Volume detached for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-var-locks-brick\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417627 33142 reconciler_common.go:293] "Volume detached for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-nvme\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417635 33142 reconciler_common.go:293] "Volume detached for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-iscsi\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417645 33142 reconciler_common.go:293] "Volume detached for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-sys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417654 33142 reconciler_common.go:293] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-lib-modules\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417664 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.417755 master-0 kubenswrapper[33142]: I1204 01:03:52.417673 33142 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/641fed3d-838b-4515-8ce7-ec745a137916-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.421598 master-0 kubenswrapper[33142]: I1204 01:03:52.421508 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82" (OuterVolumeSpecName: "kube-api-access-tfq82") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "kube-api-access-tfq82". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:52.422140 master-0 kubenswrapper[33142]: I1204 01:03:52.422077 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts" (OuterVolumeSpecName: "scripts") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.422228 master-0 kubenswrapper[33142]: I1204 01:03:52.422144 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.425411 master-0 kubenswrapper[33142]: I1204 01:03:52.425354 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78" (OuterVolumeSpecName: "kube-api-access-t8x78") pod "15a3bddd-ade5-4f66-995d-ce71f0a04b5f" (UID: "15a3bddd-ade5-4f66-995d-ce71f0a04b5f"). InnerVolumeSpecName "kube-api-access-t8x78". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:52.535497 master-0 kubenswrapper[33142]: I1204 01:03:52.534088 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.536508 master-0 kubenswrapper[33142]: I1204 01:03:52.536469 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.536576 master-0 kubenswrapper[33142]: I1204 01:03:52.536510 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tfq82\" (UniqueName: \"kubernetes.io/projected/641fed3d-838b-4515-8ce7-ec745a137916-kube-api-access-tfq82\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.536576 master-0 kubenswrapper[33142]: I1204 01:03:52.536524 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.536576 master-0 kubenswrapper[33142]: I1204 01:03:52.536535 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t8x78\" (UniqueName: \"kubernetes.io/projected/15a3bddd-ade5-4f66-995d-ce71f0a04b5f-kube-api-access-t8x78\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.536576 master-0 kubenswrapper[33142]: I1204 01:03:52.536546 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.556355 master-0 kubenswrapper[33142]: I1204 01:03:52.551681 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" Dec 04 01:03:52.556355 master-0 kubenswrapper[33142]: I1204 01:03:52.552395 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-05b7-account-create-update-9pb5q" event={"ID":"15a3bddd-ade5-4f66-995d-ce71f0a04b5f","Type":"ContainerDied","Data":"3973934a9f87ee9be16ea6dc6abb8795dc353c28247f097f98af04d4870958f1"} Dec 04 01:03:52.556355 master-0 kubenswrapper[33142]: I1204 01:03:52.552489 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3973934a9f87ee9be16ea6dc6abb8795dc353c28247f097f98af04d4870958f1" Dec 04 01:03:52.602751 master-0 kubenswrapper[33142]: I1204 01:03:52.602367 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerStarted","Data":"fc5e4fee196db33a121cca3556e48020e30058ab1e48b7075c5577958e26da30"} Dec 04 01:03:52.603358 master-0 kubenswrapper[33142]: I1204 01:03:52.603224 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:52.625507 master-0 kubenswrapper[33142]: I1204 01:03:52.625439 33142 generic.go:334] "Generic (PLEG): container finished" podID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerID="55cfabe1e9f12151e6a25f49d3b7f521bc3945f4cd91a724e62e5bc524a54af0" exitCode=0 Dec 04 01:03:52.625716 master-0 kubenswrapper[33142]: I1204 01:03:52.625549 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerDied","Data":"55cfabe1e9f12151e6a25f49d3b7f521bc3945f4cd91a724e62e5bc524a54af0"} Dec 04 01:03:52.656742 master-0 kubenswrapper[33142]: I1204 01:03:52.653570 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" event={"ID":"f796ef01-4e44-44ef-8509-7e13a0562449","Type":"ContainerStarted","Data":"0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05"} Dec 04 01:03:52.656742 master-0 kubenswrapper[33142]: I1204 01:03:52.655066 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:52.665145 master-0 kubenswrapper[33142]: I1204 01:03:52.662449 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-dqvwx" event={"ID":"9316ecfd-a283-41ed-a77e-225a9e118d4e","Type":"ContainerDied","Data":"236e28feb8205f13810d59d06f9825f20c4ea7258313afccbbbf062dff2713bc"} Dec 04 01:03:52.665145 master-0 kubenswrapper[33142]: I1204 01:03:52.662514 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-dqvwx" Dec 04 01:03:52.665145 master-0 kubenswrapper[33142]: I1204 01:03:52.662535 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="236e28feb8205f13810d59d06f9825f20c4ea7258313afccbbbf062dff2713bc" Dec 04 01:03:52.680717 master-0 kubenswrapper[33142]: I1204 01:03:52.680444 33142 generic.go:334] "Generic (PLEG): container finished" podID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerID="00de5c54fd07cdc1ace4c54dbb61570d9bfa9ac46b5b1365c9554a309116ce8b" exitCode=0 Dec 04 01:03:52.680717 master-0 kubenswrapper[33142]: I1204 01:03:52.680625 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerDied","Data":"00de5c54fd07cdc1ace4c54dbb61570d9bfa9ac46b5b1365c9554a309116ce8b"} Dec 04 01:03:52.692350 master-0 kubenswrapper[33142]: I1204 01:03:52.690425 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" podStartSLOduration=3.905160628 podStartE2EDuration="6.69038936s" podCreationTimestamp="2025-12-04 01:03:46 +0000 UTC" firstStartedPulling="2025-12-04 01:03:48.967176637 +0000 UTC m=+1001.369178487" lastFinishedPulling="2025-12-04 01:03:51.752405369 +0000 UTC m=+1004.154407219" observedRunningTime="2025-12-04 01:03:52.633488428 +0000 UTC m=+1005.035490298" watchObservedRunningTime="2025-12-04 01:03:52.69038936 +0000 UTC m=+1005.092391210" Dec 04 01:03:52.714498 master-0 kubenswrapper[33142]: I1204 01:03:52.714431 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-6676b8487-sp52q"] Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.718194 33142 generic.go:334] "Generic (PLEG): container finished" podID="641fed3d-838b-4515-8ce7-ec745a137916" containerID="8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181" exitCode=0 Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.718497 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerDied","Data":"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181"} Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.718540 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"641fed3d-838b-4515-8ce7-ec745a137916","Type":"ContainerDied","Data":"567447a8cdd83d1c411478b9f753626735091a795a07883974b275ab3f013828"} Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.718573 33142 scope.go:117] "RemoveContainer" containerID="8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181" Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.718783 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:52.720686 master-0 kubenswrapper[33142]: I1204 01:03:52.719002 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" podStartSLOduration=6.718976625 podStartE2EDuration="6.718976625s" podCreationTimestamp="2025-12-04 01:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:52.696960225 +0000 UTC m=+1005.098962085" watchObservedRunningTime="2025-12-04 01:03:52.718976625 +0000 UTC m=+1005.120978475" Dec 04 01:03:52.729426 master-0 kubenswrapper[33142]: I1204 01:03:52.729351 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data" (OuterVolumeSpecName: "config-data") pod "641fed3d-838b-4515-8ce7-ec745a137916" (UID: "641fed3d-838b-4515-8ce7-ec745a137916"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.746478 master-0 kubenswrapper[33142]: I1204 01:03:52.744992 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641fed3d-838b-4515-8ce7-ec745a137916-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.759280 master-0 kubenswrapper[33142]: I1204 01:03:52.759192 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerStarted","Data":"23ccc3a5346863e31cc07acde6bc1094ca807a02f0969003ea5222f706388a11"} Dec 04 01:03:52.794633 master-0 kubenswrapper[33142]: I1204 01:03:52.787613 33142 scope.go:117] "RemoveContainer" containerID="1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765" Dec 04 01:03:52.838330 master-0 kubenswrapper[33142]: I1204 01:03:52.836392 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: I1204 01:03:52.893320 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: I1204 01:03:52.894255 33142 scope.go:117] "RemoveContainer" containerID="8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: E1204 01:03:52.898668 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181\": container with ID starting with 8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181 not found: ID does not exist" containerID="8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: I1204 01:03:52.898703 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181"} err="failed to get container status \"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181\": rpc error: code = NotFound desc = could not find container \"8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181\": container with ID starting with 8eaa7baa2114cc84f354229eb8dfc72ce621cbf6d9a3ba8b99d8ec8abe5cb181 not found: ID does not exist" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: I1204 01:03:52.898727 33142 scope.go:117] "RemoveContainer" containerID="1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: E1204 01:03:52.899187 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765\": container with ID starting with 1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765 not found: ID does not exist" containerID="1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765" Dec 04 01:03:52.914212 master-0 kubenswrapper[33142]: I1204 01:03:52.899209 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765"} err="failed to get container status \"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765\": rpc error: code = NotFound desc = could not find container \"1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765\": container with ID starting with 1c3ad6106244a0a34381d5f12f1fc1ae0c9f349fb59403fd698ab3798bbe4765 not found: ID does not exist" Dec 04 01:03:52.947564 master-0 kubenswrapper[33142]: I1204 01:03:52.946774 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:52.949141 master-0 kubenswrapper[33142]: I1204 01:03:52.949094 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qdlw\" (UniqueName: \"kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.949388 master-0 kubenswrapper[33142]: I1204 01:03:52.949364 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.949454 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.949499 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.949548 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.949573 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts\") pod \"947e97c0-89ab-4617-80ad-99b7ccd273ae\" (UID: \"947e97c0-89ab-4617-80ad-99b7ccd273ae\") " Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.949581 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:52.950403 master-0 kubenswrapper[33142]: I1204 01:03:52.950412 33142 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/947e97c0-89ab-4617-80ad-99b7ccd273ae-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:52.957721 master-0 kubenswrapper[33142]: I1204 01:03:52.957031 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.968208 master-0 kubenswrapper[33142]: I1204 01:03:52.968097 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts" (OuterVolumeSpecName: "scripts") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:52.971021 master-0 kubenswrapper[33142]: I1204 01:03:52.970924 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw" (OuterVolumeSpecName: "kube-api-access-4qdlw") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "kube-api-access-4qdlw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052204 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052389 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052535 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052564 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052662 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052868 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjgl7\" (UniqueName: \"kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.052901 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.053076 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053237 master-0 kubenswrapper[33142]: I1204 01:03:53.053166 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053301 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053517 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev" (OuterVolumeSpecName: "dev") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "dev". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053546 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053656 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053710 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick" (OuterVolumeSpecName: "var-locks-brick") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "var-locks-brick". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053658 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053752 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053751 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053803 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053828 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme" (OuterVolumeSpecName: "etc-nvme") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "etc-nvme". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.053893 master-0 kubenswrapper[33142]: I1204 01:03:53.053863 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle\") pod \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\" (UID: \"72fa54c7-3b90-4ef2-acae-abe3dfce8eee\") " Dec 04 01:03:53.054581 master-0 kubenswrapper[33142]: I1204 01:03:53.053951 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi" (OuterVolumeSpecName: "etc-iscsi") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "etc-iscsi". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055210 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4qdlw\" (UniqueName: \"kubernetes.io/projected/947e97c0-89ab-4617-80ad-99b7ccd273ae-kube-api-access-4qdlw\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055232 33142 reconciler_common.go:293] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-lib-modules\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055304 33142 reconciler_common.go:293] "Volume detached for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-brick\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055316 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055333 33142 reconciler_common.go:293] "Volume detached for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-dev\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055341 33142 reconciler_common.go:293] "Volume detached for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-iscsi\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055349 33142 reconciler_common.go:293] "Volume detached for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-nvme\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055358 33142 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.055366 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.056081 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder" (OuterVolumeSpecName: "var-lib-cinder") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "var-lib-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.056138 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run" (OuterVolumeSpecName: "run") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.056169 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder" (OuterVolumeSpecName: "var-locks-cinder") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "var-locks-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.056201 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys" (OuterVolumeSpecName: "sys") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "sys". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.058292 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7" (OuterVolumeSpecName: "kube-api-access-pjgl7") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "kube-api-access-pjgl7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.059846 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.068561 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.068948 master-0 kubenswrapper[33142]: I1204 01:03:53.068700 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts" (OuterVolumeSpecName: "scripts") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157605 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157657 33142 reconciler_common.go:293] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157667 33142 reconciler_common.go:293] "Volume detached for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-locks-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157679 33142 reconciler_common.go:293] "Volume detached for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-sys\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157688 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.157681 master-0 kubenswrapper[33142]: I1204 01:03:53.157698 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pjgl7\" (UniqueName: \"kubernetes.io/projected/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-kube-api-access-pjgl7\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.158189 master-0 kubenswrapper[33142]: I1204 01:03:53.157707 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-var-lib-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.158189 master-0 kubenswrapper[33142]: I1204 01:03:53.157716 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.160847 master-0 kubenswrapper[33142]: I1204 01:03:53.160779 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.205372 master-0 kubenswrapper[33142]: I1204 01:03:53.205317 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data" (OuterVolumeSpecName: "config-data") pod "72fa54c7-3b90-4ef2-acae-abe3dfce8eee" (UID: "72fa54c7-3b90-4ef2-acae-abe3dfce8eee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.217801 master-0 kubenswrapper[33142]: I1204 01:03:53.217742 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data" (OuterVolumeSpecName: "config-data") pod "947e97c0-89ab-4617-80ad-99b7ccd273ae" (UID: "947e97c0-89ab-4617-80ad-99b7ccd273ae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:03:53.263283 master-0 kubenswrapper[33142]: I1204 01:03:53.263212 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.263283 master-0 kubenswrapper[33142]: I1204 01:03:53.263267 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72fa54c7-3b90-4ef2-acae-abe3dfce8eee-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.263283 master-0 kubenswrapper[33142]: I1204 01:03:53.263278 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/947e97c0-89ab-4617-80ad-99b7ccd273ae-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:53.362843 master-0 kubenswrapper[33142]: I1204 01:03:53.360264 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:53.411251 master-0 kubenswrapper[33142]: I1204 01:03:53.411007 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.416799 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.418911 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="cinder-backup" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.418964 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="cinder-backup" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419083 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="cinder-scheduler" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419100 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="cinder-scheduler" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419134 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="cinder-volume" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419146 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="cinder-volume" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419166 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15a3bddd-ade5-4f66-995d-ce71f0a04b5f" containerName="mariadb-account-create-update" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419177 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a3bddd-ade5-4f66-995d-ce71f0a04b5f" containerName="mariadb-account-create-update" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419228 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419241 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419269 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419278 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419304 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9316ecfd-a283-41ed-a77e-225a9e118d4e" containerName="mariadb-database-create" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419317 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9316ecfd-a283-41ed-a77e-225a9e118d4e" containerName="mariadb-database-create" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: E1204 01:03:53.419355 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.419364 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="probe" Dec 04 01:03:53.420203 master-0 kubenswrapper[33142]: I1204 01:03:53.420121 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="probe" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420244 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9316ecfd-a283-41ed-a77e-225a9e118d4e" containerName="mariadb-database-create" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420300 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" containerName="cinder-backup" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420348 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="cinder-volume" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420395 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="641fed3d-838b-4515-8ce7-ec745a137916" containerName="probe" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420439 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="15a3bddd-ade5-4f66-995d-ce71f0a04b5f" containerName="mariadb-account-create-update" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420464 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="probe" Dec 04 01:03:53.421019 master-0 kubenswrapper[33142]: I1204 01:03:53.420478 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" containerName="cinder-scheduler" Dec 04 01:03:53.427260 master-0 kubenswrapper[33142]: I1204 01:03:53.426817 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.433509 master-0 kubenswrapper[33142]: I1204 01:03:53.432194 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-volume-lvm-iscsi-config-data" Dec 04 01:03:53.452085 master-0 kubenswrapper[33142]: I1204 01:03:53.451905 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:53.479106 master-0 kubenswrapper[33142]: I1204 01:03:53.479011 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479348 master-0 kubenswrapper[33142]: I1204 01:03:53.479234 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479386 master-0 kubenswrapper[33142]: I1204 01:03:53.479339 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479488 master-0 kubenswrapper[33142]: I1204 01:03:53.479457 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479529 master-0 kubenswrapper[33142]: I1204 01:03:53.479494 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479529 master-0 kubenswrapper[33142]: I1204 01:03:53.479514 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479593 master-0 kubenswrapper[33142]: I1204 01:03:53.479568 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479656 master-0 kubenswrapper[33142]: I1204 01:03:53.479637 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479745 master-0 kubenswrapper[33142]: I1204 01:03:53.479716 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.479902 master-0 kubenswrapper[33142]: I1204 01:03:53.479847 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqdx\" (UniqueName: \"kubernetes.io/projected/de40a159-caed-46e7-9296-1b96535c10fc-kube-api-access-9nqdx\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.480039 master-0 kubenswrapper[33142]: I1204 01:03:53.480015 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.480100 master-0 kubenswrapper[33142]: I1204 01:03:53.480082 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.480187 master-0 kubenswrapper[33142]: I1204 01:03:53.480160 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.480224 master-0 kubenswrapper[33142]: I1204 01:03:53.480209 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.480261 master-0 kubenswrapper[33142]: I1204 01:03:53.480241 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.582261 master-0 kubenswrapper[33142]: I1204 01:03:53.582164 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582319 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582358 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582388 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582448 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582498 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582536 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqdx\" (UniqueName: \"kubernetes.io/projected/de40a159-caed-46e7-9296-1b96535c10fc-kube-api-access-9nqdx\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582573 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582600 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582643 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582670 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582699 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582776 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582812 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-lib-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582843 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-cinder\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582862 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582883 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-dev\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582911 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-var-locks-brick\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.582997 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-machine-id\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.583019 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-nvme\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.583034 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-sys\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583265 master-0 kubenswrapper[33142]: I1204 01:03:53.583052 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-etc-iscsi\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583887 master-0 kubenswrapper[33142]: I1204 01:03:53.583419 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-run\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.583887 master-0 kubenswrapper[33142]: I1204 01:03:53.583457 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de40a159-caed-46e7-9296-1b96535c10fc-lib-modules\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.591058 master-0 kubenswrapper[33142]: I1204 01:03:53.589056 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-scripts\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.591058 master-0 kubenswrapper[33142]: I1204 01:03:53.589646 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.594031 master-0 kubenswrapper[33142]: I1204 01:03:53.592887 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-config-data-custom\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.599706 master-0 kubenswrapper[33142]: I1204 01:03:53.599632 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de40a159-caed-46e7-9296-1b96535c10fc-combined-ca-bundle\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.622618 master-0 kubenswrapper[33142]: I1204 01:03:53.622551 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqdx\" (UniqueName: \"kubernetes.io/projected/de40a159-caed-46e7-9296-1b96535c10fc-kube-api-access-9nqdx\") pod \"cinder-10f14-volume-lvm-iscsi-0\" (UID: \"de40a159-caed-46e7-9296-1b96535c10fc\") " pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.767990 master-0 kubenswrapper[33142]: I1204 01:03:53.767875 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:53.777047 master-0 kubenswrapper[33142]: I1204 01:03:53.776970 33142 generic.go:334] "Generic (PLEG): container finished" podID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerID="23ccc3a5346863e31cc07acde6bc1094ca807a02f0969003ea5222f706388a11" exitCode=0 Dec 04 01:03:53.777278 master-0 kubenswrapper[33142]: I1204 01:03:53.777083 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerDied","Data":"23ccc3a5346863e31cc07acde6bc1094ca807a02f0969003ea5222f706388a11"} Dec 04 01:03:53.782193 master-0 kubenswrapper[33142]: I1204 01:03:53.781667 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-api-0" event={"ID":"2761ce07-ecd2-4a5d-b6ba-e2a63971b932","Type":"ContainerStarted","Data":"acee932cc5eff80fa76a69a63e17bd37b46d1f65b58199f653d5109329fad291"} Dec 04 01:03:53.782193 master-0 kubenswrapper[33142]: I1204 01:03:53.781907 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/cinder-10f14-api-0" Dec 04 01:03:53.788611 master-0 kubenswrapper[33142]: I1204 01:03:53.788549 33142 generic.go:334] "Generic (PLEG): container finished" podID="90226e52-15b9-4157-ab25-332ec172dfb6" containerID="bbd8210c78842f86953db15279da46e822370df5606379b0fdaee83a80d6c3a8" exitCode=0 Dec 04 01:03:53.788944 master-0 kubenswrapper[33142]: I1204 01:03:53.788636 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-6676b8487-sp52q" event={"ID":"90226e52-15b9-4157-ab25-332ec172dfb6","Type":"ContainerDied","Data":"bbd8210c78842f86953db15279da46e822370df5606379b0fdaee83a80d6c3a8"} Dec 04 01:03:53.788944 master-0 kubenswrapper[33142]: I1204 01:03:53.788669 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-6676b8487-sp52q" event={"ID":"90226e52-15b9-4157-ab25-332ec172dfb6","Type":"ContainerStarted","Data":"9013f52da59d663882fb683c456fb0de41c4a0eb6d34288a10f83638f72b6d4b"} Dec 04 01:03:53.796770 master-0 kubenswrapper[33142]: I1204 01:03:53.796730 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"91595b4ee237241f830269eefdcd70492c1fa51316409a3fa8a264ff9e075156"} Dec 04 01:03:53.796963 master-0 kubenswrapper[33142]: I1204 01:03:53.796905 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"14b19ada94e19093c2663ed0ba3857517b56826c12a2d18a109710b08e234e9f"} Dec 04 01:03:53.809829 master-0 kubenswrapper[33142]: I1204 01:03:53.809065 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:53.809829 master-0 kubenswrapper[33142]: I1204 01:03:53.809162 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"72fa54c7-3b90-4ef2-acae-abe3dfce8eee","Type":"ContainerDied","Data":"0b3311f7a1b486b8ce3870df31d31f1a538b40486924d053e58c343d951f324e"} Dec 04 01:03:53.809829 master-0 kubenswrapper[33142]: I1204 01:03:53.809231 33142 scope.go:117] "RemoveContainer" containerID="e0eed37c497b958c717ce5eed9824e22c12d86670983266a6716a95a0198b977" Dec 04 01:03:53.820547 master-0 kubenswrapper[33142]: I1204 01:03:53.820473 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"947e97c0-89ab-4617-80ad-99b7ccd273ae","Type":"ContainerDied","Data":"9684ceda41498f4a3b3cb780887f2c79d7ad5a69ea9b7120f1caa7f178fe1563"} Dec 04 01:03:53.820833 master-0 kubenswrapper[33142]: I1204 01:03:53.820623 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:53.902274 master-0 kubenswrapper[33142]: I1204 01:03:53.902194 33142 scope.go:117] "RemoveContainer" containerID="55cfabe1e9f12151e6a25f49d3b7f521bc3945f4cd91a724e62e5bc524a54af0" Dec 04 01:03:53.903008 master-0 kubenswrapper[33142]: I1204 01:03:53.902899 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-api-0" podStartSLOduration=5.902861809 podStartE2EDuration="5.902861809s" podCreationTimestamp="2025-12-04 01:03:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:53.835259916 +0000 UTC m=+1006.237261776" watchObservedRunningTime="2025-12-04 01:03:53.902861809 +0000 UTC m=+1006.304863669" Dec 04 01:03:53.935541 master-0 kubenswrapper[33142]: I1204 01:03:53.935460 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641fed3d-838b-4515-8ce7-ec745a137916" path="/var/lib/kubelet/pods/641fed3d-838b-4515-8ce7-ec745a137916/volumes" Dec 04 01:03:54.076827 master-0 kubenswrapper[33142]: I1204 01:03:54.076774 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:54.084044 master-0 kubenswrapper[33142]: I1204 01:03:54.083951 33142 scope.go:117] "RemoveContainer" containerID="da050ddaa4ed1e2db4495bc2b353eab7873cc1dbbedaed9122cd3c852f5cd95f" Dec 04 01:03:54.094465 master-0 kubenswrapper[33142]: I1204 01:03:54.094383 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:54.122098 master-0 kubenswrapper[33142]: I1204 01:03:54.119225 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:54.132455 master-0 kubenswrapper[33142]: I1204 01:03:54.132351 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.149958 master-0 kubenswrapper[33142]: I1204 01:03:54.141500 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-backup-config-data" Dec 04 01:03:54.154071 master-0 kubenswrapper[33142]: I1204 01:03:54.151623 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:54.212388 master-0 kubenswrapper[33142]: I1204 01:03:54.212262 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.212610 master-0 kubenswrapper[33142]: I1204 01:03:54.212591 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.212759 master-0 kubenswrapper[33142]: I1204 01:03:54.212734 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.212965 master-0 kubenswrapper[33142]: I1204 01:03:54.212862 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213076 master-0 kubenswrapper[33142]: I1204 01:03:54.213059 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213608 master-0 kubenswrapper[33142]: I1204 01:03:54.213396 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-sys\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213608 master-0 kubenswrapper[33142]: I1204 01:03:54.213490 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-run\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213701 master-0 kubenswrapper[33142]: I1204 01:03:54.213618 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-dev\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213701 master-0 kubenswrapper[33142]: I1204 01:03:54.213645 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213701 master-0 kubenswrapper[33142]: I1204 01:03:54.213696 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgd57\" (UniqueName: \"kubernetes.io/projected/39f1cd7b-70e2-4098-b278-78a20eccaac9-kube-api-access-wgd57\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213795 master-0 kubenswrapper[33142]: I1204 01:03:54.213774 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213882 master-0 kubenswrapper[33142]: I1204 01:03:54.213860 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.213995 master-0 kubenswrapper[33142]: I1204 01:03:54.213975 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.214041 master-0 kubenswrapper[33142]: I1204 01:03:54.213996 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.214087 master-0 kubenswrapper[33142]: I1204 01:03:54.214070 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.234437 master-0 kubenswrapper[33142]: I1204 01:03:54.227075 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:54.245801 master-0 kubenswrapper[33142]: I1204 01:03:54.245743 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:54.286405 master-0 kubenswrapper[33142]: I1204 01:03:54.286352 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:54.288370 master-0 kubenswrapper[33142]: I1204 01:03:54.288341 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.311012 master-0 kubenswrapper[33142]: I1204 01:03:54.294460 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-10f14-scheduler-config-data" Dec 04 01:03:54.311012 master-0 kubenswrapper[33142]: I1204 01:03:54.305247 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:54.318222 master-0 kubenswrapper[33142]: I1204 01:03:54.318116 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.318377 master-0 kubenswrapper[33142]: I1204 01:03:54.318255 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-sys\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318377 master-0 kubenswrapper[33142]: I1204 01:03:54.318302 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-run\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318377 master-0 kubenswrapper[33142]: I1204 01:03:54.318328 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hx7\" (UniqueName: \"kubernetes.io/projected/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-kube-api-access-c5hx7\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.318543 master-0 kubenswrapper[33142]: I1204 01:03:54.318374 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.318543 master-0 kubenswrapper[33142]: I1204 01:03:54.318465 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.318543 master-0 kubenswrapper[33142]: I1204 01:03:54.318515 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-dev\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318671 master-0 kubenswrapper[33142]: I1204 01:03:54.318567 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318671 master-0 kubenswrapper[33142]: I1204 01:03:54.318618 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wgd57\" (UniqueName: \"kubernetes.io/projected/39f1cd7b-70e2-4098-b278-78a20eccaac9-kube-api-access-wgd57\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318752 master-0 kubenswrapper[33142]: I1204 01:03:54.318697 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.318752 master-0 kubenswrapper[33142]: I1204 01:03:54.318739 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.318878 master-0 kubenswrapper[33142]: I1204 01:03:54.318832 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.318971 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319004 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319299 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319331 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319406 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319435 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319504 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319545 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.319624 master-0 kubenswrapper[33142]: I1204 01:03:54.319579 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320213 master-0 kubenswrapper[33142]: I1204 01:03:54.320149 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-sys\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320213 master-0 kubenswrapper[33142]: I1204 01:03:54.320190 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-run\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320312 master-0 kubenswrapper[33142]: I1204 01:03:54.320226 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-dev\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320312 master-0 kubenswrapper[33142]: I1204 01:03:54.320276 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-brick\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320312 master-0 kubenswrapper[33142]: I1204 01:03:54.320262 33142 scope.go:117] "RemoveContainer" containerID="00de5c54fd07cdc1ace4c54dbb61570d9bfa9ac46b5b1365c9554a309116ce8b" Dec 04 01:03:54.320417 master-0 kubenswrapper[33142]: I1204 01:03:54.320364 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-machine-id\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320476 master-0 kubenswrapper[33142]: I1204 01:03:54.320462 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-locks-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320909 master-0 kubenswrapper[33142]: I1204 01:03:54.320773 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-nvme\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.320909 master-0 kubenswrapper[33142]: I1204 01:03:54.320802 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-lib-modules\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.321233 master-0 kubenswrapper[33142]: I1204 01:03:54.321081 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-etc-iscsi\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.321407 master-0 kubenswrapper[33142]: I1204 01:03:54.321374 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/39f1cd7b-70e2-4098-b278-78a20eccaac9-var-lib-cinder\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.324455 master-0 kubenswrapper[33142]: I1204 01:03:54.324422 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.326382 master-0 kubenswrapper[33142]: I1204 01:03:54.326307 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-scripts\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.335020 master-0 kubenswrapper[33142]: I1204 01:03:54.334896 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-config-data-custom\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.341886 master-0 kubenswrapper[33142]: I1204 01:03:54.341839 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39f1cd7b-70e2-4098-b278-78a20eccaac9-combined-ca-bundle\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.346286 master-0 kubenswrapper[33142]: I1204 01:03:54.345766 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgd57\" (UniqueName: \"kubernetes.io/projected/39f1cd7b-70e2-4098-b278-78a20eccaac9-kube-api-access-wgd57\") pod \"cinder-10f14-backup-0\" (UID: \"39f1cd7b-70e2-4098-b278-78a20eccaac9\") " pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.415290 master-0 kubenswrapper[33142]: I1204 01:03:54.414451 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-volume-lvm-iscsi-0"] Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.423664 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.423763 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hx7\" (UniqueName: \"kubernetes.io/projected/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-kube-api-access-c5hx7\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.423803 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.423858 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.423965 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.424391 master-0 kubenswrapper[33142]: I1204 01:03:54.424126 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.430321 master-0 kubenswrapper[33142]: I1204 01:03:54.428855 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-etc-machine-id\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.437283 master-0 kubenswrapper[33142]: I1204 01:03:54.436890 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-combined-ca-bundle\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.437283 master-0 kubenswrapper[33142]: I1204 01:03:54.437187 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.441111 master-0 kubenswrapper[33142]: I1204 01:03:54.440791 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-config-data-custom\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.444361 master-0 kubenswrapper[33142]: I1204 01:03:54.443385 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-scripts\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.452468 master-0 kubenswrapper[33142]: I1204 01:03:54.452396 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hx7\" (UniqueName: \"kubernetes.io/projected/4973fc42-5a38-4c5f-b24b-f0eb11d729a4-kube-api-access-c5hx7\") pod \"cinder-10f14-scheduler-0\" (UID: \"4973fc42-5a38-4c5f-b24b-f0eb11d729a4\") " pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.570576 master-0 kubenswrapper[33142]: I1204 01:03:54.570436 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:54.627163 master-0 kubenswrapper[33142]: I1204 01:03:54.626918 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:54.952070 master-0 kubenswrapper[33142]: I1204 01:03:54.951905 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-6676b8487-sp52q" event={"ID":"90226e52-15b9-4157-ab25-332ec172dfb6","Type":"ContainerStarted","Data":"bdbbff2cbc0e3b678f6d90cac00de64535de146bb90afe6ea1fb8d4675a1f879"} Dec 04 01:03:54.952070 master-0 kubenswrapper[33142]: I1204 01:03:54.952021 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-6676b8487-sp52q" event={"ID":"90226e52-15b9-4157-ab25-332ec172dfb6","Type":"ContainerStarted","Data":"067b2147d0c9e2148e7facb985c54dd495f9c0f3a887a098fde94f30b7e45ed8"} Dec 04 01:03:54.952543 master-0 kubenswrapper[33142]: I1204 01:03:54.952493 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:03:54.982968 master-0 kubenswrapper[33142]: I1204 01:03:54.982059 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"de40a159-caed-46e7-9296-1b96535c10fc","Type":"ContainerStarted","Data":"a0f17e3333fd16dc5aabbdea0eddc2e2e4baf01c60840ce91e2593cd1dac617d"} Dec 04 01:03:54.982968 master-0 kubenswrapper[33142]: I1204 01:03:54.982142 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"de40a159-caed-46e7-9296-1b96535c10fc","Type":"ContainerStarted","Data":"3511b95080f828a63d00462981cba082632970d4b53388465520080fbf8bd6f1"} Dec 04 01:03:54.988716 master-0 kubenswrapper[33142]: I1204 01:03:54.988590 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerStarted","Data":"2583df8afd6f6da0bc65957cd56d5ce088d439af0cb0744a87827320374f06ad"} Dec 04 01:03:55.001145 master-0 kubenswrapper[33142]: I1204 01:03:55.000976 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-6676b8487-sp52q" podStartSLOduration=5.000913547 podStartE2EDuration="5.000913547s" podCreationTimestamp="2025-12-04 01:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:54.978463565 +0000 UTC m=+1007.380465435" watchObservedRunningTime="2025-12-04 01:03:55.000913547 +0000 UTC m=+1007.402915397" Dec 04 01:03:55.049955 master-0 kubenswrapper[33142]: I1204 01:03:55.049787 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:55.052205 master-0 kubenswrapper[33142]: I1204 01:03:55.052062 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-5856c94c7d-wbwzp" Dec 04 01:03:55.644473 master-0 kubenswrapper[33142]: I1204 01:03:55.644393 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-scheduler-0"] Dec 04 01:03:55.883964 master-0 kubenswrapper[33142]: I1204 01:03:55.872430 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/keystone-74cd467f4b-dmpnn" Dec 04 01:03:56.013366 master-0 kubenswrapper[33142]: I1204 01:03:56.009661 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72fa54c7-3b90-4ef2-acae-abe3dfce8eee" path="/var/lib/kubelet/pods/72fa54c7-3b90-4ef2-acae-abe3dfce8eee/volumes" Dec 04 01:03:56.022983 master-0 kubenswrapper[33142]: I1204 01:03:56.018491 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947e97c0-89ab-4617-80ad-99b7ccd273ae" path="/var/lib/kubelet/pods/947e97c0-89ab-4617-80ad-99b7ccd273ae/volumes" Dec 04 01:03:56.049951 master-0 kubenswrapper[33142]: I1204 01:03:56.046404 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"4973fc42-5a38-4c5f-b24b-f0eb11d729a4","Type":"ContainerStarted","Data":"f0eca6ac13a9068d5fe57960a7c063e7c1d6b34be9e888ee280adbc99eb550d2"} Dec 04 01:03:56.084095 master-0 kubenswrapper[33142]: I1204 01:03:56.080227 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-10f14-backup-0"] Dec 04 01:03:56.138301 master-0 kubenswrapper[33142]: I1204 01:03:56.134699 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" event={"ID":"de40a159-caed-46e7-9296-1b96535c10fc","Type":"ContainerStarted","Data":"8d60c0ddf7c7b04c3d5af8bd6ae992cae9f69180434e02611ff2b3f9338851b4"} Dec 04 01:03:56.158966 master-0 kubenswrapper[33142]: I1204 01:03:56.158858 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstackclient"] Dec 04 01:03:56.162091 master-0 kubenswrapper[33142]: I1204 01:03:56.162033 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstackclient"] Dec 04 01:03:56.166476 master-0 kubenswrapper[33142]: I1204 01:03:56.166407 33142 generic.go:334] "Generic (PLEG): container finished" podID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerID="a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20" exitCode=1 Dec 04 01:03:56.166888 master-0 kubenswrapper[33142]: I1204 01:03:56.165174 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstackclient" Dec 04 01:03:56.167079 master-0 kubenswrapper[33142]: I1204 01:03:56.167040 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerDied","Data":"a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20"} Dec 04 01:03:56.168720 master-0 kubenswrapper[33142]: I1204 01:03:56.168658 33142 scope.go:117] "RemoveContainer" containerID="a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20" Dec 04 01:03:56.170249 master-0 kubenswrapper[33142]: I1204 01:03:56.170182 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-config" Dec 04 01:03:56.170988 master-0 kubenswrapper[33142]: I1204 01:03:56.170909 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"openstack-config-secret" Dec 04 01:03:56.185080 master-0 kubenswrapper[33142]: I1204 01:03:56.184997 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" podStartSLOduration=3.184975845 podStartE2EDuration="3.184975845s" podCreationTimestamp="2025-12-04 01:03:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:56.183584436 +0000 UTC m=+1008.585586316" watchObservedRunningTime="2025-12-04 01:03:56.184975845 +0000 UTC m=+1008.586977695" Dec 04 01:03:56.256443 master-0 kubenswrapper[33142]: E1204 01:03:56.256316 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb9569c_09bd_4eb5_8bc2_65a639af171d.slice/crio-conmon-a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb9569c_09bd_4eb5_8bc2_65a639af171d.slice/crio-a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:03:56.270477 master-0 kubenswrapper[33142]: I1204 01:03:56.270357 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config-secret\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.270833 master-0 kubenswrapper[33142]: I1204 01:03:56.270796 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblvn\" (UniqueName: \"kubernetes.io/projected/007ad09c-92be-4f52-96a2-e345a59c17b0-kube-api-access-hblvn\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.270904 master-0 kubenswrapper[33142]: I1204 01:03:56.270850 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.270970 master-0 kubenswrapper[33142]: I1204 01:03:56.270952 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.373515 master-0 kubenswrapper[33142]: I1204 01:03:56.373451 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.373737 master-0 kubenswrapper[33142]: I1204 01:03:56.373593 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.373737 master-0 kubenswrapper[33142]: I1204 01:03:56.373670 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config-secret\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.373990 master-0 kubenswrapper[33142]: I1204 01:03:56.373963 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hblvn\" (UniqueName: \"kubernetes.io/projected/007ad09c-92be-4f52-96a2-e345a59c17b0-kube-api-access-hblvn\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.376152 master-0 kubenswrapper[33142]: I1204 01:03:56.376105 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.380084 master-0 kubenswrapper[33142]: I1204 01:03:56.379550 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.380640 master-0 kubenswrapper[33142]: I1204 01:03:56.380571 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/007ad09c-92be-4f52-96a2-e345a59c17b0-openstack-config-secret\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.391695 master-0 kubenswrapper[33142]: I1204 01:03:56.391647 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblvn\" (UniqueName: \"kubernetes.io/projected/007ad09c-92be-4f52-96a2-e345a59c17b0-kube-api-access-hblvn\") pod \"openstackclient\" (UID: \"007ad09c-92be-4f52-96a2-e345a59c17b0\") " pod="openstack/openstackclient" Dec 04 01:03:56.532960 master-0 kubenswrapper[33142]: I1204 01:03:56.532852 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstackclient" Dec 04 01:03:57.078036 master-0 kubenswrapper[33142]: I1204 01:03:57.075817 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstackclient"] Dec 04 01:03:57.094073 master-0 kubenswrapper[33142]: W1204 01:03:57.092768 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod007ad09c_92be_4f52_96a2_e345a59c17b0.slice/crio-4723f90b8673b3fa75dbf1de6552613590774115e99a0fa609dfe839ce837a13 WatchSource:0}: Error finding container 4723f90b8673b3fa75dbf1de6552613590774115e99a0fa609dfe839ce837a13: Status 404 returned error can't find the container with id 4723f90b8673b3fa75dbf1de6552613590774115e99a0fa609dfe839ce837a13 Dec 04 01:03:57.187215 master-0 kubenswrapper[33142]: I1204 01:03:57.187040 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"4973fc42-5a38-4c5f-b24b-f0eb11d729a4","Type":"ContainerStarted","Data":"4a5c10c0504fd202c6b7902cf347ea9023ea4f3ab01d09545a1243d9dad5432e"} Dec 04 01:03:57.193558 master-0 kubenswrapper[33142]: I1204 01:03:57.191514 33142 generic.go:334] "Generic (PLEG): container finished" podID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerID="4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7" exitCode=1 Dec 04 01:03:57.193558 master-0 kubenswrapper[33142]: I1204 01:03:57.191566 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerDied","Data":"4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7"} Dec 04 01:03:57.193558 master-0 kubenswrapper[33142]: I1204 01:03:57.191600 33142 scope.go:117] "RemoveContainer" containerID="a6af1399b312c6df2df47536773fe63cc4ffdccb5b9c929a79fcacc220857b20" Dec 04 01:03:57.193558 master-0 kubenswrapper[33142]: I1204 01:03:57.192523 33142 scope.go:117] "RemoveContainer" containerID="4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7" Dec 04 01:03:57.193558 master-0 kubenswrapper[33142]: E1204 01:03:57.192810 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-594b84b4f-dpqbk_openstack(9fb9569c-09bd-4eb5-8bc2-65a639af171d)\"" pod="openstack/ironic-594b84b4f-dpqbk" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" Dec 04 01:03:57.197599 master-0 kubenswrapper[33142]: I1204 01:03:57.197571 33142 generic.go:334] "Generic (PLEG): container finished" podID="1cbaa187-8869-4d39-8ce7-c4fad127b6d5" containerID="91595b4ee237241f830269eefdcd70492c1fa51316409a3fa8a264ff9e075156" exitCode=0 Dec 04 01:03:57.197702 master-0 kubenswrapper[33142]: I1204 01:03:57.197641 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerDied","Data":"91595b4ee237241f830269eefdcd70492c1fa51316409a3fa8a264ff9e075156"} Dec 04 01:03:57.210549 master-0 kubenswrapper[33142]: I1204 01:03:57.210465 33142 generic.go:334] "Generic (PLEG): container finished" podID="adc15fbc-accb-467e-9fd9-25ffb68a297e" containerID="fc5e4fee196db33a121cca3556e48020e30058ab1e48b7075c5577958e26da30" exitCode=1 Dec 04 01:03:57.210759 master-0 kubenswrapper[33142]: I1204 01:03:57.210723 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerDied","Data":"fc5e4fee196db33a121cca3556e48020e30058ab1e48b7075c5577958e26da30"} Dec 04 01:03:57.213200 master-0 kubenswrapper[33142]: I1204 01:03:57.212855 33142 scope.go:117] "RemoveContainer" containerID="fc5e4fee196db33a121cca3556e48020e30058ab1e48b7075c5577958e26da30" Dec 04 01:03:57.274949 master-0 kubenswrapper[33142]: I1204 01:03:57.261346 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstackclient" event={"ID":"007ad09c-92be-4f52-96a2-e345a59c17b0","Type":"ContainerStarted","Data":"4723f90b8673b3fa75dbf1de6552613590774115e99a0fa609dfe839ce837a13"} Dec 04 01:03:57.289992 master-0 kubenswrapper[33142]: I1204 01:03:57.289316 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"39f1cd7b-70e2-4098-b278-78a20eccaac9","Type":"ContainerStarted","Data":"37ec3478a3ce7555a3a0ba0f35b039134c0b220c45bbb2936f6961999ce8e782"} Dec 04 01:03:57.289992 master-0 kubenswrapper[33142]: I1204 01:03:57.289382 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"39f1cd7b-70e2-4098-b278-78a20eccaac9","Type":"ContainerStarted","Data":"a6bb94480c671868300ab46054f84e32ae3d09da0e9ed77e68c022b5533fd610"} Dec 04 01:03:57.289992 master-0 kubenswrapper[33142]: I1204 01:03:57.289392 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-backup-0" event={"ID":"39f1cd7b-70e2-4098-b278-78a20eccaac9","Type":"ContainerStarted","Data":"d59bbe2fd9fb88acca8381f05cfc79f5e48a20994c19b255212cd92ecea0f091"} Dec 04 01:03:57.452455 master-0 kubenswrapper[33142]: I1204 01:03:57.452391 33142 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:57.454749 master-0 kubenswrapper[33142]: I1204 01:03:57.454655 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-backup-0" podStartSLOduration=4.454626085 podStartE2EDuration="4.454626085s" podCreationTimestamp="2025-12-04 01:03:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:57.435140526 +0000 UTC m=+1009.837142396" watchObservedRunningTime="2025-12-04 01:03:57.454626085 +0000 UTC m=+1009.856627935" Dec 04 01:03:57.489913 master-0 kubenswrapper[33142]: I1204 01:03:57.489850 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:03:57.609717 master-0 kubenswrapper[33142]: I1204 01:03:57.607137 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:57.609717 master-0 kubenswrapper[33142]: I1204 01:03:57.607432 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="dnsmasq-dns" containerID="cri-o://8a4a32a68918c7c2c02dc4f9e4b1a913c917e1d22cd9c29e85df0da93e47f23b" gracePeriod=10 Dec 04 01:03:57.842919 master-0 kubenswrapper[33142]: I1204 01:03:57.842334 33142 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:57.842919 master-0 kubenswrapper[33142]: I1204 01:03:57.842415 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:03:58.368016 master-0 kubenswrapper[33142]: I1204 01:03:58.367851 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-10f14-scheduler-0" event={"ID":"4973fc42-5a38-4c5f-b24b-f0eb11d729a4","Type":"ContainerStarted","Data":"497717a3ae065717ced11f3719aeb81b50cfa898ba92a06d9a4d895d784a2dfd"} Dec 04 01:03:58.414410 master-0 kubenswrapper[33142]: I1204 01:03:58.411211 33142 scope.go:117] "RemoveContainer" containerID="4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7" Dec 04 01:03:58.414410 master-0 kubenswrapper[33142]: E1204 01:03:58.411534 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-594b84b4f-dpqbk_openstack(9fb9569c-09bd-4eb5-8bc2-65a639af171d)\"" pod="openstack/ironic-594b84b4f-dpqbk" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" Dec 04 01:03:58.449879 master-0 kubenswrapper[33142]: I1204 01:03:58.449734 33142 generic.go:334] "Generic (PLEG): container finished" podID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerID="8a4a32a68918c7c2c02dc4f9e4b1a913c917e1d22cd9c29e85df0da93e47f23b" exitCode=0 Dec 04 01:03:58.449879 master-0 kubenswrapper[33142]: I1204 01:03:58.449846 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" event={"ID":"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2","Type":"ContainerDied","Data":"8a4a32a68918c7c2c02dc4f9e4b1a913c917e1d22cd9c29e85df0da93e47f23b"} Dec 04 01:03:58.450158 master-0 kubenswrapper[33142]: I1204 01:03:58.449897 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" event={"ID":"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2","Type":"ContainerDied","Data":"a2b8d3b94367aee76b487f3f0a85762b8dd27c6c14dd4ed0ae8c9e22ccb85220"} Dec 04 01:03:58.450158 master-0 kubenswrapper[33142]: I1204 01:03:58.449913 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2b8d3b94367aee76b487f3f0a85762b8dd27c6c14dd4ed0ae8c9e22ccb85220" Dec 04 01:03:58.466586 master-0 kubenswrapper[33142]: I1204 01:03:58.466525 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:58.476894 master-0 kubenswrapper[33142]: I1204 01:03:58.476690 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-10f14-scheduler-0" podStartSLOduration=4.476662252 podStartE2EDuration="4.476662252s" podCreationTimestamp="2025-12-04 01:03:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:03:58.443617302 +0000 UTC m=+1010.845619172" watchObservedRunningTime="2025-12-04 01:03:58.476662252 +0000 UTC m=+1010.878664102" Dec 04 01:03:58.483335 master-0 kubenswrapper[33142]: I1204 01:03:58.483022 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerStarted","Data":"37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af"} Dec 04 01:03:58.483335 master-0 kubenswrapper[33142]: I1204 01:03:58.483082 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.586513 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.586639 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.586682 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.586780 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.588520 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.594973 master-0 kubenswrapper[33142]: I1204 01:03:58.588618 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt8j5\" (UniqueName: \"kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5\") pod \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\" (UID: \"3bf9d3d5-ccc0-4213-92cb-75ae785f7de2\") " Dec 04 01:03:58.679036 master-0 kubenswrapper[33142]: I1204 01:03:58.675322 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5" (OuterVolumeSpecName: "kube-api-access-mt8j5") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "kube-api-access-mt8j5". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:03:58.691837 master-0 kubenswrapper[33142]: I1204 01:03:58.691685 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mt8j5\" (UniqueName: \"kubernetes.io/projected/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-kube-api-access-mt8j5\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:58.719211 master-0 kubenswrapper[33142]: I1204 01:03:58.719062 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:58.732652 master-0 kubenswrapper[33142]: I1204 01:03:58.732582 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:58.769666 master-0 kubenswrapper[33142]: I1204 01:03:58.768614 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config" (OuterVolumeSpecName: "config") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:58.769666 master-0 kubenswrapper[33142]: I1204 01:03:58.768761 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:03:58.792671 master-0 kubenswrapper[33142]: I1204 01:03:58.792591 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:58.805839 master-0 kubenswrapper[33142]: I1204 01:03:58.805610 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" (UID: "3bf9d3d5-ccc0-4213-92cb-75ae785f7de2"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:03:58.806182 master-0 kubenswrapper[33142]: I1204 01:03:58.806142 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:58.806182 master-0 kubenswrapper[33142]: I1204 01:03:58.806169 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:58.806182 master-0 kubenswrapper[33142]: I1204 01:03:58.806182 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:58.806335 master-0 kubenswrapper[33142]: I1204 01:03:58.806192 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:58.806335 master-0 kubenswrapper[33142]: I1204 01:03:58.806205 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:03:59.512570 master-0 kubenswrapper[33142]: I1204 01:03:59.512505 33142 scope.go:117] "RemoveContainer" containerID="4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7" Dec 04 01:03:59.513372 master-0 kubenswrapper[33142]: E1204 01:03:59.512789 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-594b84b4f-dpqbk_openstack(9fb9569c-09bd-4eb5-8bc2-65a639af171d)\"" pod="openstack/ironic-594b84b4f-dpqbk" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" Dec 04 01:03:59.513640 master-0 kubenswrapper[33142]: I1204 01:03:59.513593 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7f7dc596c7-vmmgv" Dec 04 01:03:59.571051 master-0 kubenswrapper[33142]: I1204 01:03:59.570986 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:03:59.595093 master-0 kubenswrapper[33142]: I1204 01:03:59.594496 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:59.607353 master-0 kubenswrapper[33142]: I1204 01:03:59.607275 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-7f7dc596c7-vmmgv"] Dec 04 01:03:59.628958 master-0 kubenswrapper[33142]: I1204 01:03:59.627810 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-10f14-backup-0" Dec 04 01:03:59.921552 master-0 kubenswrapper[33142]: I1204 01:03:59.921456 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" path="/var/lib/kubelet/pods/3bf9d3d5-ccc0-4213-92cb-75ae785f7de2/volumes" Dec 04 01:04:01.164032 master-0 kubenswrapper[33142]: I1204 01:04:01.162439 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/cinder-10f14-api-0" Dec 04 01:04:02.363353 master-0 kubenswrapper[33142]: I1204 01:04:02.363292 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-6676b8487-sp52q" Dec 04 01:04:02.453553 master-0 kubenswrapper[33142]: I1204 01:04:02.449052 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:04:02.453553 master-0 kubenswrapper[33142]: E1204 01:04:02.451744 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.453553 master-0 kubenswrapper[33142]: E1204 01:04:02.451784 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.456470 master-0 kubenswrapper[33142]: E1204 01:04:02.456405 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.456529 master-0 kubenswrapper[33142]: E1204 01:04:02.456406 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.456966 master-0 kubenswrapper[33142]: E1204 01:04:02.456857 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.457016 master-0 kubenswrapper[33142]: E1204 01:04:02.456897 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" cmd=["/bin/true"] Dec 04 01:04:02.457016 master-0 kubenswrapper[33142]: E1204 01:04:02.456979 33142 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" probeType="Readiness" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" podUID="adc15fbc-accb-467e-9fd9-25ffb68a297e" containerName="ironic-neutron-agent" Dec 04 01:04:02.457085 master-0 kubenswrapper[33142]: E1204 01:04:02.457025 33142 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af is running failed: container process not found" probeType="Liveness" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" podUID="adc15fbc-accb-467e-9fd9-25ffb68a297e" containerName="ironic-neutron-agent" Dec 04 01:04:02.602116 master-0 kubenswrapper[33142]: I1204 01:04:02.601645 33142 generic.go:334] "Generic (PLEG): container finished" podID="adc15fbc-accb-467e-9fd9-25ffb68a297e" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" exitCode=1 Dec 04 01:04:02.602116 master-0 kubenswrapper[33142]: I1204 01:04:02.601715 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerDied","Data":"37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af"} Dec 04 01:04:02.602116 master-0 kubenswrapper[33142]: I1204 01:04:02.601763 33142 scope.go:117] "RemoveContainer" containerID="fc5e4fee196db33a121cca3556e48020e30058ab1e48b7075c5577958e26da30" Dec 04 01:04:02.609961 master-0 kubenswrapper[33142]: I1204 01:04:02.602726 33142 scope.go:117] "RemoveContainer" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" Dec 04 01:04:02.609961 master-0 kubenswrapper[33142]: E1204 01:04:02.603028 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-neutron-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-neutron-agent pod=ironic-neutron-agent-6cddc778dc-52tq5_openstack(adc15fbc-accb-467e-9fd9-25ffb68a297e)\"" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" podUID="adc15fbc-accb-467e-9fd9-25ffb68a297e" Dec 04 01:04:02.693603 master-0 kubenswrapper[33142]: I1204 01:04:02.693533 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-proxy-7848784c98-xtw5f"] Dec 04 01:04:02.694441 master-0 kubenswrapper[33142]: E1204 01:04:02.694401 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="dnsmasq-dns" Dec 04 01:04:02.694441 master-0 kubenswrapper[33142]: I1204 01:04:02.694428 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="dnsmasq-dns" Dec 04 01:04:02.694559 master-0 kubenswrapper[33142]: E1204 01:04:02.694469 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="init" Dec 04 01:04:02.694559 master-0 kubenswrapper[33142]: I1204 01:04:02.694479 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="init" Dec 04 01:04:02.694772 master-0 kubenswrapper[33142]: I1204 01:04:02.694745 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="3bf9d3d5-ccc0-4213-92cb-75ae785f7de2" containerName="dnsmasq-dns" Dec 04 01:04:02.715713 master-0 kubenswrapper[33142]: I1204 01:04:02.714776 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.719842 master-0 kubenswrapper[33142]: I1204 01:04:02.719808 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-swift-internal-svc" Dec 04 01:04:02.720005 master-0 kubenswrapper[33142]: I1204 01:04:02.719853 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-swift-public-svc" Dec 04 01:04:02.720005 master-0 kubenswrapper[33142]: I1204 01:04:02.719988 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-proxy-config-data" Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.735976 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-proxy-7848784c98-xtw5f"] Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.739067 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-combined-ca-bundle\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.739196 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-log-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.739226 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-public-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.739250 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-run-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.739334 master-0 kubenswrapper[33142]: I1204 01:04:02.739294 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-config-data\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.742208 master-0 kubenswrapper[33142]: I1204 01:04:02.739468 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-etc-swift\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.742208 master-0 kubenswrapper[33142]: I1204 01:04:02.739616 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-internal-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.742208 master-0 kubenswrapper[33142]: I1204 01:04:02.739658 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzcss\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-kube-api-access-vzcss\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842641 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-combined-ca-bundle\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842732 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-log-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842760 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-public-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842782 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-run-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842811 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-config-data\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842891 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-etc-swift\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.842980 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-internal-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.846907 master-0 kubenswrapper[33142]: I1204 01:04:02.843006 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzcss\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-kube-api-access-vzcss\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.852452 master-0 kubenswrapper[33142]: I1204 01:04:02.851570 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-run-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.864815 master-0 kubenswrapper[33142]: I1204 01:04:02.854449 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f06387a3-7a54-44b7-b234-9fc987de0e35-log-httpd\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.864815 master-0 kubenswrapper[33142]: I1204 01:04:02.858798 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-internal-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.864815 master-0 kubenswrapper[33142]: I1204 01:04:02.859482 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-etc-swift\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.877626 master-0 kubenswrapper[33142]: I1204 01:04:02.877251 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-combined-ca-bundle\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.889665 master-0 kubenswrapper[33142]: I1204 01:04:02.889485 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-public-tls-certs\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.935639 master-0 kubenswrapper[33142]: I1204 01:04:02.934146 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzcss\" (UniqueName: \"kubernetes.io/projected/f06387a3-7a54-44b7-b234-9fc987de0e35-kube-api-access-vzcss\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.945686 master-0 kubenswrapper[33142]: I1204 01:04:02.945351 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f06387a3-7a54-44b7-b234-9fc987de0e35-config-data\") pod \"swift-proxy-7848784c98-xtw5f\" (UID: \"f06387a3-7a54-44b7-b234-9fc987de0e35\") " pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:02.975198 master-0 kubenswrapper[33142]: I1204 01:04:02.974981 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:04:02.977239 master-0 kubenswrapper[33142]: I1204 01:04:02.975298 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/ironic-594b84b4f-dpqbk" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api-log" containerID="cri-o://2583df8afd6f6da0bc65957cd56d5ce088d439af0cb0744a87827320374f06ad" gracePeriod=60 Dec 04 01:04:02.995693 master-0 kubenswrapper[33142]: I1204 01:04:02.995639 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-db-sync-dj4f6"] Dec 04 01:04:02.997632 master-0 kubenswrapper[33142]: I1204 01:04:02.997606 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.001684 master-0 kubenswrapper[33142]: I1204 01:04:03.001613 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 01:04:03.003409 master-0 kubenswrapper[33142]: I1204 01:04:03.002003 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 01:04:03.011182 master-0 kubenswrapper[33142]: I1204 01:04:03.011108 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-sync-dj4f6"] Dec 04 01:04:03.111638 master-0 kubenswrapper[33142]: I1204 01:04:03.111484 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:03.113877 master-0 kubenswrapper[33142]: I1204 01:04:03.113845 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-db-create-85tml"] Dec 04 01:04:03.121451 master-0 kubenswrapper[33142]: I1204 01:04:03.121388 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.144208 master-0 kubenswrapper[33142]: I1204 01:04:03.144122 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-85tml"] Dec 04 01:04:03.151890 master-0 kubenswrapper[33142]: I1204 01:04:03.151800 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152162 master-0 kubenswrapper[33142]: I1204 01:04:03.151898 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152162 master-0 kubenswrapper[33142]: I1204 01:04:03.151958 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152295 master-0 kubenswrapper[33142]: I1204 01:04:03.152215 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152347 master-0 kubenswrapper[33142]: I1204 01:04:03.152324 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152384 master-0 kubenswrapper[33142]: I1204 01:04:03.152358 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrl6d\" (UniqueName: \"kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.152593 master-0 kubenswrapper[33142]: I1204 01:04:03.152550 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.191635 master-0 kubenswrapper[33142]: I1204 01:04:03.191569 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-db-create-l2gwx"] Dec 04 01:04:03.194490 master-0 kubenswrapper[33142]: I1204 01:04:03.194449 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.211774 master-0 kubenswrapper[33142]: I1204 01:04:03.211687 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-l2gwx"] Dec 04 01:04:03.257559 master-0 kubenswrapper[33142]: I1204 01:04:03.247548 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-db-create-lgv5d"] Dec 04 01:04:03.282953 master-0 kubenswrapper[33142]: I1204 01:04:03.266573 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.284787 master-0 kubenswrapper[33142]: I1204 01:04:03.284728 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.284945 master-0 kubenswrapper[33142]: I1204 01:04:03.284836 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.285118 master-0 kubenswrapper[33142]: I1204 01:04:03.285051 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.288440 master-0 kubenswrapper[33142]: I1204 01:04:03.288399 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpvtt\" (UniqueName: \"kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.289233 master-0 kubenswrapper[33142]: I1204 01:04:03.288491 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.289233 master-0 kubenswrapper[33142]: I1204 01:04:03.288526 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.289233 master-0 kubenswrapper[33142]: I1204 01:04:03.288588 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.289233 master-0 kubenswrapper[33142]: I1204 01:04:03.288638 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.289233 master-0 kubenswrapper[33142]: I1204 01:04:03.289187 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.290616 master-0 kubenswrapper[33142]: I1204 01:04:03.290283 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.291141 master-0 kubenswrapper[33142]: I1204 01:04:03.290740 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.291571 master-0 kubenswrapper[33142]: I1204 01:04:03.291158 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qrl6d\" (UniqueName: \"kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.293022 master-0 kubenswrapper[33142]: I1204 01:04:03.289216 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.299556 master-0 kubenswrapper[33142]: I1204 01:04:03.295878 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.304977 master-0 kubenswrapper[33142]: I1204 01:04:03.304852 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.310033 master-0 kubenswrapper[33142]: I1204 01:04:03.309372 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.354537 master-0 kubenswrapper[33142]: I1204 01:04:03.348722 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.354537 master-0 kubenswrapper[33142]: I1204 01:04:03.349129 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrl6d\" (UniqueName: \"kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d\") pod \"ironic-inspector-db-sync-dj4f6\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.370461 master-0 kubenswrapper[33142]: I1204 01:04:03.369337 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-db-create-lgv5d"] Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.413491 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.414055 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cf8d\" (UniqueName: \"kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.414427 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.414500 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.414545 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.414733 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dpvtt\" (UniqueName: \"kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.415421 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.416349 master-0 kubenswrapper[33142]: I1204 01:04:03.415847 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.440807 master-0 kubenswrapper[33142]: I1204 01:04:03.440746 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpvtt\" (UniqueName: \"kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt\") pod \"nova-api-db-create-85tml\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.452023 master-0 kubenswrapper[33142]: I1204 01:04:03.448758 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") pod \"nova-cell0-db-create-l2gwx\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.469191 master-0 kubenswrapper[33142]: I1204 01:04:03.468980 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-8b00-account-create-update-q75wg"] Dec 04 01:04:03.473604 master-0 kubenswrapper[33142]: I1204 01:04:03.471365 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.481599 master-0 kubenswrapper[33142]: I1204 01:04:03.481063 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:03.486210 master-0 kubenswrapper[33142]: I1204 01:04:03.483693 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-db-secret" Dec 04 01:04:03.497835 master-0 kubenswrapper[33142]: I1204 01:04:03.494485 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-8b00-account-create-update-q75wg"] Dec 04 01:04:03.517068 master-0 kubenswrapper[33142]: I1204 01:04:03.516992 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cf8d\" (UniqueName: \"kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.518597 master-0 kubenswrapper[33142]: I1204 01:04:03.518544 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:03.534316 master-0 kubenswrapper[33142]: I1204 01:04:03.534252 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.539958 master-0 kubenswrapper[33142]: I1204 01:04:03.538903 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:03.539958 master-0 kubenswrapper[33142]: I1204 01:04:03.539423 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:03.552782 master-0 kubenswrapper[33142]: I1204 01:04:03.552463 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-6366-account-create-update-jxntm"] Dec 04 01:04:03.558952 master-0 kubenswrapper[33142]: I1204 01:04:03.554654 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.571150 master-0 kubenswrapper[33142]: I1204 01:04:03.561772 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-db-secret" Dec 04 01:04:03.574588 master-0 kubenswrapper[33142]: I1204 01:04:03.574405 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-6366-account-create-update-jxntm"] Dec 04 01:04:03.639485 master-0 kubenswrapper[33142]: I1204 01:04:03.639432 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j5v\" (UniqueName: \"kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.639680 master-0 kubenswrapper[33142]: I1204 01:04:03.639592 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.639839 master-0 kubenswrapper[33142]: I1204 01:04:03.639809 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.640261 master-0 kubenswrapper[33142]: I1204 01:04:03.640240 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj7nw\" (UniqueName: \"kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.649199 master-0 kubenswrapper[33142]: I1204 01:04:03.648574 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-435d-account-create-update-9c4j5"] Dec 04 01:04:03.651175 master-0 kubenswrapper[33142]: I1204 01:04:03.651148 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.653673 master-0 kubenswrapper[33142]: I1204 01:04:03.653568 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-db-secret" Dec 04 01:04:03.670303 master-0 kubenswrapper[33142]: I1204 01:04:03.670224 33142 generic.go:334] "Generic (PLEG): container finished" podID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerID="2583df8afd6f6da0bc65957cd56d5ce088d439af0cb0744a87827320374f06ad" exitCode=143 Dec 04 01:04:03.670402 master-0 kubenswrapper[33142]: I1204 01:04:03.670310 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerDied","Data":"2583df8afd6f6da0bc65957cd56d5ce088d439af0cb0744a87827320374f06ad"} Dec 04 01:04:03.720785 master-0 kubenswrapper[33142]: I1204 01:04:03.720704 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-435d-account-create-update-9c4j5"] Dec 04 01:04:03.744328 master-0 kubenswrapper[33142]: I1204 01:04:03.744265 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j5v\" (UniqueName: \"kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.744485 master-0 kubenswrapper[33142]: I1204 01:04:03.744362 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.744485 master-0 kubenswrapper[33142]: I1204 01:04:03.744419 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.744577 master-0 kubenswrapper[33142]: I1204 01:04:03.744563 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.744661 master-0 kubenswrapper[33142]: I1204 01:04:03.744622 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7nw\" (UniqueName: \"kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.744765 master-0 kubenswrapper[33142]: I1204 01:04:03.744691 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phz9\" (UniqueName: \"kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.746595 master-0 kubenswrapper[33142]: I1204 01:04:03.746542 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:03.747592 master-0 kubenswrapper[33142]: I1204 01:04:03.747531 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.922288 master-0 kubenswrapper[33142]: I1204 01:04:03.921618 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5phz9\" (UniqueName: \"kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.922288 master-0 kubenswrapper[33142]: I1204 01:04:03.921804 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.923219 master-0 kubenswrapper[33142]: I1204 01:04:03.922909 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:03.953542 master-0 kubenswrapper[33142]: I1204 01:04:03.953447 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj7nw\" (UniqueName: \"kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw\") pod \"nova-api-8b00-account-create-update-q75wg\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:03.971245 master-0 kubenswrapper[33142]: I1204 01:04:03.971116 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phz9\" (UniqueName: \"kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9\") pod \"nova-cell1-435d-account-create-update-9c4j5\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:04.004209 master-0 kubenswrapper[33142]: I1204 01:04:04.004118 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:04.022647 master-0 kubenswrapper[33142]: I1204 01:04:04.013878 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cf8d\" (UniqueName: \"kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d\") pod \"nova-cell1-db-create-lgv5d\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:04.022647 master-0 kubenswrapper[33142]: I1204 01:04:04.021968 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j5v\" (UniqueName: \"kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v\") pod \"nova-cell0-6366-account-create-update-jxntm\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:04.220434 master-0 kubenswrapper[33142]: I1204 01:04:04.220349 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:04.274391 master-0 kubenswrapper[33142]: I1204 01:04:04.274149 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-proxy-7848784c98-xtw5f"] Dec 04 01:04:04.280300 master-0 kubenswrapper[33142]: I1204 01:04:04.278479 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:04.286964 master-0 kubenswrapper[33142]: I1204 01:04:04.286382 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:04:04.304151 master-0 kubenswrapper[33142]: I1204 01:04:04.304029 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:04.316315 master-0 kubenswrapper[33142]: I1204 01:04:04.316158 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-volume-lvm-iscsi-0" Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.446547 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.446665 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.446841 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.446915 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.447051 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.447102 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.447227 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swqjx\" (UniqueName: \"kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.449544 master-0 kubenswrapper[33142]: I1204 01:04:04.447274 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts\") pod \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\" (UID: \"9fb9569c-09bd-4eb5-8bc2-65a639af171d\") " Dec 04 01:04:04.451331 master-0 kubenswrapper[33142]: I1204 01:04:04.451060 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs" (OuterVolumeSpecName: "logs") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:04.456303 master-0 kubenswrapper[33142]: I1204 01:04:04.453163 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged" (OuterVolumeSpecName: "config-data-merged") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "config-data-merged". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:04.480952 master-0 kubenswrapper[33142]: I1204 01:04:04.479382 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:04.487563 master-0 kubenswrapper[33142]: I1204 01:04:04.487500 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 01:04:04.488619 master-0 kubenswrapper[33142]: I1204 01:04:04.488579 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx" (OuterVolumeSpecName: "kube-api-access-swqjx") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "kube-api-access-swqjx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:04.496250 master-0 kubenswrapper[33142]: I1204 01:04:04.496158 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts" (OuterVolumeSpecName: "scripts") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:04.528499 master-0 kubenswrapper[33142]: I1204 01:04:04.524046 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-sync-dj4f6"] Dec 04 01:04:04.538980 master-0 kubenswrapper[33142]: W1204 01:04:04.534186 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e188023_eca9_47e4_ac09_df6f8e493921.slice/crio-e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528 WatchSource:0}: Error finding container e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528: Status 404 returned error can't find the container with id e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528 Dec 04 01:04:04.553811 master-0 kubenswrapper[33142]: I1204 01:04:04.553139 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-l2gwx"] Dec 04 01:04:04.558516 master-0 kubenswrapper[33142]: I1204 01:04:04.558439 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.559335 master-0 kubenswrapper[33142]: I1204 01:04:04.558503 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-merged\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.560619 master-0 kubenswrapper[33142]: I1204 01:04:04.560500 33142 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.562000 master-0 kubenswrapper[33142]: I1204 01:04:04.561916 33142 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb9569c-09bd-4eb5-8bc2-65a639af171d-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.562000 master-0 kubenswrapper[33142]: I1204 01:04:04.561992 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-swqjx\" (UniqueName: \"kubernetes.io/projected/9fb9569c-09bd-4eb5-8bc2-65a639af171d-kube-api-access-swqjx\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.562237 master-0 kubenswrapper[33142]: I1204 01:04:04.562008 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.577704 master-0 kubenswrapper[33142]: I1204 01:04:04.574175 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data" (OuterVolumeSpecName: "config-data") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:04.620123 master-0 kubenswrapper[33142]: I1204 01:04:04.606519 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9fb9569c-09bd-4eb5-8bc2-65a639af171d" (UID: "9fb9569c-09bd-4eb5-8bc2-65a639af171d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:04.668964 master-0 kubenswrapper[33142]: I1204 01:04:04.668373 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.668964 master-0 kubenswrapper[33142]: I1204 01:04:04.668462 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb9569c-09bd-4eb5-8bc2-65a639af171d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:04.774304 master-0 kubenswrapper[33142]: I1204 01:04:04.774236 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-dj4f6" event={"ID":"1810313a-9368-4f9b-9457-205dadd3a2b7","Type":"ContainerStarted","Data":"7ea230f2c6bbeb54ea3fa7884f4a8296c86186b905c4f1c95830e8f99f043b45"} Dec 04 01:04:04.823317 master-0 kubenswrapper[33142]: I1204 01:04:04.822234 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-7848784c98-xtw5f" event={"ID":"f06387a3-7a54-44b7-b234-9fc987de0e35","Type":"ContainerStarted","Data":"b796621cc314d2cf12683976e15c32ca5f81d7df14d1b84d22940a1af4e2d1f9"} Dec 04 01:04:04.854052 master-0 kubenswrapper[33142]: I1204 01:04:04.853958 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-594b84b4f-dpqbk" event={"ID":"9fb9569c-09bd-4eb5-8bc2-65a639af171d","Type":"ContainerDied","Data":"d68eb0fdfeffc1e8fd2b13a65ff85b8555a134cc7f2ecf84ef7105044b79992d"} Dec 04 01:04:04.854277 master-0 kubenswrapper[33142]: I1204 01:04:04.854067 33142 scope.go:117] "RemoveContainer" containerID="4e2c1822a32ad2f383e6515b9c621853936bec059fcd2c22a5d54c7276f1d3d7" Dec 04 01:04:04.854343 master-0 kubenswrapper[33142]: I1204 01:04:04.854274 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-594b84b4f-dpqbk" Dec 04 01:04:04.866007 master-0 kubenswrapper[33142]: I1204 01:04:04.864513 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-l2gwx" event={"ID":"2e188023-eca9-47e4-ac09-df6f8e493921","Type":"ContainerStarted","Data":"e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528"} Dec 04 01:04:04.971356 master-0 kubenswrapper[33142]: I1204 01:04:04.970917 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-backup-0" Dec 04 01:04:05.038692 master-0 kubenswrapper[33142]: I1204 01:04:05.038328 33142 scope.go:117] "RemoveContainer" containerID="2583df8afd6f6da0bc65957cd56d5ce088d439af0cb0744a87827320374f06ad" Dec 04 01:04:05.077354 master-0 kubenswrapper[33142]: I1204 01:04:05.077302 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-10f14-scheduler-0" Dec 04 01:04:05.116126 master-0 kubenswrapper[33142]: I1204 01:04:05.116090 33142 scope.go:117] "RemoveContainer" containerID="23ccc3a5346863e31cc07acde6bc1094ca807a02f0969003ea5222f706388a11" Dec 04 01:04:05.219202 master-0 kubenswrapper[33142]: I1204 01:04:05.219081 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-7f7cdd4b75-tvgpk" Dec 04 01:04:05.650499 master-0 kubenswrapper[33142]: I1204 01:04:05.610917 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-8b00-account-create-update-q75wg"] Dec 04 01:04:05.650499 master-0 kubenswrapper[33142]: W1204 01:04:05.611736 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2365f76d_99b8_47bd_a60f_c2d5bfb019d4.slice/crio-e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8 WatchSource:0}: Error finding container e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8: Status 404 returned error can't find the container with id e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8 Dec 04 01:04:05.650499 master-0 kubenswrapper[33142]: W1204 01:04:05.612372 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42d9718c_28a1_4841_9258_10f477cfcbf5.slice/crio-a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a WatchSource:0}: Error finding container a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a: Status 404 returned error can't find the container with id a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a Dec 04 01:04:05.682308 master-0 kubenswrapper[33142]: I1204 01:04:05.681598 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-db-create-lgv5d"] Dec 04 01:04:05.707581 master-0 kubenswrapper[33142]: I1204 01:04:05.707494 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-85tml"] Dec 04 01:04:05.730645 master-0 kubenswrapper[33142]: I1204 01:04:05.722112 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-435d-account-create-update-9c4j5"] Dec 04 01:04:05.748861 master-0 kubenswrapper[33142]: I1204 01:04:05.745007 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-6366-account-create-update-jxntm"] Dec 04 01:04:05.763429 master-0 kubenswrapper[33142]: I1204 01:04:05.761056 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:04:05.821511 master-0 kubenswrapper[33142]: I1204 01:04:05.821445 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-594b84b4f-dpqbk"] Dec 04 01:04:05.948670 master-0 kubenswrapper[33142]: I1204 01:04:05.948552 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" path="/var/lib/kubelet/pods/9fb9569c-09bd-4eb5-8bc2-65a639af171d/volumes" Dec 04 01:04:05.950179 master-0 kubenswrapper[33142]: I1204 01:04:05.950160 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:04:05.950290 master-0 kubenswrapper[33142]: I1204 01:04:05.950273 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-l2gwx" event={"ID":"2e188023-eca9-47e4-ac09-df6f8e493921","Type":"ContainerStarted","Data":"952873a598e4610a0b37cf6fa37af74cf426d4627113b18c934e47799445a020"} Dec 04 01:04:05.950367 master-0 kubenswrapper[33142]: I1204 01:04:05.950349 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-85tml" event={"ID":"a8134968-9742-489a-a71b-ae48af42f8fe","Type":"ContainerStarted","Data":"0768f82212d9fb143e8f313ce5878c68802e04acd779550a5637aedee1aeaef9"} Dec 04 01:04:05.950450 master-0 kubenswrapper[33142]: I1204 01:04:05.950436 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-7848784c98-xtw5f" event={"ID":"f06387a3-7a54-44b7-b234-9fc987de0e35","Type":"ContainerStarted","Data":"4201b5e671000cb985603fe6a3ef5107e006d1730ce1151e26ee2d355dd7b9e2"} Dec 04 01:04:05.950522 master-0 kubenswrapper[33142]: I1204 01:04:05.950506 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-lgv5d" event={"ID":"d76d6e99-a5be-4091-a768-a9724f60d131","Type":"ContainerStarted","Data":"ba5dab73867c70878e3a9478f719f4b2a02dda824665815217e58ea40a1d02c9"} Dec 04 01:04:05.950591 master-0 kubenswrapper[33142]: I1204 01:04:05.950578 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-8b00-account-create-update-q75wg" event={"ID":"2365f76d-99b8-47bd-a60f-c2d5bfb019d4","Type":"ContainerStarted","Data":"e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8"} Dec 04 01:04:05.950655 master-0 kubenswrapper[33142]: I1204 01:04:05.950643 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-6366-account-create-update-jxntm" event={"ID":"42d9718c-28a1-4841-9258-10f477cfcbf5","Type":"ContainerStarted","Data":"a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a"} Dec 04 01:04:05.950738 master-0 kubenswrapper[33142]: I1204 01:04:05.950722 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" event={"ID":"374a1faa-b897-416f-a67a-e12a6ab22f87","Type":"ContainerStarted","Data":"ce338498f03f5393f0fec29e4ec19f0381114caed94592b145d556b303810d81"} Dec 04 01:04:05.951300 master-0 kubenswrapper[33142]: I1204 01:04:05.951275 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-5fc8c54796-fmv8m" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-api" containerID="cri-o://622cde4b83e16256af7693cdba26edf8bad9d86603b2aa977694b60b73b9cdda" gracePeriod=30 Dec 04 01:04:05.951746 master-0 kubenswrapper[33142]: I1204 01:04:05.951726 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-5fc8c54796-fmv8m" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-httpd" containerID="cri-o://12383da18f488dfa2fa6fbee65225b2530aeb8162869b0ba020285e843fdd9d1" gracePeriod=30 Dec 04 01:04:05.973529 master-0 kubenswrapper[33142]: I1204 01:04:05.973440 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-db-create-l2gwx" podStartSLOduration=3.973418095 podStartE2EDuration="3.973418095s" podCreationTimestamp="2025-12-04 01:04:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:05.933139231 +0000 UTC m=+1018.335141081" watchObservedRunningTime="2025-12-04 01:04:05.973418095 +0000 UTC m=+1018.375419945" Dec 04 01:04:06.987816 master-0 kubenswrapper[33142]: I1204 01:04:06.987090 33142 generic.go:334] "Generic (PLEG): container finished" podID="2e188023-eca9-47e4-ac09-df6f8e493921" containerID="952873a598e4610a0b37cf6fa37af74cf426d4627113b18c934e47799445a020" exitCode=0 Dec 04 01:04:06.987816 master-0 kubenswrapper[33142]: I1204 01:04:06.987196 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-l2gwx" event={"ID":"2e188023-eca9-47e4-ac09-df6f8e493921","Type":"ContainerDied","Data":"952873a598e4610a0b37cf6fa37af74cf426d4627113b18c934e47799445a020"} Dec 04 01:04:06.991795 master-0 kubenswrapper[33142]: I1204 01:04:06.991743 33142 generic.go:334] "Generic (PLEG): container finished" podID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerID="12383da18f488dfa2fa6fbee65225b2530aeb8162869b0ba020285e843fdd9d1" exitCode=0 Dec 04 01:04:06.992056 master-0 kubenswrapper[33142]: I1204 01:04:06.991807 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerDied","Data":"12383da18f488dfa2fa6fbee65225b2530aeb8162869b0ba020285e843fdd9d1"} Dec 04 01:04:07.451035 master-0 kubenswrapper[33142]: I1204 01:04:07.450876 33142 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:04:07.452168 master-0 kubenswrapper[33142]: I1204 01:04:07.452119 33142 scope.go:117] "RemoveContainer" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" Dec 04 01:04:07.452629 master-0 kubenswrapper[33142]: E1204 01:04:07.452583 33142 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-neutron-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-neutron-agent pod=ironic-neutron-agent-6cddc778dc-52tq5_openstack(adc15fbc-accb-467e-9fd9-25ffb68a297e)\"" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" podUID="adc15fbc-accb-467e-9fd9-25ffb68a297e" Dec 04 01:04:12.398481 master-0 kubenswrapper[33142]: I1204 01:04:12.397513 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-db-secret" Dec 04 01:04:12.398481 master-0 kubenswrapper[33142]: I1204 01:04:12.397820 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-db-secret" Dec 04 01:04:12.399285 master-0 kubenswrapper[33142]: I1204 01:04:12.398749 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-db-secret" Dec 04 01:04:12.583990 master-0 kubenswrapper[33142]: I1204 01:04:12.582622 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:12.751034 master-0 kubenswrapper[33142]: I1204 01:04:12.750144 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts\") pod \"2e188023-eca9-47e4-ac09-df6f8e493921\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " Dec 04 01:04:12.751034 master-0 kubenswrapper[33142]: I1204 01:04:12.750275 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") pod \"2e188023-eca9-47e4-ac09-df6f8e493921\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " Dec 04 01:04:12.764833 master-0 kubenswrapper[33142]: I1204 01:04:12.759532 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2e188023-eca9-47e4-ac09-df6f8e493921" (UID: "2e188023-eca9-47e4-ac09-df6f8e493921"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:12.857146 master-0 kubenswrapper[33142]: I1204 01:04:12.856133 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4" (OuterVolumeSpecName: "kube-api-access-k54n4") pod "2e188023-eca9-47e4-ac09-df6f8e493921" (UID: "2e188023-eca9-47e4-ac09-df6f8e493921"). InnerVolumeSpecName "kube-api-access-k54n4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:12.861013 master-0 kubenswrapper[33142]: I1204 01:04:12.857453 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") pod \"2e188023-eca9-47e4-ac09-df6f8e493921\" (UID: \"2e188023-eca9-47e4-ac09-df6f8e493921\") " Dec 04 01:04:12.861013 master-0 kubenswrapper[33142]: W1204 01:04:12.857600 33142 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/2e188023-eca9-47e4-ac09-df6f8e493921/volumes/kubernetes.io~projected/kube-api-access-k54n4 Dec 04 01:04:12.861013 master-0 kubenswrapper[33142]: I1204 01:04:12.857712 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4" (OuterVolumeSpecName: "kube-api-access-k54n4") pod "2e188023-eca9-47e4-ac09-df6f8e493921" (UID: "2e188023-eca9-47e4-ac09-df6f8e493921"). InnerVolumeSpecName "kube-api-access-k54n4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:12.861013 master-0 kubenswrapper[33142]: I1204 01:04:12.858494 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e188023-eca9-47e4-ac09-df6f8e493921-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:12.861013 master-0 kubenswrapper[33142]: I1204 01:04:12.858513 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k54n4\" (UniqueName: \"kubernetes.io/projected/2e188023-eca9-47e4-ac09-df6f8e493921-kube-api-access-k54n4\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:13.113748 master-0 kubenswrapper[33142]: I1204 01:04:13.113674 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-l2gwx" event={"ID":"2e188023-eca9-47e4-ac09-df6f8e493921","Type":"ContainerDied","Data":"e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528"} Dec 04 01:04:13.113748 master-0 kubenswrapper[33142]: I1204 01:04:13.113743 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e36f562d9a4b80df02ace44d98e9688a3e6ba179b3f950d76a2145de9c780528" Dec 04 01:04:13.114054 master-0 kubenswrapper[33142]: I1204 01:04:13.113831 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-l2gwx" Dec 04 01:04:15.157376 master-0 kubenswrapper[33142]: I1204 01:04:15.155531 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-7848784c98-xtw5f" event={"ID":"f06387a3-7a54-44b7-b234-9fc987de0e35","Type":"ContainerStarted","Data":"9cb2bbc3def2a37c0717bc033c7b63dd5f4ff121f602131d404ec24598b5811b"} Dec 04 01:04:15.157376 master-0 kubenswrapper[33142]: I1204 01:04:15.156140 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:15.157376 master-0 kubenswrapper[33142]: I1204 01:04:15.156618 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:15.160408 master-0 kubenswrapper[33142]: I1204 01:04:15.158802 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" event={"ID":"374a1faa-b897-416f-a67a-e12a6ab22f87","Type":"ContainerStarted","Data":"cbf6f86392bf1c9fc1eb37e1740b70c6c92a9598e07970903b90c45732ee1d1f"} Dec 04 01:04:15.166652 master-0 kubenswrapper[33142]: I1204 01:04:15.165844 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstackclient" event={"ID":"007ad09c-92be-4f52-96a2-e345a59c17b0","Type":"ContainerStarted","Data":"085b39d8942ba1193f3f62a65878bf1edfb07741454d5c10c19924592c24f95c"} Dec 04 01:04:15.170860 master-0 kubenswrapper[33142]: I1204 01:04:15.170727 33142 generic.go:334] "Generic (PLEG): container finished" podID="a8134968-9742-489a-a71b-ae48af42f8fe" containerID="9bc05cfb844d91b04f90eaab6eca9a32006366e6b73913197a2f4f5527de8488" exitCode=0 Dec 04 01:04:15.172076 master-0 kubenswrapper[33142]: I1204 01:04:15.170861 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-85tml" event={"ID":"a8134968-9742-489a-a71b-ae48af42f8fe","Type":"ContainerDied","Data":"9bc05cfb844d91b04f90eaab6eca9a32006366e6b73913197a2f4f5527de8488"} Dec 04 01:04:15.177549 master-0 kubenswrapper[33142]: I1204 01:04:15.176026 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/swift-proxy-7848784c98-xtw5f" podUID="f06387a3-7a54-44b7-b234-9fc987de0e35" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Dec 04 01:04:15.188656 master-0 kubenswrapper[33142]: I1204 01:04:15.184283 33142 generic.go:334] "Generic (PLEG): container finished" podID="d76d6e99-a5be-4091-a768-a9724f60d131" containerID="10bc4134fdf872f09ff5a652e61260d32c217c0ceacabdcfdd6627ce624ff547" exitCode=0 Dec 04 01:04:15.188656 master-0 kubenswrapper[33142]: I1204 01:04:15.184409 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-lgv5d" event={"ID":"d76d6e99-a5be-4091-a768-a9724f60d131","Type":"ContainerDied","Data":"10bc4134fdf872f09ff5a652e61260d32c217c0ceacabdcfdd6627ce624ff547"} Dec 04 01:04:15.201360 master-0 kubenswrapper[33142]: I1204 01:04:15.201182 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-8b00-account-create-update-q75wg" event={"ID":"2365f76d-99b8-47bd-a60f-c2d5bfb019d4","Type":"ContainerStarted","Data":"40a2eb7350b294b6fd3bc42ce9d84a36dd887ce3d46275db92d398c238e648c4"} Dec 04 01:04:15.205555 master-0 kubenswrapper[33142]: I1204 01:04:15.203390 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-proxy-7848784c98-xtw5f" podStartSLOduration=13.203362639 podStartE2EDuration="13.203362639s" podCreationTimestamp="2025-12-04 01:04:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:15.184853817 +0000 UTC m=+1027.586855678" watchObservedRunningTime="2025-12-04 01:04:15.203362639 +0000 UTC m=+1027.605364499" Dec 04 01:04:15.205555 master-0 kubenswrapper[33142]: I1204 01:04:15.204174 33142 generic.go:334] "Generic (PLEG): container finished" podID="42d9718c-28a1-4841-9258-10f477cfcbf5" containerID="1401a4237e42cad32080dfa3086674c39612c875cee1e781add7ba4d18b62cea" exitCode=0 Dec 04 01:04:15.205555 master-0 kubenswrapper[33142]: I1204 01:04:15.204253 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-6366-account-create-update-jxntm" event={"ID":"42d9718c-28a1-4841-9258-10f477cfcbf5","Type":"ContainerDied","Data":"1401a4237e42cad32080dfa3086674c39612c875cee1e781add7ba4d18b62cea"} Dec 04 01:04:15.207737 master-0 kubenswrapper[33142]: I1204 01:04:15.206908 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-dj4f6" event={"ID":"1810313a-9368-4f9b-9457-205dadd3a2b7","Type":"ContainerStarted","Data":"20477f76d926167038a4075c0d989581c7f1bd4fb52bbd37ad199405fd7c089f"} Dec 04 01:04:15.308096 master-0 kubenswrapper[33142]: I1204 01:04:15.302044 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" podStartSLOduration=12.302012466 podStartE2EDuration="12.302012466s" podCreationTimestamp="2025-12-04 01:04:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:15.258644235 +0000 UTC m=+1027.660646085" watchObservedRunningTime="2025-12-04 01:04:15.302012466 +0000 UTC m=+1027.704014316" Dec 04 01:04:15.317839 master-0 kubenswrapper[33142]: I1204 01:04:15.315996 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstackclient" podStartSLOduration=2.279223703 podStartE2EDuration="19.315964999s" podCreationTimestamp="2025-12-04 01:03:56 +0000 UTC" firstStartedPulling="2025-12-04 01:03:57.102604723 +0000 UTC m=+1009.504606563" lastFinishedPulling="2025-12-04 01:04:14.139346009 +0000 UTC m=+1026.541347859" observedRunningTime="2025-12-04 01:04:15.289472683 +0000 UTC m=+1027.691474533" watchObservedRunningTime="2025-12-04 01:04:15.315964999 +0000 UTC m=+1027.717966869" Dec 04 01:04:15.347880 master-0 kubenswrapper[33142]: I1204 01:04:15.347763 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-inspector-db-sync-dj4f6" podStartSLOduration=3.823841665 podStartE2EDuration="13.347729814s" podCreationTimestamp="2025-12-04 01:04:02 +0000 UTC" firstStartedPulling="2025-12-04 01:04:04.680134281 +0000 UTC m=+1017.082136131" lastFinishedPulling="2025-12-04 01:04:14.20402243 +0000 UTC m=+1026.606024280" observedRunningTime="2025-12-04 01:04:15.317886963 +0000 UTC m=+1027.719888823" watchObservedRunningTime="2025-12-04 01:04:15.347729814 +0000 UTC m=+1027.749731674" Dec 04 01:04:15.368553 master-0 kubenswrapper[33142]: I1204 01:04:15.368423 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-8b00-account-create-update-q75wg" podStartSLOduration=13.368394746 podStartE2EDuration="13.368394746s" podCreationTimestamp="2025-12-04 01:04:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:15.341473597 +0000 UTC m=+1027.743475467" watchObservedRunningTime="2025-12-04 01:04:15.368394746 +0000 UTC m=+1027.770396596" Dec 04 01:04:16.236296 master-0 kubenswrapper[33142]: I1204 01:04:16.236203 33142 generic.go:334] "Generic (PLEG): container finished" podID="2365f76d-99b8-47bd-a60f-c2d5bfb019d4" containerID="40a2eb7350b294b6fd3bc42ce9d84a36dd887ce3d46275db92d398c238e648c4" exitCode=0 Dec 04 01:04:16.237062 master-0 kubenswrapper[33142]: I1204 01:04:16.236436 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-8b00-account-create-update-q75wg" event={"ID":"2365f76d-99b8-47bd-a60f-c2d5bfb019d4","Type":"ContainerDied","Data":"40a2eb7350b294b6fd3bc42ce9d84a36dd887ce3d46275db92d398c238e648c4"} Dec 04 01:04:16.239790 master-0 kubenswrapper[33142]: I1204 01:04:16.239732 33142 generic.go:334] "Generic (PLEG): container finished" podID="374a1faa-b897-416f-a67a-e12a6ab22f87" containerID="cbf6f86392bf1c9fc1eb37e1740b70c6c92a9598e07970903b90c45732ee1d1f" exitCode=0 Dec 04 01:04:16.241271 master-0 kubenswrapper[33142]: I1204 01:04:16.241218 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" event={"ID":"374a1faa-b897-416f-a67a-e12a6ab22f87","Type":"ContainerDied","Data":"cbf6f86392bf1c9fc1eb37e1740b70c6c92a9598e07970903b90c45732ee1d1f"} Dec 04 01:04:16.265284 master-0 kubenswrapper[33142]: I1204 01:04:16.265195 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:16.866169 master-0 kubenswrapper[33142]: I1204 01:04:16.866091 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:16.962077 master-0 kubenswrapper[33142]: I1204 01:04:16.962002 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6j5v\" (UniqueName: \"kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v\") pod \"42d9718c-28a1-4841-9258-10f477cfcbf5\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " Dec 04 01:04:16.962332 master-0 kubenswrapper[33142]: I1204 01:04:16.962298 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts\") pod \"42d9718c-28a1-4841-9258-10f477cfcbf5\" (UID: \"42d9718c-28a1-4841-9258-10f477cfcbf5\") " Dec 04 01:04:16.963027 master-0 kubenswrapper[33142]: I1204 01:04:16.962958 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "42d9718c-28a1-4841-9258-10f477cfcbf5" (UID: "42d9718c-28a1-4841-9258-10f477cfcbf5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:16.963156 master-0 kubenswrapper[33142]: I1204 01:04:16.963128 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42d9718c-28a1-4841-9258-10f477cfcbf5-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:16.965969 master-0 kubenswrapper[33142]: I1204 01:04:16.965889 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v" (OuterVolumeSpecName: "kube-api-access-p6j5v") pod "42d9718c-28a1-4841-9258-10f477cfcbf5" (UID: "42d9718c-28a1-4841-9258-10f477cfcbf5"). InnerVolumeSpecName "kube-api-access-p6j5v". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:17.065804 master-0 kubenswrapper[33142]: I1204 01:04:17.065739 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p6j5v\" (UniqueName: \"kubernetes.io/projected/42d9718c-28a1-4841-9258-10f477cfcbf5-kube-api-access-p6j5v\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:17.082753 master-0 kubenswrapper[33142]: I1204 01:04:17.082653 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:17.087410 master-0 kubenswrapper[33142]: I1204 01:04:17.087354 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:17.167416 master-0 kubenswrapper[33142]: I1204 01:04:17.167332 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cf8d\" (UniqueName: \"kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d\") pod \"d76d6e99-a5be-4091-a768-a9724f60d131\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " Dec 04 01:04:17.167700 master-0 kubenswrapper[33142]: I1204 01:04:17.167625 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpvtt\" (UniqueName: \"kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt\") pod \"a8134968-9742-489a-a71b-ae48af42f8fe\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " Dec 04 01:04:17.168414 master-0 kubenswrapper[33142]: I1204 01:04:17.168386 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts\") pod \"d76d6e99-a5be-4091-a768-a9724f60d131\" (UID: \"d76d6e99-a5be-4091-a768-a9724f60d131\") " Dec 04 01:04:17.169098 master-0 kubenswrapper[33142]: I1204 01:04:17.168666 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts\") pod \"a8134968-9742-489a-a71b-ae48af42f8fe\" (UID: \"a8134968-9742-489a-a71b-ae48af42f8fe\") " Dec 04 01:04:17.169098 master-0 kubenswrapper[33142]: I1204 01:04:17.169015 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d76d6e99-a5be-4091-a768-a9724f60d131" (UID: "d76d6e99-a5be-4091-a768-a9724f60d131"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:17.169714 master-0 kubenswrapper[33142]: I1204 01:04:17.169575 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d76d6e99-a5be-4091-a768-a9724f60d131-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:17.169714 master-0 kubenswrapper[33142]: I1204 01:04:17.169681 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a8134968-9742-489a-a71b-ae48af42f8fe" (UID: "a8134968-9742-489a-a71b-ae48af42f8fe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:17.171628 master-0 kubenswrapper[33142]: I1204 01:04:17.171550 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d" (OuterVolumeSpecName: "kube-api-access-7cf8d") pod "d76d6e99-a5be-4091-a768-a9724f60d131" (UID: "d76d6e99-a5be-4091-a768-a9724f60d131"). InnerVolumeSpecName "kube-api-access-7cf8d". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:17.173485 master-0 kubenswrapper[33142]: I1204 01:04:17.173427 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt" (OuterVolumeSpecName: "kube-api-access-dpvtt") pod "a8134968-9742-489a-a71b-ae48af42f8fe" (UID: "a8134968-9742-489a-a71b-ae48af42f8fe"). InnerVolumeSpecName "kube-api-access-dpvtt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:17.263941 master-0 kubenswrapper[33142]: I1204 01:04:17.263825 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-85tml" Dec 04 01:04:17.264456 master-0 kubenswrapper[33142]: I1204 01:04:17.264352 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-85tml" event={"ID":"a8134968-9742-489a-a71b-ae48af42f8fe","Type":"ContainerDied","Data":"0768f82212d9fb143e8f313ce5878c68802e04acd779550a5637aedee1aeaef9"} Dec 04 01:04:17.264456 master-0 kubenswrapper[33142]: I1204 01:04:17.264430 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0768f82212d9fb143e8f313ce5878c68802e04acd779550a5637aedee1aeaef9" Dec 04 01:04:17.272048 master-0 kubenswrapper[33142]: I1204 01:04:17.271641 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-lgv5d" Dec 04 01:04:17.273179 master-0 kubenswrapper[33142]: I1204 01:04:17.273095 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7cf8d\" (UniqueName: \"kubernetes.io/projected/d76d6e99-a5be-4091-a768-a9724f60d131-kube-api-access-7cf8d\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:17.273179 master-0 kubenswrapper[33142]: I1204 01:04:17.273168 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dpvtt\" (UniqueName: \"kubernetes.io/projected/a8134968-9742-489a-a71b-ae48af42f8fe-kube-api-access-dpvtt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:17.273449 master-0 kubenswrapper[33142]: I1204 01:04:17.273193 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a8134968-9742-489a-a71b-ae48af42f8fe-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:17.273641 master-0 kubenswrapper[33142]: I1204 01:04:17.273545 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-lgv5d" event={"ID":"d76d6e99-a5be-4091-a768-a9724f60d131","Type":"ContainerDied","Data":"ba5dab73867c70878e3a9478f719f4b2a02dda824665815217e58ea40a1d02c9"} Dec 04 01:04:17.273641 master-0 kubenswrapper[33142]: I1204 01:04:17.273606 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba5dab73867c70878e3a9478f719f4b2a02dda824665815217e58ea40a1d02c9" Dec 04 01:04:17.283633 master-0 kubenswrapper[33142]: I1204 01:04:17.283582 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-6366-account-create-update-jxntm" Dec 04 01:04:17.284232 master-0 kubenswrapper[33142]: I1204 01:04:17.284173 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-6366-account-create-update-jxntm" event={"ID":"42d9718c-28a1-4841-9258-10f477cfcbf5","Type":"ContainerDied","Data":"a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a"} Dec 04 01:04:17.284294 master-0 kubenswrapper[33142]: I1204 01:04:17.284239 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0b33e6cf2b1cba1c44d8f6e644c19355dc8660ef9234914953965b28471345a" Dec 04 01:04:17.941024 master-0 kubenswrapper[33142]: I1204 01:04:17.940841 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:17.954418 master-0 kubenswrapper[33142]: I1204 01:04:17.954359 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:17.996587 master-0 kubenswrapper[33142]: I1204 01:04:17.996268 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts\") pod \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " Dec 04 01:04:17.997339 master-0 kubenswrapper[33142]: I1204 01:04:17.997310 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj7nw\" (UniqueName: \"kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw\") pod \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\" (UID: \"2365f76d-99b8-47bd-a60f-c2d5bfb019d4\") " Dec 04 01:04:17.997916 master-0 kubenswrapper[33142]: I1204 01:04:17.997867 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2365f76d-99b8-47bd-a60f-c2d5bfb019d4" (UID: "2365f76d-99b8-47bd-a60f-c2d5bfb019d4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:17.998669 master-0 kubenswrapper[33142]: I1204 01:04:17.998648 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5phz9\" (UniqueName: \"kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9\") pod \"374a1faa-b897-416f-a67a-e12a6ab22f87\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " Dec 04 01:04:17.998828 master-0 kubenswrapper[33142]: I1204 01:04:17.998809 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts\") pod \"374a1faa-b897-416f-a67a-e12a6ab22f87\" (UID: \"374a1faa-b897-416f-a67a-e12a6ab22f87\") " Dec 04 01:04:17.999440 master-0 kubenswrapper[33142]: I1204 01:04:17.999394 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "374a1faa-b897-416f-a67a-e12a6ab22f87" (UID: "374a1faa-b897-416f-a67a-e12a6ab22f87"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:18.006051 master-0 kubenswrapper[33142]: I1204 01:04:18.003852 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw" (OuterVolumeSpecName: "kube-api-access-lj7nw") pod "2365f76d-99b8-47bd-a60f-c2d5bfb019d4" (UID: "2365f76d-99b8-47bd-a60f-c2d5bfb019d4"). InnerVolumeSpecName "kube-api-access-lj7nw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:18.009369 master-0 kubenswrapper[33142]: I1204 01:04:18.009286 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9" (OuterVolumeSpecName: "kube-api-access-5phz9") pod "374a1faa-b897-416f-a67a-e12a6ab22f87" (UID: "374a1faa-b897-416f-a67a-e12a6ab22f87"). InnerVolumeSpecName "kube-api-access-5phz9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:18.012179 master-0 kubenswrapper[33142]: I1204 01:04:18.010827 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lj7nw\" (UniqueName: \"kubernetes.io/projected/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-kube-api-access-lj7nw\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:18.012179 master-0 kubenswrapper[33142]: I1204 01:04:18.010863 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5phz9\" (UniqueName: \"kubernetes.io/projected/374a1faa-b897-416f-a67a-e12a6ab22f87-kube-api-access-5phz9\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:18.012179 master-0 kubenswrapper[33142]: I1204 01:04:18.010881 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/374a1faa-b897-416f-a67a-e12a6ab22f87-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:18.012179 master-0 kubenswrapper[33142]: I1204 01:04:18.010897 33142 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2365f76d-99b8-47bd-a60f-c2d5bfb019d4-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:18.306693 master-0 kubenswrapper[33142]: I1204 01:04:18.306569 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" event={"ID":"374a1faa-b897-416f-a67a-e12a6ab22f87","Type":"ContainerDied","Data":"ce338498f03f5393f0fec29e4ec19f0381114caed94592b145d556b303810d81"} Dec 04 01:04:18.306693 master-0 kubenswrapper[33142]: I1204 01:04:18.306675 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce338498f03f5393f0fec29e4ec19f0381114caed94592b145d556b303810d81" Dec 04 01:04:18.307304 master-0 kubenswrapper[33142]: I1204 01:04:18.306810 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-435d-account-create-update-9c4j5" Dec 04 01:04:18.313456 master-0 kubenswrapper[33142]: I1204 01:04:18.313379 33142 generic.go:334] "Generic (PLEG): container finished" podID="1810313a-9368-4f9b-9457-205dadd3a2b7" containerID="20477f76d926167038a4075c0d989581c7f1bd4fb52bbd37ad199405fd7c089f" exitCode=0 Dec 04 01:04:18.313641 master-0 kubenswrapper[33142]: I1204 01:04:18.313492 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-dj4f6" event={"ID":"1810313a-9368-4f9b-9457-205dadd3a2b7","Type":"ContainerDied","Data":"20477f76d926167038a4075c0d989581c7f1bd4fb52bbd37ad199405fd7c089f"} Dec 04 01:04:18.316710 master-0 kubenswrapper[33142]: I1204 01:04:18.316626 33142 generic.go:334] "Generic (PLEG): container finished" podID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerID="622cde4b83e16256af7693cdba26edf8bad9d86603b2aa977694b60b73b9cdda" exitCode=0 Dec 04 01:04:18.316841 master-0 kubenswrapper[33142]: I1204 01:04:18.316732 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerDied","Data":"622cde4b83e16256af7693cdba26edf8bad9d86603b2aa977694b60b73b9cdda"} Dec 04 01:04:18.319052 master-0 kubenswrapper[33142]: I1204 01:04:18.319002 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-8b00-account-create-update-q75wg" event={"ID":"2365f76d-99b8-47bd-a60f-c2d5bfb019d4","Type":"ContainerDied","Data":"e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8"} Dec 04 01:04:18.319127 master-0 kubenswrapper[33142]: I1204 01:04:18.319053 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3cfbbbde377ddde68a912da632e0c907d181e57e5386ad88920741a1379b2b8" Dec 04 01:04:18.319127 master-0 kubenswrapper[33142]: I1204 01:04:18.319026 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-8b00-account-create-update-q75wg" Dec 04 01:04:21.920163 master-0 kubenswrapper[33142]: I1204 01:04:21.919774 33142 scope.go:117] "RemoveContainer" containerID="37b0421453b80a5edfa6919333a28bff73f4ac34ee297452846e0fbf462bb2af" Dec 04 01:04:23.119821 master-0 kubenswrapper[33142]: I1204 01:04:23.119740 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/swift-proxy-7848784c98-xtw5f" Dec 04 01:04:24.958568 master-0 kubenswrapper[33142]: I1204 01:04:24.958437 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:24.980176 master-0 kubenswrapper[33142]: I1204 01:04:24.970657 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:04:25.071852 master-0 kubenswrapper[33142]: I1204 01:04:25.071772 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs\") pod \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " Dec 04 01:04:25.071852 master-0 kubenswrapper[33142]: I1204 01:04:25.071855 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2qm2\" (UniqueName: \"kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2\") pod \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " Dec 04 01:04:25.072168 master-0 kubenswrapper[33142]: I1204 01:04:25.071901 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072168 master-0 kubenswrapper[33142]: I1204 01:04:25.071965 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072168 master-0 kubenswrapper[33142]: I1204 01:04:25.071995 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle\") pod \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " Dec 04 01:04:25.072168 master-0 kubenswrapper[33142]: I1204 01:04:25.072094 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrl6d\" (UniqueName: \"kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072168 master-0 kubenswrapper[33142]: I1204 01:04:25.072168 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072409 master-0 kubenswrapper[33142]: I1204 01:04:25.072323 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config\") pod \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " Dec 04 01:04:25.072409 master-0 kubenswrapper[33142]: I1204 01:04:25.072349 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072499 master-0 kubenswrapper[33142]: I1204 01:04:25.072424 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072614 master-0 kubenswrapper[33142]: I1204 01:04:25.072541 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts\") pod \"1810313a-9368-4f9b-9457-205dadd3a2b7\" (UID: \"1810313a-9368-4f9b-9457-205dadd3a2b7\") " Dec 04 01:04:25.072685 master-0 kubenswrapper[33142]: I1204 01:04:25.072636 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config\") pod \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\" (UID: \"97fb0590-66c4-4eb8-83ca-6f719e7b2f28\") " Dec 04 01:04:25.074462 master-0 kubenswrapper[33142]: I1204 01:04:25.074413 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir" (OuterVolumeSpecName: "var-lib-ironic-inspector-dhcp-hostsdir") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "var-lib-ironic-inspector-dhcp-hostsdir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:25.074571 master-0 kubenswrapper[33142]: I1204 01:04:25.074450 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic" (OuterVolumeSpecName: "var-lib-ironic") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "var-lib-ironic". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:25.083847 master-0 kubenswrapper[33142]: I1204 01:04:25.083737 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2" (OuterVolumeSpecName: "kube-api-access-v2qm2") pod "97fb0590-66c4-4eb8-83ca-6f719e7b2f28" (UID: "97fb0590-66c4-4eb8-83ca-6f719e7b2f28"). InnerVolumeSpecName "kube-api-access-v2qm2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:25.089791 master-0 kubenswrapper[33142]: I1204 01:04:25.089569 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "97fb0590-66c4-4eb8-83ca-6f719e7b2f28" (UID: "97fb0590-66c4-4eb8-83ca-6f719e7b2f28"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.090184 master-0 kubenswrapper[33142]: I1204 01:04:25.090120 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts" (OuterVolumeSpecName: "scripts") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.093566 master-0 kubenswrapper[33142]: I1204 01:04:25.092891 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d" (OuterVolumeSpecName: "kube-api-access-qrl6d") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "kube-api-access-qrl6d". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:25.093566 master-0 kubenswrapper[33142]: I1204 01:04:25.093048 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 01:04:25.114742 master-0 kubenswrapper[33142]: I1204 01:04:25.113363 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config" (OuterVolumeSpecName: "config") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.114742 master-0 kubenswrapper[33142]: I1204 01:04:25.114668 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1810313a-9368-4f9b-9457-205dadd3a2b7" (UID: "1810313a-9368-4f9b-9457-205dadd3a2b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.158279 master-0 kubenswrapper[33142]: I1204 01:04:25.158206 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config" (OuterVolumeSpecName: "config") pod "97fb0590-66c4-4eb8-83ca-6f719e7b2f28" (UID: "97fb0590-66c4-4eb8-83ca-6f719e7b2f28"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.171359 master-0 kubenswrapper[33142]: I1204 01:04:25.171267 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97fb0590-66c4-4eb8-83ca-6f719e7b2f28" (UID: "97fb0590-66c4-4eb8-83ca-6f719e7b2f28"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.176360 master-0 kubenswrapper[33142]: I1204 01:04:25.176309 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176360 master-0 kubenswrapper[33142]: I1204 01:04:25.176354 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qrl6d\" (UniqueName: \"kubernetes.io/projected/1810313a-9368-4f9b-9457-205dadd3a2b7-kube-api-access-qrl6d\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176371 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176387 33142 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-httpd-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176402 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/1810313a-9368-4f9b-9457-205dadd3a2b7-var-lib-ironic-inspector-dhcp-hostsdir\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176414 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176423 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176436 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176448 master-0 kubenswrapper[33142]: I1204 01:04:25.176446 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v2qm2\" (UniqueName: \"kubernetes.io/projected/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-kube-api-access-v2qm2\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176735 master-0 kubenswrapper[33142]: I1204 01:04:25.176459 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1810313a-9368-4f9b-9457-205dadd3a2b7-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.176735 master-0 kubenswrapper[33142]: I1204 01:04:25.176470 33142 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1810313a-9368-4f9b-9457-205dadd3a2b7-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.195230 master-0 kubenswrapper[33142]: I1204 01:04:25.195117 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "97fb0590-66c4-4eb8-83ca-6f719e7b2f28" (UID: "97fb0590-66c4-4eb8-83ca-6f719e7b2f28"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:25.281435 master-0 kubenswrapper[33142]: I1204 01:04:25.281358 33142 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/97fb0590-66c4-4eb8-83ca-6f719e7b2f28-ovndb-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:25.383819 master-0 kubenswrapper[33142]: I1204 01:04:25.383729 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-conductor-db-sync-nmfnt"] Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: E1204 01:04:25.384636 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="init" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: I1204 01:04:25.384672 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="init" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: E1204 01:04:25.384692 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2365f76d-99b8-47bd-a60f-c2d5bfb019d4" containerName="mariadb-account-create-update" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: I1204 01:04:25.384703 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2365f76d-99b8-47bd-a60f-c2d5bfb019d4" containerName="mariadb-account-create-update" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: E1204 01:04:25.384716 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d76d6e99-a5be-4091-a768-a9724f60d131" containerName="mariadb-database-create" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: I1204 01:04:25.384727 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76d6e99-a5be-4091-a768-a9724f60d131" containerName="mariadb-database-create" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: E1204 01:04:25.384754 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1810313a-9368-4f9b-9457-205dadd3a2b7" containerName="ironic-inspector-db-sync" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: I1204 01:04:25.384764 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1810313a-9368-4f9b-9457-205dadd3a2b7" containerName="ironic-inspector-db-sync" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: E1204 01:04:25.384779 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api-log" Dec 04 01:04:25.384781 master-0 kubenswrapper[33142]: I1204 01:04:25.384788 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api-log" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.384809 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.384819 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.384845 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e188023-eca9-47e4-ac09-df6f8e493921" containerName="mariadb-database-create" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.384854 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e188023-eca9-47e4-ac09-df6f8e493921" containerName="mariadb-database-create" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.384874 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42d9718c-28a1-4841-9258-10f477cfcbf5" containerName="mariadb-account-create-update" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.384883 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d9718c-28a1-4841-9258-10f477cfcbf5" containerName="mariadb-account-create-update" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.385039 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8134968-9742-489a-a71b-ae48af42f8fe" containerName="mariadb-database-create" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.385062 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8134968-9742-489a-a71b-ae48af42f8fe" containerName="mariadb-database-create" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.385097 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-api" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.385106 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-api" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.385157 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="374a1faa-b897-416f-a67a-e12a6ab22f87" containerName="mariadb-account-create-update" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.385168 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="374a1faa-b897-416f-a67a-e12a6ab22f87" containerName="mariadb-account-create-update" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: E1204 01:04:25.385193 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-httpd" Dec 04 01:04:25.385236 master-0 kubenswrapper[33142]: I1204 01:04:25.385204 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-httpd" Dec 04 01:04:25.385712 master-0 kubenswrapper[33142]: I1204 01:04:25.385683 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d76d6e99-a5be-4091-a768-a9724f60d131" containerName="mariadb-database-create" Dec 04 01:04:25.385768 master-0 kubenswrapper[33142]: I1204 01:04:25.385715 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-api" Dec 04 01:04:25.385768 master-0 kubenswrapper[33142]: I1204 01:04:25.385753 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="42d9718c-28a1-4841-9258-10f477cfcbf5" containerName="mariadb-account-create-update" Dec 04 01:04:25.385829 master-0 kubenswrapper[33142]: I1204 01:04:25.385775 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:25.385829 master-0 kubenswrapper[33142]: I1204 01:04:25.385787 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="374a1faa-b897-416f-a67a-e12a6ab22f87" containerName="mariadb-account-create-update" Dec 04 01:04:25.385829 master-0 kubenswrapper[33142]: I1204 01:04:25.385800 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2365f76d-99b8-47bd-a60f-c2d5bfb019d4" containerName="mariadb-account-create-update" Dec 04 01:04:25.385829 master-0 kubenswrapper[33142]: I1204 01:04:25.385816 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api-log" Dec 04 01:04:25.385966 master-0 kubenswrapper[33142]: I1204 01:04:25.385845 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:25.385966 master-0 kubenswrapper[33142]: I1204 01:04:25.385865 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1810313a-9368-4f9b-9457-205dadd3a2b7" containerName="ironic-inspector-db-sync" Dec 04 01:04:25.385966 master-0 kubenswrapper[33142]: I1204 01:04:25.385890 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" containerName="neutron-httpd" Dec 04 01:04:25.385966 master-0 kubenswrapper[33142]: I1204 01:04:25.385906 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e188023-eca9-47e4-ac09-df6f8e493921" containerName="mariadb-database-create" Dec 04 01:04:25.385966 master-0 kubenswrapper[33142]: I1204 01:04:25.385919 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8134968-9742-489a-a71b-ae48af42f8fe" containerName="mariadb-database-create" Dec 04 01:04:25.387025 master-0 kubenswrapper[33142]: I1204 01:04:25.386993 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.389765 master-0 kubenswrapper[33142]: I1204 01:04:25.389659 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-scripts" Dec 04 01:04:25.389853 master-0 kubenswrapper[33142]: I1204 01:04:25.389737 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-config-data" Dec 04 01:04:25.422635 master-0 kubenswrapper[33142]: I1204 01:04:25.422560 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-nmfnt"] Dec 04 01:04:25.450883 master-0 kubenswrapper[33142]: I1204 01:04:25.450790 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" event={"ID":"adc15fbc-accb-467e-9fd9-25ffb68a297e","Type":"ContainerStarted","Data":"f7ca37d31ad1c30dbf395880ddf1adc4d99d26ffff5000020323a9f56234e1a5"} Dec 04 01:04:25.453677 master-0 kubenswrapper[33142]: I1204 01:04:25.453642 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:04:25.457167 master-0 kubenswrapper[33142]: I1204 01:04:25.457116 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-dj4f6" event={"ID":"1810313a-9368-4f9b-9457-205dadd3a2b7","Type":"ContainerDied","Data":"7ea230f2c6bbeb54ea3fa7884f4a8296c86186b905c4f1c95830e8f99f043b45"} Dec 04 01:04:25.457289 master-0 kubenswrapper[33142]: I1204 01:04:25.457272 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ea230f2c6bbeb54ea3fa7884f4a8296c86186b905c4f1c95830e8f99f043b45" Dec 04 01:04:25.457436 master-0 kubenswrapper[33142]: I1204 01:04:25.457420 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-dj4f6" Dec 04 01:04:25.465116 master-0 kubenswrapper[33142]: I1204 01:04:25.465086 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5fc8c54796-fmv8m" Dec 04 01:04:25.465258 master-0 kubenswrapper[33142]: I1204 01:04:25.465098 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5fc8c54796-fmv8m" event={"ID":"97fb0590-66c4-4eb8-83ca-6f719e7b2f28","Type":"ContainerDied","Data":"7fbb1a39f3dc21b2c09e608be29b17f203c637b83d6585a52bcd8dd413935922"} Dec 04 01:04:25.465258 master-0 kubenswrapper[33142]: I1204 01:04:25.465222 33142 scope.go:117] "RemoveContainer" containerID="12383da18f488dfa2fa6fbee65225b2530aeb8162869b0ba020285e843fdd9d1" Dec 04 01:04:25.468030 master-0 kubenswrapper[33142]: I1204 01:04:25.467894 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"41715b3b111a2d3922d75d49e5570f8ec0a790574b9ea17ae7d1503eef5229b5"} Dec 04 01:04:25.485842 master-0 kubenswrapper[33142]: I1204 01:04:25.485693 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.485842 master-0 kubenswrapper[33142]: I1204 01:04:25.485816 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.486095 master-0 kubenswrapper[33142]: I1204 01:04:25.485966 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.486095 master-0 kubenswrapper[33142]: I1204 01:04:25.486054 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb26z\" (UniqueName: \"kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.500574 master-0 kubenswrapper[33142]: I1204 01:04:25.500348 33142 scope.go:117] "RemoveContainer" containerID="622cde4b83e16256af7693cdba26edf8bad9d86603b2aa977694b60b73b9cdda" Dec 04 01:04:25.559562 master-0 kubenswrapper[33142]: I1204 01:04:25.559506 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:04:25.571321 master-0 kubenswrapper[33142]: I1204 01:04:25.571259 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-5fc8c54796-fmv8m"] Dec 04 01:04:25.589015 master-0 kubenswrapper[33142]: I1204 01:04:25.588947 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.589250 master-0 kubenswrapper[33142]: I1204 01:04:25.589219 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mb26z\" (UniqueName: \"kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.589416 master-0 kubenswrapper[33142]: I1204 01:04:25.589381 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.589572 master-0 kubenswrapper[33142]: I1204 01:04:25.589533 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.594544 master-0 kubenswrapper[33142]: I1204 01:04:25.593729 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.595193 master-0 kubenswrapper[33142]: I1204 01:04:25.595136 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.595950 master-0 kubenswrapper[33142]: I1204 01:04:25.595903 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.608874 master-0 kubenswrapper[33142]: I1204 01:04:25.608820 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb26z\" (UniqueName: \"kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z\") pod \"nova-cell0-conductor-db-sync-nmfnt\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.743657 master-0 kubenswrapper[33142]: I1204 01:04:25.743514 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:04:25.969665 master-0 kubenswrapper[33142]: I1204 01:04:25.969594 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97fb0590-66c4-4eb8-83ca-6f719e7b2f28" path="/var/lib/kubelet/pods/97fb0590-66c4-4eb8-83ca-6f719e7b2f28/volumes" Dec 04 01:04:26.237568 master-0 kubenswrapper[33142]: I1204 01:04:26.237403 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-nmfnt"] Dec 04 01:04:26.239014 master-0 kubenswrapper[33142]: W1204 01:04:26.238494 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c9e20f8_5e76_46ee_bd45_da2d6f2b6583.slice/crio-0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6 WatchSource:0}: Error finding container 0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6: Status 404 returned error can't find the container with id 0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6 Dec 04 01:04:26.484065 master-0 kubenswrapper[33142]: I1204 01:04:26.483881 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" event={"ID":"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583","Type":"ContainerStarted","Data":"0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6"} Dec 04 01:04:26.620992 master-0 kubenswrapper[33142]: I1204 01:04:26.619980 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:26.620992 master-0 kubenswrapper[33142]: I1204 01:04:26.620311 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-external-api-0" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-log" containerID="cri-o://78446d3325aec54ecb3e60f698657f74182c8fe8aa8837352b71aa034a22f212" gracePeriod=30 Dec 04 01:04:26.620992 master-0 kubenswrapper[33142]: I1204 01:04:26.620596 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-external-api-0" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-httpd" containerID="cri-o://aa50042ecba39c07f14c6cf4387963475a006dc1bd7af76149e80e04659e09c9" gracePeriod=30 Dec 04 01:04:27.043203 master-0 kubenswrapper[33142]: I1204 01:04:27.040100 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:04:27.043203 master-0 kubenswrapper[33142]: E1204 01:04:27.040762 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:27.043203 master-0 kubenswrapper[33142]: I1204 01:04:27.040779 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb9569c-09bd-4eb5-8bc2-65a639af171d" containerName="ironic-api" Dec 04 01:04:27.043203 master-0 kubenswrapper[33142]: I1204 01:04:27.043146 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.096057 master-0 kubenswrapper[33142]: I1204 01:04:27.093919 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.149670 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.149769 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.149988 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.150141 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.150368 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5sj\" (UniqueName: \"kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.154728 master-0 kubenswrapper[33142]: I1204 01:04:27.150418 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253144 master-0 kubenswrapper[33142]: I1204 01:04:27.253062 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253516 master-0 kubenswrapper[33142]: I1204 01:04:27.253189 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253516 master-0 kubenswrapper[33142]: I1204 01:04:27.253253 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253516 master-0 kubenswrapper[33142]: I1204 01:04:27.253362 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5sj\" (UniqueName: \"kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253516 master-0 kubenswrapper[33142]: I1204 01:04:27.253393 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.253516 master-0 kubenswrapper[33142]: I1204 01:04:27.253453 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.254511 master-0 kubenswrapper[33142]: I1204 01:04:27.254480 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.255078 master-0 kubenswrapper[33142]: I1204 01:04:27.255052 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.255677 master-0 kubenswrapper[33142]: I1204 01:04:27.255648 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.256623 master-0 kubenswrapper[33142]: I1204 01:04:27.256212 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.257212 master-0 kubenswrapper[33142]: I1204 01:04:27.257166 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.259010 master-0 kubenswrapper[33142]: I1204 01:04:27.258870 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:27.286974 master-0 kubenswrapper[33142]: I1204 01:04:27.286245 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5sj\" (UniqueName: \"kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj\") pod \"dnsmasq-dns-65bf6dc599-wn4bp\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.313898 master-0 kubenswrapper[33142]: I1204 01:04:27.306188 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:27.313898 master-0 kubenswrapper[33142]: I1204 01:04:27.313839 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-inspector-transport" Dec 04 01:04:27.314238 master-0 kubenswrapper[33142]: I1204 01:04:27.314144 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 01:04:27.337112 master-0 kubenswrapper[33142]: I1204 01:04:27.314291 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355080 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355177 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355218 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355255 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355289 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355323 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdnt\" (UniqueName: \"kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.359011 master-0 kubenswrapper[33142]: I1204 01:04:27.355375 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.371955 master-0 kubenswrapper[33142]: I1204 01:04:27.365210 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.457380 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.457476 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.457873 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.457954 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdnt\" (UniqueName: \"kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.458155 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.458340 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.458759 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.460564 master-0 kubenswrapper[33142]: I1204 01:04:27.459418 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.463409 master-0 kubenswrapper[33142]: I1204 01:04:27.463046 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.463648 master-0 kubenswrapper[33142]: I1204 01:04:27.463615 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.465881 master-0 kubenswrapper[33142]: I1204 01:04:27.465207 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.474348 master-0 kubenswrapper[33142]: I1204 01:04:27.474236 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.474827 master-0 kubenswrapper[33142]: I1204 01:04:27.474593 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.483639 master-0 kubenswrapper[33142]: I1204 01:04:27.478303 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:27.483639 master-0 kubenswrapper[33142]: I1204 01:04:27.480446 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdnt\" (UniqueName: \"kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt\") pod \"ironic-inspector-0\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:27.508348 master-0 kubenswrapper[33142]: I1204 01:04:27.508254 33142 generic.go:334] "Generic (PLEG): container finished" podID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerID="78446d3325aec54ecb3e60f698657f74182c8fe8aa8837352b71aa034a22f212" exitCode=143 Dec 04 01:04:27.508576 master-0 kubenswrapper[33142]: I1204 01:04:27.508375 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerDied","Data":"78446d3325aec54ecb3e60f698657f74182c8fe8aa8837352b71aa034a22f212"} Dec 04 01:04:27.683196 master-0 kubenswrapper[33142]: I1204 01:04:27.681970 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:28.111956 master-0 kubenswrapper[33142]: I1204 01:04:28.101038 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:04:28.561105 master-0 kubenswrapper[33142]: I1204 01:04:28.560943 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" event={"ID":"30532606-4a55-430e-83e9-178201d7caaf","Type":"ContainerStarted","Data":"7e5e7add67692c51a4d9bd481d9b2f60e91e31fac7576cb4f12b8e19e70dbcd0"} Dec 04 01:04:28.645858 master-0 kubenswrapper[33142]: I1204 01:04:28.645786 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:29.578351 master-0 kubenswrapper[33142]: I1204 01:04:29.578168 33142 generic.go:334] "Generic (PLEG): container finished" podID="30532606-4a55-430e-83e9-178201d7caaf" containerID="6df093dcf659593543ee93cbebadd17672855f647f58279e013e7dc91dc4b343" exitCode=0 Dec 04 01:04:29.579552 master-0 kubenswrapper[33142]: I1204 01:04:29.579012 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" event={"ID":"30532606-4a55-430e-83e9-178201d7caaf","Type":"ContainerDied","Data":"6df093dcf659593543ee93cbebadd17672855f647f58279e013e7dc91dc4b343"} Dec 04 01:04:29.584015 master-0 kubenswrapper[33142]: I1204 01:04:29.583271 33142 generic.go:334] "Generic (PLEG): container finished" podID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerID="725af3aa0bf6b017b57965224357714b37597b38fe37302d9508678e0d298488" exitCode=0 Dec 04 01:04:29.584015 master-0 kubenswrapper[33142]: I1204 01:04:29.583335 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"74645d59-1991-4c1f-bae2-68f5bfb9054d","Type":"ContainerDied","Data":"725af3aa0bf6b017b57965224357714b37597b38fe37302d9508678e0d298488"} Dec 04 01:04:29.584015 master-0 kubenswrapper[33142]: I1204 01:04:29.583555 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"74645d59-1991-4c1f-bae2-68f5bfb9054d","Type":"ContainerStarted","Data":"59a9ebd6e91562497816183db252d5a601fed0f5cf0a3876295badeec1d43b3f"} Dec 04 01:04:29.770166 master-0 kubenswrapper[33142]: I1204 01:04:29.763045 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:29.925298 master-0 kubenswrapper[33142]: I1204 01:04:29.925227 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:29.925601 master-0 kubenswrapper[33142]: I1204 01:04:29.925501 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-internal-api-0" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-log" containerID="cri-o://277c85e648a74edd30139d98bebab240f369fd35c40b9a3d8312033a87233cb2" gracePeriod=30 Dec 04 01:04:29.927959 master-0 kubenswrapper[33142]: I1204 01:04:29.925952 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-10f14-default-internal-api-0" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-httpd" containerID="cri-o://f92f468b06abae32967732cdab4b6eff79962702650c607048fb0dee2940e8dc" gracePeriod=30 Dec 04 01:04:30.603713 master-0 kubenswrapper[33142]: I1204 01:04:30.603634 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" event={"ID":"30532606-4a55-430e-83e9-178201d7caaf","Type":"ContainerStarted","Data":"a0a98ca1fc8dd19b24183e149a2162b1d9446ca1ea0c642c66376a89bdaaa03a"} Dec 04 01:04:30.604590 master-0 kubenswrapper[33142]: I1204 01:04:30.604564 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:30.606479 master-0 kubenswrapper[33142]: I1204 01:04:30.606437 33142 generic.go:334] "Generic (PLEG): container finished" podID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerID="aa50042ecba39c07f14c6cf4387963475a006dc1bd7af76149e80e04659e09c9" exitCode=0 Dec 04 01:04:30.606586 master-0 kubenswrapper[33142]: I1204 01:04:30.606524 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerDied","Data":"aa50042ecba39c07f14c6cf4387963475a006dc1bd7af76149e80e04659e09c9"} Dec 04 01:04:30.606652 master-0 kubenswrapper[33142]: I1204 01:04:30.606598 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"8e0392c7-1f34-40d1-8f25-af51952106c7","Type":"ContainerDied","Data":"64c9b3eb48d0436afaa50415ad865b5538c7e453862ae60cbfbc946882abbe4c"} Dec 04 01:04:30.606652 master-0 kubenswrapper[33142]: I1204 01:04:30.606619 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c9b3eb48d0436afaa50415ad865b5538c7e453862ae60cbfbc946882abbe4c" Dec 04 01:04:30.609952 master-0 kubenswrapper[33142]: I1204 01:04:30.609893 33142 generic.go:334] "Generic (PLEG): container finished" podID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerID="277c85e648a74edd30139d98bebab240f369fd35c40b9a3d8312033a87233cb2" exitCode=143 Dec 04 01:04:30.610241 master-0 kubenswrapper[33142]: I1204 01:04:30.609967 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerDied","Data":"277c85e648a74edd30139d98bebab240f369fd35c40b9a3d8312033a87233cb2"} Dec 04 01:04:30.613953 master-0 kubenswrapper[33142]: I1204 01:04:30.613891 33142 generic.go:334] "Generic (PLEG): container finished" podID="1cbaa187-8869-4d39-8ce7-c4fad127b6d5" containerID="41715b3b111a2d3922d75d49e5570f8ec0a790574b9ea17ae7d1503eef5229b5" exitCode=0 Dec 04 01:04:30.614250 master-0 kubenswrapper[33142]: I1204 01:04:30.614225 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerDied","Data":"41715b3b111a2d3922d75d49e5570f8ec0a790574b9ea17ae7d1503eef5229b5"} Dec 04 01:04:30.616317 master-0 kubenswrapper[33142]: I1204 01:04:30.616298 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:30.631211 master-0 kubenswrapper[33142]: I1204 01:04:30.630922 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" podStartSLOduration=4.630902406 podStartE2EDuration="4.630902406s" podCreationTimestamp="2025-12-04 01:04:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:30.628687314 +0000 UTC m=+1043.030689184" watchObservedRunningTime="2025-12-04 01:04:30.630902406 +0000 UTC m=+1043.032904266" Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782181 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782263 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782393 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nqhn\" (UniqueName: \"kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782429 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782504 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782657 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782750 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.786282 master-0 kubenswrapper[33142]: I1204 01:04:30.782813 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run\") pod \"8e0392c7-1f34-40d1-8f25-af51952106c7\" (UID: \"8e0392c7-1f34-40d1-8f25-af51952106c7\") " Dec 04 01:04:30.787397 master-0 kubenswrapper[33142]: I1204 01:04:30.786427 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs" (OuterVolumeSpecName: "logs") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:30.787397 master-0 kubenswrapper[33142]: I1204 01:04:30.786747 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:30.795233 master-0 kubenswrapper[33142]: I1204 01:04:30.788104 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts" (OuterVolumeSpecName: "scripts") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:30.795233 master-0 kubenswrapper[33142]: I1204 01:04:30.791985 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn" (OuterVolumeSpecName: "kube-api-access-7nqhn") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "kube-api-access-7nqhn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:30.824433 master-0 kubenswrapper[33142]: I1204 01:04:30.824345 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:30.872951 master-0 kubenswrapper[33142]: I1204 01:04:30.872860 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:30.886954 master-0 kubenswrapper[33142]: I1204 01:04:30.886882 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.886954 master-0 kubenswrapper[33142]: I1204 01:04:30.886943 33142 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8e0392c7-1f34-40d1-8f25-af51952106c7-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.886954 master-0 kubenswrapper[33142]: I1204 01:04:30.886954 33142 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-public-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.886954 master-0 kubenswrapper[33142]: I1204 01:04:30.886968 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.887302 master-0 kubenswrapper[33142]: I1204 01:04:30.886979 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7nqhn\" (UniqueName: \"kubernetes.io/projected/8e0392c7-1f34-40d1-8f25-af51952106c7-kube-api-access-7nqhn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.887302 master-0 kubenswrapper[33142]: I1204 01:04:30.886991 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:30.889067 master-0 kubenswrapper[33142]: I1204 01:04:30.889006 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data" (OuterVolumeSpecName: "config-data") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:30.989828 master-0 kubenswrapper[33142]: I1204 01:04:30.989490 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0392c7-1f34-40d1-8f25-af51952106c7-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:31.634215 master-0 kubenswrapper[33142]: I1204 01:04:31.634133 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:32.490785 master-0 kubenswrapper[33142]: I1204 01:04:32.490546 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-neutron-agent-6cddc778dc-52tq5" Dec 04 01:04:33.120620 master-0 kubenswrapper[33142]: I1204 01:04:33.120541 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9" (OuterVolumeSpecName: "glance") pod "8e0392c7-1f34-40d1-8f25-af51952106c7" (UID: "8e0392c7-1f34-40d1-8f25-af51952106c7"). InnerVolumeSpecName "pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 01:04:33.174154 master-0 kubenswrapper[33142]: I1204 01:04:33.174092 33142 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") on node \"master-0\" " Dec 04 01:04:33.200086 master-0 kubenswrapper[33142]: I1204 01:04:33.199988 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:33.214773 master-0 kubenswrapper[33142]: I1204 01:04:33.214695 33142 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 01:04:33.215068 master-0 kubenswrapper[33142]: I1204 01:04:33.214871 33142 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102" (UniqueName: "kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9") on node "master-0" Dec 04 01:04:33.219068 master-0 kubenswrapper[33142]: I1204 01:04:33.219014 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:33.243561 master-0 kubenswrapper[33142]: I1204 01:04:33.243456 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:33.244443 master-0 kubenswrapper[33142]: E1204 01:04:33.244086 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-log" Dec 04 01:04:33.244984 master-0 kubenswrapper[33142]: I1204 01:04:33.244672 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-log" Dec 04 01:04:33.244984 master-0 kubenswrapper[33142]: E1204 01:04:33.244755 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-httpd" Dec 04 01:04:33.244984 master-0 kubenswrapper[33142]: I1204 01:04:33.244768 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-httpd" Dec 04 01:04:33.245350 master-0 kubenswrapper[33142]: I1204 01:04:33.245325 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-httpd" Dec 04 01:04:33.245410 master-0 kubenswrapper[33142]: I1204 01:04:33.245389 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" containerName="glance-log" Dec 04 01:04:33.248421 master-0 kubenswrapper[33142]: I1204 01:04:33.248378 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.253625 master-0 kubenswrapper[33142]: I1204 01:04:33.253585 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-external-config-data" Dec 04 01:04:33.253770 master-0 kubenswrapper[33142]: I1204 01:04:33.253585 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Dec 04 01:04:33.276482 master-0 kubenswrapper[33142]: I1204 01:04:33.276431 33142 reconciler_common.go:293] "Volume detached for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:33.277737 master-0 kubenswrapper[33142]: I1204 01:04:33.277687 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:33.300765 master-0 kubenswrapper[33142]: I1204 01:04:33.300695 33142 trace.go:236] Trace[934043550]: "Calculate volume metrics of mysql-db for pod openstack/openstack-cell1-galera-0" (04-Dec-2025 01:04:31.778) (total time: 1522ms): Dec 04 01:04:33.300765 master-0 kubenswrapper[33142]: Trace[934043550]: [1.522632773s] [1.522632773s] END Dec 04 01:04:33.378572 master-0 kubenswrapper[33142]: I1204 01:04:33.378506 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.378874 master-0 kubenswrapper[33142]: I1204 01:04:33.378823 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.379839 master-0 kubenswrapper[33142]: I1204 01:04:33.379807 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.380049 master-0 kubenswrapper[33142]: I1204 01:04:33.380019 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.380340 master-0 kubenswrapper[33142]: I1204 01:04:33.380291 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.380496 master-0 kubenswrapper[33142]: I1204 01:04:33.380444 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.380544 master-0 kubenswrapper[33142]: I1204 01:04:33.380530 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.380768 master-0 kubenswrapper[33142]: I1204 01:04:33.380741 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58pbw\" (UniqueName: \"kubernetes.io/projected/f6396222-918f-456e-8145-3ed9d7eb8698-kube-api-access-58pbw\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483138 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483224 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483323 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483375 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483402 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483473 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58pbw\" (UniqueName: \"kubernetes.io/projected/f6396222-918f-456e-8145-3ed9d7eb8698-kube-api-access-58pbw\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483554 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483609 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.483944 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-logs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.486619 master-0 kubenswrapper[33142]: I1204 01:04:33.484896 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6396222-918f-456e-8145-3ed9d7eb8698-httpd-run\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.488719 master-0 kubenswrapper[33142]: I1204 01:04:33.488124 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:04:33.488719 master-0 kubenswrapper[33142]: I1204 01:04:33.488196 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0d3ec47f3a51dd89bb2d1678494217721404d4aff31f2dde3036a53713dd9006/globalmount\"" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.488983 master-0 kubenswrapper[33142]: I1204 01:04:33.488840 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-config-data\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.491199 master-0 kubenswrapper[33142]: I1204 01:04:33.491159 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-public-tls-certs\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.492509 master-0 kubenswrapper[33142]: I1204 01:04:33.492468 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-scripts\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.494277 master-0 kubenswrapper[33142]: I1204 01:04:33.494232 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6396222-918f-456e-8145-3ed9d7eb8698-combined-ca-bundle\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.513837 master-0 kubenswrapper[33142]: I1204 01:04:33.511352 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58pbw\" (UniqueName: \"kubernetes.io/projected/f6396222-918f-456e-8145-3ed9d7eb8698-kube-api-access-58pbw\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:33.668776 master-0 kubenswrapper[33142]: I1204 01:04:33.668440 33142 generic.go:334] "Generic (PLEG): container finished" podID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerID="f92f468b06abae32967732cdab4b6eff79962702650c607048fb0dee2940e8dc" exitCode=0 Dec 04 01:04:33.668776 master-0 kubenswrapper[33142]: I1204 01:04:33.668544 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerDied","Data":"f92f468b06abae32967732cdab4b6eff79962702650c607048fb0dee2940e8dc"} Dec 04 01:04:33.924800 master-0 kubenswrapper[33142]: I1204 01:04:33.924656 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0392c7-1f34-40d1-8f25-af51952106c7" path="/var/lib/kubelet/pods/8e0392c7-1f34-40d1-8f25-af51952106c7/volumes" Dec 04 01:04:34.382800 master-0 kubenswrapper[33142]: I1204 01:04:34.382724 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b8ec8d6c-f9fa-41b3-919b-3437f2304102\" (UniqueName: \"kubernetes.io/csi/topolvm.io^b5fd6f01-9afb-4d5c-94b7-fee8068241f9\") pod \"glance-10f14-default-external-api-0\" (UID: \"f6396222-918f-456e-8145-3ed9d7eb8698\") " pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:34.488952 master-0 kubenswrapper[33142]: I1204 01:04:34.488754 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:37.480077 master-0 kubenswrapper[33142]: I1204 01:04:37.479994 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:04:37.614577 master-0 kubenswrapper[33142]: I1204 01:04:37.614497 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:04:37.615189 master-0 kubenswrapper[33142]: I1204 01:04:37.615111 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="dnsmasq-dns" containerID="cri-o://0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05" gracePeriod=10 Dec 04 01:04:37.785802 master-0 kubenswrapper[33142]: E1204 01:04:37.785663 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796ef01_4e44_44ef_8509_7e13a0562449.slice/crio-0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796ef01_4e44_44ef_8509_7e13a0562449.slice/crio-conmon-0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:04:37.787088 master-0 kubenswrapper[33142]: E1204 01:04:37.787048 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796ef01_4e44_44ef_8509_7e13a0562449.slice/crio-conmon-0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796ef01_4e44_44ef_8509_7e13a0562449.slice/crio-0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:04:38.741574 master-0 kubenswrapper[33142]: I1204 01:04:38.741369 33142 generic.go:334] "Generic (PLEG): container finished" podID="f796ef01-4e44-44ef-8509-7e13a0562449" containerID="0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05" exitCode=0 Dec 04 01:04:38.741574 master-0 kubenswrapper[33142]: I1204 01:04:38.741494 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" event={"ID":"f796ef01-4e44-44ef-8509-7e13a0562449","Type":"ContainerDied","Data":"0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05"} Dec 04 01:04:39.392753 master-0 kubenswrapper[33142]: I1204 01:04:39.392677 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.502633 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.502807 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.502896 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.502921 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zltnr\" (UniqueName: \"kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.503007 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.503101 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.503125 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.503408 master-0 kubenswrapper[33142]: I1204 01:04:39.503366 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\" (UID: \"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6\") " Dec 04 01:04:39.506919 master-0 kubenswrapper[33142]: I1204 01:04:39.505565 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs" (OuterVolumeSpecName: "logs") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:39.512465 master-0 kubenswrapper[33142]: I1204 01:04:39.512402 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:39.514860 master-0 kubenswrapper[33142]: I1204 01:04:39.514774 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr" (OuterVolumeSpecName: "kube-api-access-zltnr") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "kube-api-access-zltnr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:39.514860 master-0 kubenswrapper[33142]: I1204 01:04:39.514951 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts" (OuterVolumeSpecName: "scripts") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:39.579520 master-0 kubenswrapper[33142]: I1204 01:04:39.579472 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228" (OuterVolumeSpecName: "glance") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 01:04:39.588570 master-0 kubenswrapper[33142]: I1204 01:04:39.588504 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.621760 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.622064 33142 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") on node \"master-0\" " Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.622330 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.622352 33142 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.622367 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zltnr\" (UniqueName: \"kubernetes.io/projected/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-kube-api-access-zltnr\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.629184 master-0 kubenswrapper[33142]: I1204 01:04:39.622381 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.658209 master-0 kubenswrapper[33142]: I1204 01:04:39.658147 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-external-api-0"] Dec 04 01:04:39.664397 master-0 kubenswrapper[33142]: I1204 01:04:39.664356 33142 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 01:04:39.664536 master-0 kubenswrapper[33142]: I1204 01:04:39.664513 33142 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c" (UniqueName: "kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228") on node "master-0" Dec 04 01:04:39.699399 master-0 kubenswrapper[33142]: I1204 01:04:39.699309 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:04:39.707251 master-0 kubenswrapper[33142]: I1204 01:04:39.707194 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data" (OuterVolumeSpecName: "config-data") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:39.734120 master-0 kubenswrapper[33142]: I1204 01:04:39.729546 33142 reconciler_common.go:293] "Volume detached for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.734120 master-0 kubenswrapper[33142]: I1204 01:04:39.729610 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.734120 master-0 kubenswrapper[33142]: I1204 01:04:39.730544 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" (UID: "7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:39.781197 master-0 kubenswrapper[33142]: I1204 01:04:39.781139 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6","Type":"ContainerDied","Data":"98a4e36bbddae8bd7e301fe4e29bba5b107c6769fef8dcfce2f324fd311ea48b"} Dec 04 01:04:39.781197 master-0 kubenswrapper[33142]: I1204 01:04:39.781176 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:39.783383 master-0 kubenswrapper[33142]: I1204 01:04:39.781210 33142 scope.go:117] "RemoveContainer" containerID="f92f468b06abae32967732cdab4b6eff79962702650c607048fb0dee2940e8dc" Dec 04 01:04:39.789731 master-0 kubenswrapper[33142]: I1204 01:04:39.788310 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"f6396222-918f-456e-8145-3ed9d7eb8698","Type":"ContainerStarted","Data":"77dd76106c4597378261a897eb1fa4a7f4cb9df8f4ed2ee8e0a2705707fdc6d4"} Dec 04 01:04:39.792172 master-0 kubenswrapper[33142]: I1204 01:04:39.791833 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" event={"ID":"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583","Type":"ContainerStarted","Data":"859be3ec608c0e1fecef6a7e45f036dad82e2e63d29426a8db5b4f694695a73c"} Dec 04 01:04:39.799108 master-0 kubenswrapper[33142]: I1204 01:04:39.798990 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" event={"ID":"f796ef01-4e44-44ef-8509-7e13a0562449","Type":"ContainerDied","Data":"1a3ea49fe7e39385dee40163c6e6b5d2cc08999e6b3d81f09310347633f90db5"} Dec 04 01:04:39.799108 master-0 kubenswrapper[33142]: I1204 01:04:39.799040 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c48b76f-hnvxg" Dec 04 01:04:39.828027 master-0 kubenswrapper[33142]: I1204 01:04:39.827953 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" podStartSLOduration=1.955424107 podStartE2EDuration="14.827586693s" podCreationTimestamp="2025-12-04 01:04:25 +0000 UTC" firstStartedPulling="2025-12-04 01:04:26.242038821 +0000 UTC m=+1038.644040671" lastFinishedPulling="2025-12-04 01:04:39.114201407 +0000 UTC m=+1051.516203257" observedRunningTime="2025-12-04 01:04:39.810529543 +0000 UTC m=+1052.212531413" watchObservedRunningTime="2025-12-04 01:04:39.827586693 +0000 UTC m=+1052.229588543" Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.830641 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.830714 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.830909 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdhgz\" (UniqueName: \"kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.831025 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.831077 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.831149 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb\") pod \"f796ef01-4e44-44ef-8509-7e13a0562449\" (UID: \"f796ef01-4e44-44ef-8509-7e13a0562449\") " Dec 04 01:04:39.832950 master-0 kubenswrapper[33142]: I1204 01:04:39.832619 33142 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.838705 master-0 kubenswrapper[33142]: I1204 01:04:39.838536 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz" (OuterVolumeSpecName: "kube-api-access-zdhgz") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "kube-api-access-zdhgz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:39.868638 master-0 kubenswrapper[33142]: I1204 01:04:39.868298 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:39.893289 master-0 kubenswrapper[33142]: I1204 01:04:39.892087 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:39.903767 master-0 kubenswrapper[33142]: I1204 01:04:39.903127 33142 scope.go:117] "RemoveContainer" containerID="277c85e648a74edd30139d98bebab240f369fd35c40b9a3d8312033a87233cb2" Dec 04 01:04:39.935885 master-0 kubenswrapper[33142]: I1204 01:04:39.935823 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zdhgz\" (UniqueName: \"kubernetes.io/projected/f796ef01-4e44-44ef-8509-7e13a0562449-kube-api-access-zdhgz\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:39.939578 master-0 kubenswrapper[33142]: I1204 01:04:39.939533 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:39.942046 master-0 kubenswrapper[33142]: I1204 01:04:39.941814 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" path="/var/lib/kubelet/pods/7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6/volumes" Dec 04 01:04:40.038209 master-0 kubenswrapper[33142]: I1204 01:04:40.038056 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:40.038546 master-0 kubenswrapper[33142]: I1204 01:04:40.038334 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:40.039108 master-0 kubenswrapper[33142]: E1204 01:04:40.039078 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="dnsmasq-dns" Dec 04 01:04:40.039108 master-0 kubenswrapper[33142]: I1204 01:04:40.039109 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="dnsmasq-dns" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: E1204 01:04:40.039155 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="init" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: I1204 01:04:40.039163 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="init" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: E1204 01:04:40.039201 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-httpd" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: I1204 01:04:40.039208 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-httpd" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: E1204 01:04:40.039242 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-log" Dec 04 01:04:40.039304 master-0 kubenswrapper[33142]: I1204 01:04:40.039249 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-log" Dec 04 01:04:40.039665 master-0 kubenswrapper[33142]: I1204 01:04:40.039546 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-httpd" Dec 04 01:04:40.039665 master-0 kubenswrapper[33142]: I1204 01:04:40.039582 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" containerName="dnsmasq-dns" Dec 04 01:04:40.039665 master-0 kubenswrapper[33142]: I1204 01:04:40.039621 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b1908c4-2b62-4ca1-8c3d-04d4d3385fa6" containerName="glance-log" Dec 04 01:04:40.041385 master-0 kubenswrapper[33142]: I1204 01:04:40.041271 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:40.041496 master-0 kubenswrapper[33142]: I1204 01:04:40.041412 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.045094 master-0 kubenswrapper[33142]: I1204 01:04:40.045040 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:40.045663 master-0 kubenswrapper[33142]: I1204 01:04:40.045608 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-10f14-default-internal-config-data" Dec 04 01:04:40.045846 master-0 kubenswrapper[33142]: I1204 01:04:40.045801 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Dec 04 01:04:40.045962 master-0 kubenswrapper[33142]: I1204 01:04:40.045832 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:40.046126 master-0 kubenswrapper[33142]: I1204 01:04:40.046081 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config" (OuterVolumeSpecName: "config") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:40.049444 master-0 kubenswrapper[33142]: I1204 01:04:40.049372 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "f796ef01-4e44-44ef-8509-7e13a0562449" (UID: "f796ef01-4e44-44ef-8509-7e13a0562449"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:04:40.061050 master-0 kubenswrapper[33142]: I1204 01:04:40.059630 33142 scope.go:117] "RemoveContainer" containerID="0771d227c7d3fc13cb1f25557c00c1f3b6ced5673c0303493f3d5aeeb97b0e05" Dec 04 01:04:40.140277 master-0 kubenswrapper[33142]: I1204 01:04:40.140225 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:40.140277 master-0 kubenswrapper[33142]: I1204 01:04:40.140268 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:40.140277 master-0 kubenswrapper[33142]: I1204 01:04:40.140281 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:40.140277 master-0 kubenswrapper[33142]: I1204 01:04:40.140290 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f796ef01-4e44-44ef-8509-7e13a0562449-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:40.204167 master-0 kubenswrapper[33142]: I1204 01:04:40.204119 33142 scope.go:117] "RemoveContainer" containerID="7a4a6710873a5c83130f8ed2518ad6f719263f621dea402e6f986bca6be3b9f7" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242210 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242271 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242377 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242407 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242437 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242461 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcjzt\" (UniqueName: \"kubernetes.io/projected/3b186a9d-ba1f-418b-8560-e9d652da39f9-kube-api-access-pcjzt\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242571 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.245452 master-0 kubenswrapper[33142]: I1204 01:04:40.242604 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344468 master-0 kubenswrapper[33142]: I1204 01:04:40.344419 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344585 master-0 kubenswrapper[33142]: I1204 01:04:40.344470 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344629 master-0 kubenswrapper[33142]: I1204 01:04:40.344611 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344707 master-0 kubenswrapper[33142]: I1204 01:04:40.344681 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344742 master-0 kubenswrapper[33142]: I1204 01:04:40.344712 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pcjzt\" (UniqueName: \"kubernetes.io/projected/3b186a9d-ba1f-418b-8560-e9d652da39f9-kube-api-access-pcjzt\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344807 master-0 kubenswrapper[33142]: I1204 01:04:40.344781 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.344847 master-0 kubenswrapper[33142]: I1204 01:04:40.344819 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.345548 master-0 kubenswrapper[33142]: I1204 01:04:40.345507 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-httpd-run\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.346733 master-0 kubenswrapper[33142]: I1204 01:04:40.346680 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b186a9d-ba1f-418b-8560-e9d652da39f9-logs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.353280 master-0 kubenswrapper[33142]: I1204 01:04:40.353237 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-combined-ca-bundle\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.353391 master-0 kubenswrapper[33142]: I1204 01:04:40.353364 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-scripts\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.354665 master-0 kubenswrapper[33142]: I1204 01:04:40.354629 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-config-data\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.355744 master-0 kubenswrapper[33142]: I1204 01:04:40.355712 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b186a9d-ba1f-418b-8560-e9d652da39f9-internal-tls-certs\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.424621 master-0 kubenswrapper[33142]: I1204 01:04:40.424492 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:04:40.426095 master-0 kubenswrapper[33142]: I1204 01:04:40.425990 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcjzt\" (UniqueName: \"kubernetes.io/projected/3b186a9d-ba1f-418b-8560-e9d652da39f9-kube-api-access-pcjzt\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.447192 master-0 kubenswrapper[33142]: I1204 01:04:40.447126 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.450427 master-0 kubenswrapper[33142]: I1204 01:04:40.450383 33142 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 01:04:40.450489 master-0 kubenswrapper[33142]: I1204 01:04:40.450450 33142 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/f9bf544312b95af1c4795a85459fe1441801d5371397986d7a3e19188458ab2e/globalmount\"" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:40.473871 master-0 kubenswrapper[33142]: I1204 01:04:40.473772 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-559c48b76f-hnvxg"] Dec 04 01:04:40.812978 master-0 kubenswrapper[33142]: I1204 01:04:40.812521 33142 generic.go:334] "Generic (PLEG): container finished" podID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerID="ce157191b23cac3105f20b7392eab2152b1a5c639493f2d608589882c4f37245" exitCode=0 Dec 04 01:04:40.812978 master-0 kubenswrapper[33142]: I1204 01:04:40.812600 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"74645d59-1991-4c1f-bae2-68f5bfb9054d","Type":"ContainerDied","Data":"ce157191b23cac3105f20b7392eab2152b1a5c639493f2d608589882c4f37245"} Dec 04 01:04:40.816848 master-0 kubenswrapper[33142]: I1204 01:04:40.816801 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"2e537b2147a547dcfd387e1bbe8b2eb21b968ddec42d83c90ec8db934305ee17"} Dec 04 01:04:40.822395 master-0 kubenswrapper[33142]: I1204 01:04:40.822333 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"f6396222-918f-456e-8145-3ed9d7eb8698","Type":"ContainerStarted","Data":"e561f37a91991ab0a9f83127648f0cdf265b702dacd8c6d09d8d886e739ab3f7"} Dec 04 01:04:41.332600 master-0 kubenswrapper[33142]: I1204 01:04:41.332539 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b019e51e-7f69-4dce-93e8-fb1afe817a3c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^46615197-8dac-424c-8a4c-307c5cd48228\") pod \"glance-10f14-default-internal-api-0\" (UID: \"3b186a9d-ba1f-418b-8560-e9d652da39f9\") " pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:41.687994 master-0 kubenswrapper[33142]: I1204 01:04:41.687605 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:41.849474 master-0 kubenswrapper[33142]: I1204 01:04:41.848022 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-external-api-0" event={"ID":"f6396222-918f-456e-8145-3ed9d7eb8698","Type":"ContainerStarted","Data":"a3bb85fd92b245347b9b9f63cb540503291fda6b974e7f8cdb74b581cef3b850"} Dec 04 01:04:41.921023 master-0 kubenswrapper[33142]: I1204 01:04:41.920827 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f796ef01-4e44-44ef-8509-7e13a0562449" path="/var/lib/kubelet/pods/f796ef01-4e44-44ef-8509-7e13a0562449/volumes" Dec 04 01:04:41.996373 master-0 kubenswrapper[33142]: I1204 01:04:41.996306 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:42.873333 master-0 kubenswrapper[33142]: I1204 01:04:42.873230 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-10f14-default-external-api-0" podStartSLOduration=9.873188047 podStartE2EDuration="9.873188047s" podCreationTimestamp="2025-12-04 01:04:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:42.871092128 +0000 UTC m=+1055.273093998" watchObservedRunningTime="2025-12-04 01:04:42.873188047 +0000 UTC m=+1055.275189897" Dec 04 01:04:42.880879 master-0 kubenswrapper[33142]: I1204 01:04:42.880809 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:42.881581 master-0 kubenswrapper[33142]: I1204 01:04:42.881532 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"74645d59-1991-4c1f-bae2-68f5bfb9054d","Type":"ContainerDied","Data":"59a9ebd6e91562497816183db252d5a601fed0f5cf0a3876295badeec1d43b3f"} Dec 04 01:04:42.881646 master-0 kubenswrapper[33142]: I1204 01:04:42.881590 33142 scope.go:117] "RemoveContainer" containerID="ce157191b23cac3105f20b7392eab2152b1a5c639493f2d608589882c4f37245" Dec 04 01:04:42.946825 master-0 kubenswrapper[33142]: I1204 01:04:42.946710 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.946845 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.946972 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.947038 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.947120 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.947181 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.947303 master-0 kubenswrapper[33142]: I1204 01:04:42.947222 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfdnt\" (UniqueName: \"kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt\") pod \"74645d59-1991-4c1f-bae2-68f5bfb9054d\" (UID: \"74645d59-1991-4c1f-bae2-68f5bfb9054d\") " Dec 04 01:04:42.952401 master-0 kubenswrapper[33142]: I1204 01:04:42.952156 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts" (OuterVolumeSpecName: "scripts") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:42.956348 master-0 kubenswrapper[33142]: I1204 01:04:42.956287 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config" (OuterVolumeSpecName: "config") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:42.958068 master-0 kubenswrapper[33142]: I1204 01:04:42.957970 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt" (OuterVolumeSpecName: "kube-api-access-nfdnt") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "kube-api-access-nfdnt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:04:42.958772 master-0 kubenswrapper[33142]: I1204 01:04:42.958723 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir" (OuterVolumeSpecName: "var-lib-ironic-inspector-dhcp-hostsdir") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "var-lib-ironic-inspector-dhcp-hostsdir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:42.981761 master-0 kubenswrapper[33142]: I1204 01:04:42.981668 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic" (OuterVolumeSpecName: "var-lib-ironic") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "var-lib-ironic". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:04:43.004552 master-0 kubenswrapper[33142]: I1204 01:04:43.004478 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051326 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051374 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic-inspector-dhcp-hostsdir\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051384 33142 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74645d59-1991-4c1f-bae2-68f5bfb9054d-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051394 33142 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/74645d59-1991-4c1f-bae2-68f5bfb9054d-var-lib-ironic\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051403 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.062953 master-0 kubenswrapper[33142]: I1204 01:04:43.051412 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nfdnt\" (UniqueName: \"kubernetes.io/projected/74645d59-1991-4c1f-bae2-68f5bfb9054d-kube-api-access-nfdnt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.102619 master-0 kubenswrapper[33142]: I1204 01:04:43.097047 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74645d59-1991-4c1f-bae2-68f5bfb9054d" (UID: "74645d59-1991-4c1f-bae2-68f5bfb9054d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:04:43.108674 master-0 kubenswrapper[33142]: I1204 01:04:43.108632 33142 scope.go:117] "RemoveContainer" containerID="725af3aa0bf6b017b57965224357714b37597b38fe37302d9508678e0d298488" Dec 04 01:04:43.121875 master-0 kubenswrapper[33142]: I1204 01:04:43.121422 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-10f14-default-internal-api-0"] Dec 04 01:04:43.155267 master-0 kubenswrapper[33142]: I1204 01:04:43.154641 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74645d59-1991-4c1f-bae2-68f5bfb9054d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:04:43.858129 master-0 kubenswrapper[33142]: I1204 01:04:43.858041 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:43.882519 master-0 kubenswrapper[33142]: I1204 01:04:43.881998 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:43.950559 master-0 kubenswrapper[33142]: I1204 01:04:43.949721 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" path="/var/lib/kubelet/pods/74645d59-1991-4c1f-bae2-68f5bfb9054d/volumes" Dec 04 01:04:43.950957 master-0 kubenswrapper[33142]: I1204 01:04:43.950714 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:43.951427 master-0 kubenswrapper[33142]: E1204 01:04:43.951128 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerName="ironic-python-agent-init" Dec 04 01:04:43.951427 master-0 kubenswrapper[33142]: I1204 01:04:43.951149 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerName="ironic-python-agent-init" Dec 04 01:04:43.951427 master-0 kubenswrapper[33142]: E1204 01:04:43.951176 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerName="inspector-pxe-init" Dec 04 01:04:43.951427 master-0 kubenswrapper[33142]: I1204 01:04:43.951188 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerName="inspector-pxe-init" Dec 04 01:04:43.951721 master-0 kubenswrapper[33142]: I1204 01:04:43.951509 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="74645d59-1991-4c1f-bae2-68f5bfb9054d" containerName="inspector-pxe-init" Dec 04 01:04:43.956322 master-0 kubenswrapper[33142]: I1204 01:04:43.955646 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:43.956322 master-0 kubenswrapper[33142]: I1204 01:04:43.955811 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:43.960541 master-0 kubenswrapper[33142]: I1204 01:04:43.958540 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 01:04:43.960541 master-0 kubenswrapper[33142]: I1204 01:04:43.958718 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 01:04:43.960541 master-0 kubenswrapper[33142]: I1204 01:04:43.958894 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-inspector-public-svc" Dec 04 01:04:43.960541 master-0 kubenswrapper[33142]: I1204 01:04:43.959068 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-inspector-internal-svc" Dec 04 01:04:43.960541 master-0 kubenswrapper[33142]: I1204 01:04:43.959251 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"3b186a9d-ba1f-418b-8560-e9d652da39f9","Type":"ContainerStarted","Data":"a6ec8ece37877cbbefdca4c3fac584958f02dcfe6289bf5f8f6b7dc54ea98c1c"} Dec 04 01:04:43.961132 master-0 kubenswrapper[33142]: I1204 01:04:43.961059 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-inspector-transport" Dec 04 01:04:44.116118 master-0 kubenswrapper[33142]: I1204 01:04:44.116027 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116550 master-0 kubenswrapper[33142]: I1204 01:04:44.116178 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgs5n\" (UniqueName: \"kubernetes.io/projected/efb29bfd-67fd-4323-813d-f4d7d68afba3-kube-api-access-pgs5n\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116550 master-0 kubenswrapper[33142]: I1204 01:04:44.116359 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-config\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116550 master-0 kubenswrapper[33142]: I1204 01:04:44.116427 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116813 master-0 kubenswrapper[33142]: I1204 01:04:44.116658 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116813 master-0 kubenswrapper[33142]: I1204 01:04:44.116737 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-scripts\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.116813 master-0 kubenswrapper[33142]: I1204 01:04:44.116804 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb29bfd-67fd-4323-813d-f4d7d68afba3-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.117041 master-0 kubenswrapper[33142]: I1204 01:04:44.116890 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.117041 master-0 kubenswrapper[33142]: I1204 01:04:44.116974 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.220807 master-0 kubenswrapper[33142]: I1204 01:04:44.220736 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-config\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.220807 master-0 kubenswrapper[33142]: I1204 01:04:44.220796 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.220902 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.220971 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-scripts\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.220997 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb29bfd-67fd-4323-813d-f4d7d68afba3-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.221029 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.221054 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221169 master-0 kubenswrapper[33142]: I1204 01:04:44.221159 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221440 master-0 kubenswrapper[33142]: I1204 01:04:44.221188 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pgs5n\" (UniqueName: \"kubernetes.io/projected/efb29bfd-67fd-4323-813d-f4d7d68afba3-kube-api-access-pgs5n\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.221916 master-0 kubenswrapper[33142]: I1204 01:04:44.221571 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.222289 master-0 kubenswrapper[33142]: I1204 01:04:44.222256 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/efb29bfd-67fd-4323-813d-f4d7d68afba3-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.226141 master-0 kubenswrapper[33142]: I1204 01:04:44.225968 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.226437 master-0 kubenswrapper[33142]: I1204 01:04:44.226367 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.232192 master-0 kubenswrapper[33142]: I1204 01:04:44.227105 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb29bfd-67fd-4323-813d-f4d7d68afba3-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.232192 master-0 kubenswrapper[33142]: I1204 01:04:44.227363 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.233563 master-0 kubenswrapper[33142]: I1204 01:04:44.233479 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-config\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.241951 master-0 kubenswrapper[33142]: I1204 01:04:44.235845 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efb29bfd-67fd-4323-813d-f4d7d68afba3-scripts\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.251646 master-0 kubenswrapper[33142]: I1204 01:04:44.251553 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgs5n\" (UniqueName: \"kubernetes.io/projected/efb29bfd-67fd-4323-813d-f4d7d68afba3-kube-api-access-pgs5n\") pod \"ironic-inspector-0\" (UID: \"efb29bfd-67fd-4323-813d-f4d7d68afba3\") " pod="openstack/ironic-inspector-0" Dec 04 01:04:44.290893 master-0 kubenswrapper[33142]: I1204 01:04:44.290831 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 01:04:44.490314 master-0 kubenswrapper[33142]: I1204 01:04:44.490271 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:44.490496 master-0 kubenswrapper[33142]: I1204 01:04:44.490483 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:44.554034 master-0 kubenswrapper[33142]: I1204 01:04:44.553393 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:44.561464 master-0 kubenswrapper[33142]: I1204 01:04:44.561088 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:44.976580 master-0 kubenswrapper[33142]: I1204 01:04:44.976509 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"3b186a9d-ba1f-418b-8560-e9d652da39f9","Type":"ContainerStarted","Data":"9f7de01d1a5de4c9ac5a8c536cabaa066bed404f81c87c911bbe4f5019e689e7"} Dec 04 01:04:44.977270 master-0 kubenswrapper[33142]: I1204 01:04:44.976879 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:44.977270 master-0 kubenswrapper[33142]: I1204 01:04:44.976947 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:46.002685 master-0 kubenswrapper[33142]: I1204 01:04:46.002613 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-10f14-default-internal-api-0" event={"ID":"3b186a9d-ba1f-418b-8560-e9d652da39f9","Type":"ContainerStarted","Data":"b7cdaa33e4cf9823d9d1f16d0f3a50a36c22b029623da273a923e2a162b3fc4b"} Dec 04 01:04:46.803100 master-0 kubenswrapper[33142]: I1204 01:04:46.802895 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-10f14-default-internal-api-0" podStartSLOduration=7.802862483 podStartE2EDuration="7.802862483s" podCreationTimestamp="2025-12-04 01:04:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:46.748476982 +0000 UTC m=+1059.150478882" watchObservedRunningTime="2025-12-04 01:04:46.802862483 +0000 UTC m=+1059.204864333" Dec 04 01:04:46.919546 master-0 kubenswrapper[33142]: I1204 01:04:46.918057 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 01:04:46.980033 master-0 kubenswrapper[33142]: E1204 01:04:46.974800 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefb29bfd_67fd_4323_813d_f4d7d68afba3.slice/crio-44b15ce9b8a695df475c38750ceabeeb30a70039b9dacc55617e7773a298c3f5\": RecentStats: unable to find data in memory cache]" Dec 04 01:04:47.057681 master-0 kubenswrapper[33142]: I1204 01:04:47.057203 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"44b15ce9b8a695df475c38750ceabeeb30a70039b9dacc55617e7773a298c3f5"} Dec 04 01:04:48.078422 master-0 kubenswrapper[33142]: I1204 01:04:48.078332 33142 generic.go:334] "Generic (PLEG): container finished" podID="efb29bfd-67fd-4323-813d-f4d7d68afba3" containerID="d1a64914d8a4f67640d03559d256a6133a30d523bf0244c912ea981e1f4153bc" exitCode=0 Dec 04 01:04:48.078422 master-0 kubenswrapper[33142]: I1204 01:04:48.078378 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerDied","Data":"d1a64914d8a4f67640d03559d256a6133a30d523bf0244c912ea981e1f4153bc"} Dec 04 01:04:48.467114 master-0 kubenswrapper[33142]: I1204 01:04:48.466379 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:48.510954 master-0 kubenswrapper[33142]: I1204 01:04:48.504477 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-external-api-0" Dec 04 01:04:49.093288 master-0 kubenswrapper[33142]: I1204 01:04:49.093212 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"4333021a5117833761e4824c517e95a826f21b44a563149be0abebdf65bffd4d"} Dec 04 01:04:50.116399 master-0 kubenswrapper[33142]: I1204 01:04:50.116317 33142 generic.go:334] "Generic (PLEG): container finished" podID="efb29bfd-67fd-4323-813d-f4d7d68afba3" containerID="4333021a5117833761e4824c517e95a826f21b44a563149be0abebdf65bffd4d" exitCode=0 Dec 04 01:04:50.117210 master-0 kubenswrapper[33142]: I1204 01:04:50.116440 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerDied","Data":"4333021a5117833761e4824c517e95a826f21b44a563149be0abebdf65bffd4d"} Dec 04 01:04:51.143274 master-0 kubenswrapper[33142]: I1204 01:04:51.143192 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"31012d68364eb6b31da94dac2fdb66ffb597023f24117ac98a9a3290613e88d4"} Dec 04 01:04:51.688515 master-0 kubenswrapper[33142]: I1204 01:04:51.688410 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:51.688830 master-0 kubenswrapper[33142]: I1204 01:04:51.688540 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:51.751282 master-0 kubenswrapper[33142]: I1204 01:04:51.750045 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:51.770739 master-0 kubenswrapper[33142]: I1204 01:04:51.770662 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:52.159874 master-0 kubenswrapper[33142]: I1204 01:04:52.159791 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"d05e2477482815bb3e04e9ccbc8ff1468da852656958ad7f511152e9b5d89e32"} Dec 04 01:04:52.160722 master-0 kubenswrapper[33142]: I1204 01:04:52.160426 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:52.160722 master-0 kubenswrapper[33142]: I1204 01:04:52.160455 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:53.179101 master-0 kubenswrapper[33142]: I1204 01:04:53.178894 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"19e8d2ce2fc49e016b669cc6cf912e0546956d84dffd17300078c7a0aca6d797"} Dec 04 01:04:54.196446 master-0 kubenswrapper[33142]: I1204 01:04:54.196255 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"8db27dc6dd43d1a76945db20534d0b8f8414075c588da6bae0dedae579b6d0a7"} Dec 04 01:04:54.388393 master-0 kubenswrapper[33142]: I1204 01:04:54.388321 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:54.388643 master-0 kubenswrapper[33142]: I1204 01:04:54.388464 33142 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 01:04:54.389569 master-0 kubenswrapper[33142]: I1204 01:04:54.389527 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-10f14-default-internal-api-0" Dec 04 01:04:55.215263 master-0 kubenswrapper[33142]: I1204 01:04:55.215177 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"efb29bfd-67fd-4323-813d-f4d7d68afba3","Type":"ContainerStarted","Data":"e17c79417436b6eb16c73e5407d46ae50a64b5b077198e632bf844199b3b3e48"} Dec 04 01:04:55.215263 master-0 kubenswrapper[33142]: I1204 01:04:55.215267 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 01:04:55.216070 master-0 kubenswrapper[33142]: I1204 01:04:55.215310 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 01:04:55.273490 master-0 kubenswrapper[33142]: I1204 01:04:55.273381 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-inspector-0" podStartSLOduration=12.273355504 podStartE2EDuration="12.273355504s" podCreationTimestamp="2025-12-04 01:04:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:04:55.266240734 +0000 UTC m=+1067.668242594" watchObservedRunningTime="2025-12-04 01:04:55.273355504 +0000 UTC m=+1067.675357354" Dec 04 01:04:59.291442 master-0 kubenswrapper[33142]: I1204 01:04:59.291343 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 01:04:59.292134 master-0 kubenswrapper[33142]: I1204 01:04:59.291621 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 01:04:59.295241 master-0 kubenswrapper[33142]: I1204 01:04:59.295199 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 01:04:59.296306 master-0 kubenswrapper[33142]: I1204 01:04:59.296264 33142 generic.go:334] "Generic (PLEG): container finished" podID="9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" containerID="859be3ec608c0e1fecef6a7e45f036dad82e2e63d29426a8db5b4f694695a73c" exitCode=0 Dec 04 01:04:59.296408 master-0 kubenswrapper[33142]: I1204 01:04:59.296314 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" event={"ID":"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583","Type":"ContainerDied","Data":"859be3ec608c0e1fecef6a7e45f036dad82e2e63d29426a8db5b4f694695a73c"} Dec 04 01:04:59.340533 master-0 kubenswrapper[33142]: I1204 01:04:59.340456 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 01:05:00.830918 master-0 kubenswrapper[33142]: I1204 01:05:00.830822 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:05:00.890597 master-0 kubenswrapper[33142]: I1204 01:05:00.890494 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle\") pod \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " Dec 04 01:05:00.890597 master-0 kubenswrapper[33142]: I1204 01:05:00.890599 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb26z\" (UniqueName: \"kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z\") pod \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " Dec 04 01:05:00.891028 master-0 kubenswrapper[33142]: I1204 01:05:00.890669 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts\") pod \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " Dec 04 01:05:00.891028 master-0 kubenswrapper[33142]: I1204 01:05:00.890743 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data\") pod \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\" (UID: \"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583\") " Dec 04 01:05:00.896032 master-0 kubenswrapper[33142]: I1204 01:05:00.895882 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z" (OuterVolumeSpecName: "kube-api-access-mb26z") pod "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" (UID: "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583"). InnerVolumeSpecName "kube-api-access-mb26z". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:00.900346 master-0 kubenswrapper[33142]: I1204 01:05:00.899251 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts" (OuterVolumeSpecName: "scripts") pod "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" (UID: "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:00.924842 master-0 kubenswrapper[33142]: I1204 01:05:00.924429 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data" (OuterVolumeSpecName: "config-data") pod "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" (UID: "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:00.928994 master-0 kubenswrapper[33142]: I1204 01:05:00.928833 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" (UID: "9c9e20f8-5e76-46ee-bd45-da2d6f2b6583"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:00.995787 master-0 kubenswrapper[33142]: I1204 01:05:00.995706 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:00.995787 master-0 kubenswrapper[33142]: I1204 01:05:00.995767 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mb26z\" (UniqueName: \"kubernetes.io/projected/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-kube-api-access-mb26z\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:00.996062 master-0 kubenswrapper[33142]: I1204 01:05:00.995800 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:00.996062 master-0 kubenswrapper[33142]: I1204 01:05:00.995814 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:01.331205 master-0 kubenswrapper[33142]: I1204 01:05:01.331009 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" event={"ID":"9c9e20f8-5e76-46ee-bd45-da2d6f2b6583","Type":"ContainerDied","Data":"0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6"} Dec 04 01:05:01.331205 master-0 kubenswrapper[33142]: I1204 01:05:01.331096 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a702959b5528e5398459d4e38a997bd473525a8e41c4ccae7c4019520118ac6" Dec 04 01:05:01.332012 master-0 kubenswrapper[33142]: I1204 01:05:01.331050 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-nmfnt" Dec 04 01:05:01.652262 master-0 kubenswrapper[33142]: I1204 01:05:01.652179 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 01:05:01.652968 master-0 kubenswrapper[33142]: E1204 01:05:01.652918 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" containerName="nova-cell0-conductor-db-sync" Dec 04 01:05:01.653074 master-0 kubenswrapper[33142]: I1204 01:05:01.652965 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" containerName="nova-cell0-conductor-db-sync" Dec 04 01:05:01.653401 master-0 kubenswrapper[33142]: I1204 01:05:01.653364 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" containerName="nova-cell0-conductor-db-sync" Dec 04 01:05:01.654518 master-0 kubenswrapper[33142]: I1204 01:05:01.654478 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.658162 master-0 kubenswrapper[33142]: I1204 01:05:01.658118 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-config-data" Dec 04 01:05:01.671108 master-0 kubenswrapper[33142]: I1204 01:05:01.671023 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 01:05:01.713474 master-0 kubenswrapper[33142]: I1204 01:05:01.713409 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkj8f\" (UniqueName: \"kubernetes.io/projected/51f64a63-a202-4ac3-a029-1ebe9631ea29-kube-api-access-gkj8f\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.713736 master-0 kubenswrapper[33142]: I1204 01:05:01.713629 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.713736 master-0 kubenswrapper[33142]: I1204 01:05:01.713685 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.815367 master-0 kubenswrapper[33142]: I1204 01:05:01.815282 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gkj8f\" (UniqueName: \"kubernetes.io/projected/51f64a63-a202-4ac3-a029-1ebe9631ea29-kube-api-access-gkj8f\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.815602 master-0 kubenswrapper[33142]: I1204 01:05:01.815565 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.815643 master-0 kubenswrapper[33142]: I1204 01:05:01.815623 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.825054 master-0 kubenswrapper[33142]: I1204 01:05:01.824834 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.826436 master-0 kubenswrapper[33142]: I1204 01:05:01.826385 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51f64a63-a202-4ac3-a029-1ebe9631ea29-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.833730 master-0 kubenswrapper[33142]: I1204 01:05:01.833675 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkj8f\" (UniqueName: \"kubernetes.io/projected/51f64a63-a202-4ac3-a029-1ebe9631ea29-kube-api-access-gkj8f\") pod \"nova-cell0-conductor-0\" (UID: \"51f64a63-a202-4ac3-a029-1ebe9631ea29\") " pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:01.982411 master-0 kubenswrapper[33142]: I1204 01:05:01.982272 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:02.654188 master-0 kubenswrapper[33142]: W1204 01:05:02.654016 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51f64a63_a202_4ac3_a029_1ebe9631ea29.slice/crio-7a28c719f06acd276672d038d43db4623edfb230ee3e328ce6adcd8ec75ae60e WatchSource:0}: Error finding container 7a28c719f06acd276672d038d43db4623edfb230ee3e328ce6adcd8ec75ae60e: Status 404 returned error can't find the container with id 7a28c719f06acd276672d038d43db4623edfb230ee3e328ce6adcd8ec75ae60e Dec 04 01:05:02.655710 master-0 kubenswrapper[33142]: I1204 01:05:02.655644 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 01:05:03.372551 master-0 kubenswrapper[33142]: I1204 01:05:03.372457 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-0" event={"ID":"51f64a63-a202-4ac3-a029-1ebe9631ea29","Type":"ContainerStarted","Data":"fd400ac76f452661ed670ec78f77042f068653fc3625698571cba72341985b21"} Dec 04 01:05:03.372551 master-0 kubenswrapper[33142]: I1204 01:05:03.372550 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-0" event={"ID":"51f64a63-a202-4ac3-a029-1ebe9631ea29","Type":"ContainerStarted","Data":"7a28c719f06acd276672d038d43db4623edfb230ee3e328ce6adcd8ec75ae60e"} Dec 04 01:05:03.417072 master-0 kubenswrapper[33142]: I1204 01:05:03.416916 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-conductor-0" podStartSLOduration=2.416892007 podStartE2EDuration="2.416892007s" podCreationTimestamp="2025-12-04 01:05:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:03.402375199 +0000 UTC m=+1075.804377049" watchObservedRunningTime="2025-12-04 01:05:03.416892007 +0000 UTC m=+1075.818893867" Dec 04 01:05:04.292347 master-0 kubenswrapper[33142]: I1204 01:05:04.291908 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ironic-inspector-0" Dec 04 01:05:04.292347 master-0 kubenswrapper[33142]: I1204 01:05:04.292017 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ironic-inspector-0" Dec 04 01:05:04.319136 master-0 kubenswrapper[33142]: I1204 01:05:04.319064 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ironic-inspector-0" Dec 04 01:05:04.324096 master-0 kubenswrapper[33142]: I1204 01:05:04.324067 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ironic-inspector-0" Dec 04 01:05:04.393608 master-0 kubenswrapper[33142]: I1204 01:05:04.393204 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:04.407117 master-0 kubenswrapper[33142]: I1204 01:05:04.406272 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 01:05:04.408793 master-0 kubenswrapper[33142]: I1204 01:05:04.408749 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 01:05:12.028833 master-0 kubenswrapper[33142]: I1204 01:05:12.028741 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell0-conductor-0" Dec 04 01:05:13.202961 master-0 kubenswrapper[33142]: I1204 01:05:13.201744 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-cell-mapping-jhv4v"] Dec 04 01:05:13.211957 master-0 kubenswrapper[33142]: I1204 01:05:13.203898 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.211957 master-0 kubenswrapper[33142]: I1204 01:05:13.207104 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-manage-scripts" Dec 04 01:05:13.211957 master-0 kubenswrapper[33142]: I1204 01:05:13.208475 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-manage-config-data" Dec 04 01:05:13.338377 master-0 kubenswrapper[33142]: I1204 01:05:13.337981 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.338377 master-0 kubenswrapper[33142]: I1204 01:05:13.338169 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.338377 master-0 kubenswrapper[33142]: I1204 01:05:13.338295 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.338377 master-0 kubenswrapper[33142]: I1204 01:05:13.338328 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2r47\" (UniqueName: \"kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.354871 master-0 kubenswrapper[33142]: I1204 01:05:13.354783 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-cell-mapping-jhv4v"] Dec 04 01:05:13.451130 master-0 kubenswrapper[33142]: I1204 01:05:13.451055 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.451491 master-0 kubenswrapper[33142]: I1204 01:05:13.451182 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.451491 master-0 kubenswrapper[33142]: I1204 01:05:13.451260 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.451491 master-0 kubenswrapper[33142]: I1204 01:05:13.451285 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l2r47\" (UniqueName: \"kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.457593 master-0 kubenswrapper[33142]: I1204 01:05:13.457427 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.460194 master-0 kubenswrapper[33142]: I1204 01:05:13.460130 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.464880 master-0 kubenswrapper[33142]: I1204 01:05:13.464656 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.476910 master-0 kubenswrapper[33142]: I1204 01:05:13.476348 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2r47\" (UniqueName: \"kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47\") pod \"nova-cell0-cell-mapping-jhv4v\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.508224 master-0 kubenswrapper[33142]: I1204 01:05:13.508152 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 01:05:13.511237 master-0 kubenswrapper[33142]: I1204 01:05:13.511175 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.519848 master-0 kubenswrapper[33142]: I1204 01:05:13.519779 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-compute-ironic-compute-config-data" Dec 04 01:05:13.554301 master-0 kubenswrapper[33142]: I1204 01:05:13.553922 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hg9s\" (UniqueName: \"kubernetes.io/projected/a6953eaf-df6e-43bc-82b2-45550672bda9-kube-api-access-5hg9s\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.558272 master-0 kubenswrapper[33142]: I1204 01:05:13.557648 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.558272 master-0 kubenswrapper[33142]: I1204 01:05:13.557783 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.561403 master-0 kubenswrapper[33142]: I1204 01:05:13.561323 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 01:05:13.611572 master-0 kubenswrapper[33142]: I1204 01:05:13.610297 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:13.652702 master-0 kubenswrapper[33142]: I1204 01:05:13.650534 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:13.660722 master-0 kubenswrapper[33142]: I1204 01:05:13.660296 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hg9s\" (UniqueName: \"kubernetes.io/projected/a6953eaf-df6e-43bc-82b2-45550672bda9-kube-api-access-5hg9s\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.660722 master-0 kubenswrapper[33142]: I1204 01:05:13.660442 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.660722 master-0 kubenswrapper[33142]: I1204 01:05:13.660482 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.713590 master-0 kubenswrapper[33142]: I1204 01:05:13.712352 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.726350 master-0 kubenswrapper[33142]: I1204 01:05:13.726285 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:13.727794 master-0 kubenswrapper[33142]: I1204 01:05:13.727676 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6953eaf-df6e-43bc-82b2-45550672bda9-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.771787 master-0 kubenswrapper[33142]: I1204 01:05:13.766054 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 01:05:13.790386 master-0 kubenswrapper[33142]: I1204 01:05:13.790036 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:13.859778 master-0 kubenswrapper[33142]: I1204 01:05:13.859631 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hg9s\" (UniqueName: \"kubernetes.io/projected/a6953eaf-df6e-43bc-82b2-45550672bda9-kube-api-access-5hg9s\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"a6953eaf-df6e-43bc-82b2-45550672bda9\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.917101 master-0 kubenswrapper[33142]: I1204 01:05:13.916012 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:13.934468 master-0 kubenswrapper[33142]: I1204 01:05:13.930533 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzjt\" (UniqueName: \"kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:13.934468 master-0 kubenswrapper[33142]: I1204 01:05:13.931013 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:13.934468 master-0 kubenswrapper[33142]: I1204 01:05:13.931061 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:13.934468 master-0 kubenswrapper[33142]: I1204 01:05:13.932991 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:13.989463 master-0 kubenswrapper[33142]: I1204 01:05:13.983260 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:13.989463 master-0 kubenswrapper[33142]: I1204 01:05:13.987651 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:13.989463 master-0 kubenswrapper[33142]: I1204 01:05:13.987797 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:14.086463 master-0 kubenswrapper[33142]: I1204 01:05:13.994551 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 01:05:14.098223 master-0 kubenswrapper[33142]: I1204 01:05:14.090272 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.098223 master-0 kubenswrapper[33142]: I1204 01:05:14.090526 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzjt\" (UniqueName: \"kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.098223 master-0 kubenswrapper[33142]: I1204 01:05:14.090738 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.098223 master-0 kubenswrapper[33142]: I1204 01:05:14.090763 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.098223 master-0 kubenswrapper[33142]: I1204 01:05:14.091295 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.116850 master-0 kubenswrapper[33142]: I1204 01:05:14.116282 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.148686 master-0 kubenswrapper[33142]: I1204 01:05:14.143019 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:14.181687 master-0 kubenswrapper[33142]: I1204 01:05:14.163182 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.181687 master-0 kubenswrapper[33142]: I1204 01:05:14.165820 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.181687 master-0 kubenswrapper[33142]: I1204 01:05:14.170050 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-novncproxy-config-data" Dec 04 01:05:14.181687 master-0 kubenswrapper[33142]: I1204 01:05:14.176861 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzjt\" (UniqueName: \"kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt\") pod \"nova-api-0\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " pod="openstack/nova-api-0" Dec 04 01:05:14.223061 master-0 kubenswrapper[33142]: I1204 01:05:14.222193 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.223061 master-0 kubenswrapper[33142]: I1204 01:05:14.222290 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.223061 master-0 kubenswrapper[33142]: I1204 01:05:14.222505 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.223061 master-0 kubenswrapper[33142]: I1204 01:05:14.222641 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fsn8\" (UniqueName: \"kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.259956 master-0 kubenswrapper[33142]: I1204 01:05:14.259717 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:14.281965 master-0 kubenswrapper[33142]: I1204 01:05:14.261236 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:14.323398 master-0 kubenswrapper[33142]: I1204 01:05:14.323325 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:05:14.326498 master-0 kubenswrapper[33142]: I1204 01:05:14.326384 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.338165 master-0 kubenswrapper[33142]: I1204 01:05:14.338071 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5fsn8\" (UniqueName: \"kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338290 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338328 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338353 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338377 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338435 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.338495 master-0 kubenswrapper[33142]: I1204 01:05:14.338458 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzmkz\" (UniqueName: \"kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.343218 master-0 kubenswrapper[33142]: I1204 01:05:14.341191 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.343218 master-0 kubenswrapper[33142]: I1204 01:05:14.341261 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:05:14.349973 master-0 kubenswrapper[33142]: I1204 01:05:14.346200 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.353308 master-0 kubenswrapper[33142]: I1204 01:05:14.351645 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.379964 master-0 kubenswrapper[33142]: I1204 01:05:14.366006 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fsn8\" (UniqueName: \"kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8\") pod \"nova-metadata-0\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " pod="openstack/nova-metadata-0" Dec 04 01:05:14.399612 master-0 kubenswrapper[33142]: I1204 01:05:14.394248 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:14.399612 master-0 kubenswrapper[33142]: I1204 01:05:14.396302 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:14.410863 master-0 kubenswrapper[33142]: I1204 01:05:14.403869 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 01:05:14.410863 master-0 kubenswrapper[33142]: I1204 01:05:14.404098 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsglj\" (UniqueName: \"kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447590 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffff4\" (UniqueName: \"kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447627 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xzmkz\" (UniqueName: \"kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447649 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447687 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447706 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447739 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447782 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447866 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447894 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447916 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.452140 master-0 kubenswrapper[33142]: I1204 01:05:14.447960 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.452789 master-0 kubenswrapper[33142]: I1204 01:05:14.452325 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.455874 master-0 kubenswrapper[33142]: I1204 01:05:14.455827 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.474915 master-0 kubenswrapper[33142]: I1204 01:05:14.471828 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzmkz\" (UniqueName: \"kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz\") pod \"nova-cell1-novncproxy-0\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.552210 master-0 kubenswrapper[33142]: I1204 01:05:14.552155 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tsglj\" (UniqueName: \"kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.552210 master-0 kubenswrapper[33142]: I1204 01:05:14.552220 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ffff4\" (UniqueName: \"kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.552523 master-0 kubenswrapper[33142]: I1204 01:05:14.552256 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.552523 master-0 kubenswrapper[33142]: I1204 01:05:14.552311 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.552523 master-0 kubenswrapper[33142]: I1204 01:05:14.552333 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.552523 master-0 kubenswrapper[33142]: I1204 01:05:14.552369 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.552523 master-0 kubenswrapper[33142]: I1204 01:05:14.552433 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.552710 master-0 kubenswrapper[33142]: I1204 01:05:14.552562 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.552710 master-0 kubenswrapper[33142]: I1204 01:05:14.552615 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.554428 master-0 kubenswrapper[33142]: I1204 01:05:14.554401 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.559201 master-0 kubenswrapper[33142]: I1204 01:05:14.559154 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.559847 master-0 kubenswrapper[33142]: I1204 01:05:14.559816 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.561533 master-0 kubenswrapper[33142]: I1204 01:05:14.560630 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.561533 master-0 kubenswrapper[33142]: I1204 01:05:14.561260 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:14.561533 master-0 kubenswrapper[33142]: I1204 01:05:14.561273 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.579387 master-0 kubenswrapper[33142]: I1204 01:05:14.563809 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.579387 master-0 kubenswrapper[33142]: I1204 01:05:14.564148 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.581416 master-0 kubenswrapper[33142]: I1204 01:05:14.581206 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffff4\" (UniqueName: \"kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4\") pod \"dnsmasq-dns-799464c6f-vmsnj\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.589491 master-0 kubenswrapper[33142]: I1204 01:05:14.589186 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-cell-mapping-jhv4v"] Dec 04 01:05:14.590287 master-0 kubenswrapper[33142]: I1204 01:05:14.589804 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsglj\" (UniqueName: \"kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj\") pod \"nova-scheduler-0\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:14.632902 master-0 kubenswrapper[33142]: I1204 01:05:14.632762 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:14.674346 master-0 kubenswrapper[33142]: I1204 01:05:14.674253 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:14.739349 master-0 kubenswrapper[33142]: I1204 01:05:14.739178 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:14.747185 master-0 kubenswrapper[33142]: I1204 01:05:14.747117 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 01:05:14.818454 master-0 kubenswrapper[33142]: W1204 01:05:14.807980 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6953eaf_df6e_43bc_82b2_45550672bda9.slice/crio-8efa80ce9aa7532c0f96a157a009ccab741968f019205db064e84b1a290bb05a WatchSource:0}: Error finding container 8efa80ce9aa7532c0f96a157a009ccab741968f019205db064e84b1a290bb05a: Status 404 returned error can't find the container with id 8efa80ce9aa7532c0f96a157a009ccab741968f019205db064e84b1a290bb05a Dec 04 01:05:15.135610 master-0 kubenswrapper[33142]: I1204 01:05:15.135537 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:15.166748 master-0 kubenswrapper[33142]: I1204 01:05:15.160815 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-conductor-db-sync-t89rl"] Dec 04 01:05:15.166748 master-0 kubenswrapper[33142]: I1204 01:05:15.162821 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.166748 master-0 kubenswrapper[33142]: I1204 01:05:15.166123 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-scripts" Dec 04 01:05:15.172942 master-0 kubenswrapper[33142]: I1204 01:05:15.169093 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-config-data" Dec 04 01:05:15.186344 master-0 kubenswrapper[33142]: I1204 01:05:15.182370 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-t89rl"] Dec 04 01:05:15.242810 master-0 kubenswrapper[33142]: I1204 01:05:15.238628 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnlf\" (UniqueName: \"kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.242810 master-0 kubenswrapper[33142]: I1204 01:05:15.238808 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.242810 master-0 kubenswrapper[33142]: I1204 01:05:15.238961 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.242810 master-0 kubenswrapper[33142]: I1204 01:05:15.238993 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.348762 master-0 kubenswrapper[33142]: I1204 01:05:15.347841 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnlf\" (UniqueName: \"kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.352763 master-0 kubenswrapper[33142]: I1204 01:05:15.349204 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.352763 master-0 kubenswrapper[33142]: I1204 01:05:15.349311 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.352763 master-0 kubenswrapper[33142]: I1204 01:05:15.349343 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.357553 master-0 kubenswrapper[33142]: I1204 01:05:15.357455 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.357553 master-0 kubenswrapper[33142]: I1204 01:05:15.357478 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.368592 master-0 kubenswrapper[33142]: I1204 01:05:15.366139 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.385310 master-0 kubenswrapper[33142]: I1204 01:05:15.374595 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnlf\" (UniqueName: \"kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf\") pod \"nova-cell1-conductor-db-sync-t89rl\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.411514 master-0 kubenswrapper[33142]: I1204 01:05:15.411428 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:15.505239 master-0 kubenswrapper[33142]: I1204 01:05:15.505119 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:15.621716 master-0 kubenswrapper[33142]: I1204 01:05:15.621582 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:15.638429 master-0 kubenswrapper[33142]: I1204 01:05:15.637198 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerStarted","Data":"2d3dce0a2e3dd15f05a311668d86afdebd670f9f012695115790311495867f3f"} Dec 04 01:05:15.647765 master-0 kubenswrapper[33142]: I1204 01:05:15.647677 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-compute-ironic-compute-0" event={"ID":"a6953eaf-df6e-43bc-82b2-45550672bda9","Type":"ContainerStarted","Data":"8efa80ce9aa7532c0f96a157a009ccab741968f019205db064e84b1a290bb05a"} Dec 04 01:05:15.651501 master-0 kubenswrapper[33142]: I1204 01:05:15.651453 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"ebca5772-11a8-43be-83e8-8a3825f1dc5d","Type":"ContainerStarted","Data":"feadebcbf1d447154dd1ee76e62067d3e51b1f356cbd279ec70d7f98cb59e494"} Dec 04 01:05:15.656251 master-0 kubenswrapper[33142]: I1204 01:05:15.653252 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerStarted","Data":"b6f0f0b3cbd5418057ab16947561ac904c95cb0c3d3b279e3314f74416f47bcc"} Dec 04 01:05:15.672681 master-0 kubenswrapper[33142]: I1204 01:05:15.672591 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-jhv4v" event={"ID":"1ebe789b-7001-4f0a-b6fd-5a28815a7a10","Type":"ContainerStarted","Data":"3c26ade0dff1243c05bdd28fd9038b9268c9e4ddc51e2567b076ffd64b8e24f8"} Dec 04 01:05:15.672681 master-0 kubenswrapper[33142]: I1204 01:05:15.672687 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-jhv4v" event={"ID":"1ebe789b-7001-4f0a-b6fd-5a28815a7a10","Type":"ContainerStarted","Data":"3112de708feba11ba584a605e4f23fe9cd4a5e68f3c4badd060d3040bcc288c7"} Dec 04 01:05:15.693966 master-0 kubenswrapper[33142]: I1204 01:05:15.688797 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:05:15.740339 master-0 kubenswrapper[33142]: I1204 01:05:15.740230 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-cell-mapping-jhv4v" podStartSLOduration=2.74020371 podStartE2EDuration="2.74020371s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:15.697796516 +0000 UTC m=+1088.099798386" watchObservedRunningTime="2025-12-04 01:05:15.74020371 +0000 UTC m=+1088.142205570" Dec 04 01:05:15.825858 master-0 kubenswrapper[33142]: I1204 01:05:15.825769 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:16.108833 master-0 kubenswrapper[33142]: I1204 01:05:16.108517 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-t89rl"] Dec 04 01:05:16.688166 master-0 kubenswrapper[33142]: I1204 01:05:16.687998 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"d2445fe3-c926-4000-9179-becf11db90f5","Type":"ContainerStarted","Data":"e9d45a7cc6901d1367485392e0be17535e07f2bc816d1ad301ffa8a68fd0288e"} Dec 04 01:05:16.695877 master-0 kubenswrapper[33142]: I1204 01:05:16.691243 33142 generic.go:334] "Generic (PLEG): container finished" podID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerID="583e1217d2c1dcf05b2a2fd4e2be4684b1cfa8bd55031d92030b9459cb61404d" exitCode=0 Dec 04 01:05:16.695877 master-0 kubenswrapper[33142]: I1204 01:05:16.691326 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" event={"ID":"acdb4202-4e28-4123-ad00-808c14eb96b3","Type":"ContainerDied","Data":"583e1217d2c1dcf05b2a2fd4e2be4684b1cfa8bd55031d92030b9459cb61404d"} Dec 04 01:05:16.695877 master-0 kubenswrapper[33142]: I1204 01:05:16.691358 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" event={"ID":"acdb4202-4e28-4123-ad00-808c14eb96b3","Type":"ContainerStarted","Data":"17271f6d410dee63df0ad99e40c26e0d2ef2b6a0b7bb4dddfbba1cb2d28909bd"} Dec 04 01:05:16.697957 master-0 kubenswrapper[33142]: I1204 01:05:16.697631 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-t89rl" event={"ID":"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c","Type":"ContainerStarted","Data":"ed9aee9b0196dd092b072d1733d42b7d8cad78b9e4b66111b15dd9e0a18eb81c"} Dec 04 01:05:16.697957 master-0 kubenswrapper[33142]: I1204 01:05:16.697697 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-t89rl" event={"ID":"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c","Type":"ContainerStarted","Data":"f81103601814f0e39a05f9d37344ea3a615d44062a22ba55fd8918ee505a8013"} Dec 04 01:05:16.975016 master-0 kubenswrapper[33142]: I1204 01:05:16.974074 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-conductor-db-sync-t89rl" podStartSLOduration=1.974047261 podStartE2EDuration="1.974047261s" podCreationTimestamp="2025-12-04 01:05:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:16.929345763 +0000 UTC m=+1089.331347623" watchObservedRunningTime="2025-12-04 01:05:16.974047261 +0000 UTC m=+1089.376049131" Dec 04 01:05:18.377685 master-0 kubenswrapper[33142]: I1204 01:05:18.377535 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:18.394113 master-0 kubenswrapper[33142]: I1204 01:05:18.393163 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:19.754452 master-0 kubenswrapper[33142]: I1204 01:05:19.753450 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"d2445fe3-c926-4000-9179-becf11db90f5","Type":"ContainerStarted","Data":"d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26"} Dec 04 01:05:19.759549 master-0 kubenswrapper[33142]: I1204 01:05:19.759434 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" event={"ID":"acdb4202-4e28-4123-ad00-808c14eb96b3","Type":"ContainerStarted","Data":"52978f34185694577001e152fe7e748d9418ab710e169fe28cc05d54532c17c1"} Dec 04 01:05:19.760568 master-0 kubenswrapper[33142]: I1204 01:05:19.760524 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:19.768650 master-0 kubenswrapper[33142]: I1204 01:05:19.766149 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerStarted","Data":"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954"} Dec 04 01:05:19.768650 master-0 kubenswrapper[33142]: I1204 01:05:19.766212 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerStarted","Data":"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1"} Dec 04 01:05:19.768650 master-0 kubenswrapper[33142]: I1204 01:05:19.766397 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-log" containerID="cri-o://4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1" gracePeriod=30 Dec 04 01:05:19.768650 master-0 kubenswrapper[33142]: I1204 01:05:19.766552 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-metadata" containerID="cri-o://f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954" gracePeriod=30 Dec 04 01:05:19.782160 master-0 kubenswrapper[33142]: I1204 01:05:19.776285 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerStarted","Data":"c455fb7a1678fea6dd5d62104436b47b25bd3119afb7b9d1c8d4458508006259"} Dec 04 01:05:19.782160 master-0 kubenswrapper[33142]: I1204 01:05:19.776351 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerStarted","Data":"232325de57a3e257c1d41403809d16b1d424d8cb2fb8a8135c5f6c212b122835"} Dec 04 01:05:19.788731 master-0 kubenswrapper[33142]: I1204 01:05:19.788642 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=3.7754780009999998 podStartE2EDuration="6.78861916s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="2025-12-04 01:05:15.845167336 +0000 UTC m=+1088.247169186" lastFinishedPulling="2025-12-04 01:05:18.858308495 +0000 UTC m=+1091.260310345" observedRunningTime="2025-12-04 01:05:19.781450828 +0000 UTC m=+1092.183452688" watchObservedRunningTime="2025-12-04 01:05:19.78861916 +0000 UTC m=+1092.190621010" Dec 04 01:05:19.793211 master-0 kubenswrapper[33142]: I1204 01:05:19.792969 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"ebca5772-11a8-43be-83e8-8a3825f1dc5d","Type":"ContainerStarted","Data":"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b"} Dec 04 01:05:19.793594 master-0 kubenswrapper[33142]: I1204 01:05:19.793548 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-cell1-novncproxy-0" podUID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b" gracePeriod=30 Dec 04 01:05:19.821232 master-0 kubenswrapper[33142]: I1204 01:05:19.821138 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" podStartSLOduration=6.821077444 podStartE2EDuration="6.821077444s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:19.811156855 +0000 UTC m=+1092.213158715" watchObservedRunningTime="2025-12-04 01:05:19.821077444 +0000 UTC m=+1092.223079294" Dec 04 01:05:19.859053 master-0 kubenswrapper[33142]: I1204 01:05:19.858887 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=3.094492156 podStartE2EDuration="6.858858338s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="2025-12-04 01:05:15.079727703 +0000 UTC m=+1087.481729553" lastFinishedPulling="2025-12-04 01:05:18.844093875 +0000 UTC m=+1091.246095735" observedRunningTime="2025-12-04 01:05:19.838168605 +0000 UTC m=+1092.240170465" watchObservedRunningTime="2025-12-04 01:05:19.858858338 +0000 UTC m=+1092.260860198" Dec 04 01:05:19.886157 master-0 kubenswrapper[33142]: I1204 01:05:19.885900 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=3.4185513 podStartE2EDuration="6.885871948s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="2025-12-04 01:05:15.390951616 +0000 UTC m=+1087.792953456" lastFinishedPulling="2025-12-04 01:05:18.858272244 +0000 UTC m=+1091.260274104" observedRunningTime="2025-12-04 01:05:19.87316058 +0000 UTC m=+1092.275162440" watchObservedRunningTime="2025-12-04 01:05:19.885871948 +0000 UTC m=+1092.287873808" Dec 04 01:05:19.913898 master-0 kubenswrapper[33142]: I1204 01:05:19.913797 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-novncproxy-0" podStartSLOduration=3.658905128 podStartE2EDuration="6.913769694s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="2025-12-04 01:05:15.603382848 +0000 UTC m=+1088.005384718" lastFinishedPulling="2025-12-04 01:05:18.858247434 +0000 UTC m=+1091.260249284" observedRunningTime="2025-12-04 01:05:19.899005638 +0000 UTC m=+1092.301007498" watchObservedRunningTime="2025-12-04 01:05:19.913769694 +0000 UTC m=+1092.315771544" Dec 04 01:05:20.814670 master-0 kubenswrapper[33142]: I1204 01:05:20.814578 33142 generic.go:334] "Generic (PLEG): container finished" podID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerID="4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1" exitCode=143 Dec 04 01:05:20.815983 master-0 kubenswrapper[33142]: I1204 01:05:20.815950 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerDied","Data":"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1"} Dec 04 01:05:24.262314 master-0 kubenswrapper[33142]: I1204 01:05:24.262227 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:05:24.262314 master-0 kubenswrapper[33142]: I1204 01:05:24.262327 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:05:24.564801 master-0 kubenswrapper[33142]: I1204 01:05:24.564629 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:05:24.565092 master-0 kubenswrapper[33142]: I1204 01:05:24.564826 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:05:24.633998 master-0 kubenswrapper[33142]: I1204 01:05:24.633909 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:24.677242 master-0 kubenswrapper[33142]: I1204 01:05:24.677143 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:05:24.741077 master-0 kubenswrapper[33142]: I1204 01:05:24.740999 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 01:05:24.741077 master-0 kubenswrapper[33142]: I1204 01:05:24.741059 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 01:05:24.784019 master-0 kubenswrapper[33142]: I1204 01:05:24.783965 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 01:05:24.934859 master-0 kubenswrapper[33142]: I1204 01:05:24.934789 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 01:05:25.279394 master-0 kubenswrapper[33142]: I1204 01:05:25.277937 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:05:25.279394 master-0 kubenswrapper[33142]: I1204 01:05:25.278241 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="dnsmasq-dns" containerID="cri-o://a0a98ca1fc8dd19b24183e149a2162b1d9446ca1ea0c642c66376a89bdaaa03a" gracePeriod=10 Dec 04 01:05:25.346135 master-0 kubenswrapper[33142]: I1204 01:05:25.345288 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.128.1.11:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 01:05:25.346135 master-0 kubenswrapper[33142]: I1204 01:05:25.345383 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.128.1.11:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 01:05:25.921632 master-0 kubenswrapper[33142]: I1204 01:05:25.921557 33142 generic.go:334] "Generic (PLEG): container finished" podID="1ebe789b-7001-4f0a-b6fd-5a28815a7a10" containerID="3c26ade0dff1243c05bdd28fd9038b9268c9e4ddc51e2567b076ffd64b8e24f8" exitCode=0 Dec 04 01:05:25.933792 master-0 kubenswrapper[33142]: I1204 01:05:25.933585 33142 generic.go:334] "Generic (PLEG): container finished" podID="30532606-4a55-430e-83e9-178201d7caaf" containerID="a0a98ca1fc8dd19b24183e149a2162b1d9446ca1ea0c642c66376a89bdaaa03a" exitCode=0 Dec 04 01:05:25.946153 master-0 kubenswrapper[33142]: I1204 01:05:25.941703 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-jhv4v" event={"ID":"1ebe789b-7001-4f0a-b6fd-5a28815a7a10","Type":"ContainerDied","Data":"3c26ade0dff1243c05bdd28fd9038b9268c9e4ddc51e2567b076ffd64b8e24f8"} Dec 04 01:05:25.946153 master-0 kubenswrapper[33142]: I1204 01:05:25.941831 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" event={"ID":"30532606-4a55-430e-83e9-178201d7caaf","Type":"ContainerDied","Data":"a0a98ca1fc8dd19b24183e149a2162b1d9446ca1ea0c642c66376a89bdaaa03a"} Dec 04 01:05:27.481589 master-0 kubenswrapper[33142]: I1204 01:05:27.481494 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.1.3:5353: connect: connection refused" Dec 04 01:05:27.891422 master-0 kubenswrapper[33142]: I1204 01:05:27.891324 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:27.979203 master-0 kubenswrapper[33142]: I1204 01:05:27.979134 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle\") pod \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " Dec 04 01:05:27.979450 master-0 kubenswrapper[33142]: I1204 01:05:27.979416 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data\") pod \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " Dec 04 01:05:27.979520 master-0 kubenswrapper[33142]: I1204 01:05:27.979478 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts\") pod \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " Dec 04 01:05:27.979588 master-0 kubenswrapper[33142]: I1204 01:05:27.979538 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2r47\" (UniqueName: \"kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47\") pod \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\" (UID: \"1ebe789b-7001-4f0a-b6fd-5a28815a7a10\") " Dec 04 01:05:27.980847 master-0 kubenswrapper[33142]: I1204 01:05:27.980790 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-jhv4v" event={"ID":"1ebe789b-7001-4f0a-b6fd-5a28815a7a10","Type":"ContainerDied","Data":"3112de708feba11ba584a605e4f23fe9cd4a5e68f3c4badd060d3040bcc288c7"} Dec 04 01:05:27.980963 master-0 kubenswrapper[33142]: I1204 01:05:27.980859 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3112de708feba11ba584a605e4f23fe9cd4a5e68f3c4badd060d3040bcc288c7" Dec 04 01:05:27.981021 master-0 kubenswrapper[33142]: I1204 01:05:27.981007 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-jhv4v" Dec 04 01:05:27.984449 master-0 kubenswrapper[33142]: I1204 01:05:27.984400 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts" (OuterVolumeSpecName: "scripts") pod "1ebe789b-7001-4f0a-b6fd-5a28815a7a10" (UID: "1ebe789b-7001-4f0a-b6fd-5a28815a7a10"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:27.987395 master-0 kubenswrapper[33142]: I1204 01:05:27.987277 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47" (OuterVolumeSpecName: "kube-api-access-l2r47") pod "1ebe789b-7001-4f0a-b6fd-5a28815a7a10" (UID: "1ebe789b-7001-4f0a-b6fd-5a28815a7a10"). InnerVolumeSpecName "kube-api-access-l2r47". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:28.021629 master-0 kubenswrapper[33142]: I1204 01:05:28.021504 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ebe789b-7001-4f0a-b6fd-5a28815a7a10" (UID: "1ebe789b-7001-4f0a-b6fd-5a28815a7a10"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:28.028841 master-0 kubenswrapper[33142]: I1204 01:05:28.028513 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data" (OuterVolumeSpecName: "config-data") pod "1ebe789b-7001-4f0a-b6fd-5a28815a7a10" (UID: "1ebe789b-7001-4f0a-b6fd-5a28815a7a10"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:28.057327 master-0 kubenswrapper[33142]: I1204 01:05:28.057278 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:05:28.084491 master-0 kubenswrapper[33142]: I1204 01:05:28.084405 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.085131 master-0 kubenswrapper[33142]: I1204 01:05:28.085095 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.085216 master-0 kubenswrapper[33142]: I1204 01:05:28.085143 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.085216 master-0 kubenswrapper[33142]: I1204 01:05:28.085201 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.085317 master-0 kubenswrapper[33142]: I1204 01:05:28.085284 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l5sj\" (UniqueName: \"kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.087414 master-0 kubenswrapper[33142]: I1204 01:05:28.085455 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config\") pod \"30532606-4a55-430e-83e9-178201d7caaf\" (UID: \"30532606-4a55-430e-83e9-178201d7caaf\") " Dec 04 01:05:28.090951 master-0 kubenswrapper[33142]: I1204 01:05:28.087542 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.090951 master-0 kubenswrapper[33142]: I1204 01:05:28.087575 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.090951 master-0 kubenswrapper[33142]: I1204 01:05:28.087590 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.090951 master-0 kubenswrapper[33142]: I1204 01:05:28.087604 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l2r47\" (UniqueName: \"kubernetes.io/projected/1ebe789b-7001-4f0a-b6fd-5a28815a7a10-kube-api-access-l2r47\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.111864 master-0 kubenswrapper[33142]: I1204 01:05:28.110257 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj" (OuterVolumeSpecName: "kube-api-access-2l5sj") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "kube-api-access-2l5sj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:28.205707 master-0 kubenswrapper[33142]: I1204 01:05:28.200272 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2l5sj\" (UniqueName: \"kubernetes.io/projected/30532606-4a55-430e-83e9-178201d7caaf-kube-api-access-2l5sj\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.221470 master-0 kubenswrapper[33142]: I1204 01:05:28.221283 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:05:28.227235 master-0 kubenswrapper[33142]: I1204 01:05:28.224830 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:05:28.247258 master-0 kubenswrapper[33142]: I1204 01:05:28.242746 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:05:28.247666 master-0 kubenswrapper[33142]: I1204 01:05:28.247566 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config" (OuterVolumeSpecName: "config") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:05:28.267847 master-0 kubenswrapper[33142]: I1204 01:05:28.267744 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "30532606-4a55-430e-83e9-178201d7caaf" (UID: "30532606-4a55-430e-83e9-178201d7caaf"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:05:28.303386 master-0 kubenswrapper[33142]: I1204 01:05:28.303010 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.303386 master-0 kubenswrapper[33142]: I1204 01:05:28.303070 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.303386 master-0 kubenswrapper[33142]: I1204 01:05:28.303083 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.303386 master-0 kubenswrapper[33142]: I1204 01:05:28.303094 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.303386 master-0 kubenswrapper[33142]: I1204 01:05:28.303104 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/30532606-4a55-430e-83e9-178201d7caaf-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:28.419285 master-0 kubenswrapper[33142]: I1204 01:05:28.417097 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:28.419285 master-0 kubenswrapper[33142]: I1204 01:05:28.418338 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-api" containerID="cri-o://c455fb7a1678fea6dd5d62104436b47b25bd3119afb7b9d1c8d4458508006259" gracePeriod=30 Dec 04 01:05:28.419285 master-0 kubenswrapper[33142]: I1204 01:05:28.418912 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-log" containerID="cri-o://232325de57a3e257c1d41403809d16b1d424d8cb2fb8a8135c5f6c212b122835" gracePeriod=30 Dec 04 01:05:28.457545 master-0 kubenswrapper[33142]: I1204 01:05:28.457445 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:28.457841 master-0 kubenswrapper[33142]: I1204 01:05:28.457773 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-0" podUID="d2445fe3-c926-4000-9179-becf11db90f5" containerName="nova-scheduler-scheduler" containerID="cri-o://d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" gracePeriod=30 Dec 04 01:05:29.006777 master-0 kubenswrapper[33142]: I1204 01:05:29.006617 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-compute-ironic-compute-0" event={"ID":"a6953eaf-df6e-43bc-82b2-45550672bda9","Type":"ContainerStarted","Data":"c6c9fcc2e0874728c0e72c86b80985298d100c0c8fe23dfae87ea93918e65981"} Dec 04 01:05:29.008426 master-0 kubenswrapper[33142]: I1204 01:05:29.008379 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:29.021133 master-0 kubenswrapper[33142]: I1204 01:05:29.020066 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" event={"ID":"30532606-4a55-430e-83e9-178201d7caaf","Type":"ContainerDied","Data":"7e5e7add67692c51a4d9bd481d9b2f60e91e31fac7576cb4f12b8e19e70dbcd0"} Dec 04 01:05:29.021133 master-0 kubenswrapper[33142]: I1204 01:05:29.020094 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65bf6dc599-wn4bp" Dec 04 01:05:29.021880 master-0 kubenswrapper[33142]: I1204 01:05:29.021768 33142 scope.go:117] "RemoveContainer" containerID="a0a98ca1fc8dd19b24183e149a2162b1d9446ca1ea0c642c66376a89bdaaa03a" Dec 04 01:05:29.023652 master-0 kubenswrapper[33142]: I1204 01:05:29.023610 33142 generic.go:334] "Generic (PLEG): container finished" podID="1cbaa187-8869-4d39-8ce7-c4fad127b6d5" containerID="2e537b2147a547dcfd387e1bbe8b2eb21b968ddec42d83c90ec8db934305ee17" exitCode=0 Dec 04 01:05:29.023825 master-0 kubenswrapper[33142]: I1204 01:05:29.023642 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerDied","Data":"2e537b2147a547dcfd387e1bbe8b2eb21b968ddec42d83c90ec8db934305ee17"} Dec 04 01:05:29.031056 master-0 kubenswrapper[33142]: I1204 01:05:29.030711 33142 generic.go:334] "Generic (PLEG): container finished" podID="4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" containerID="ed9aee9b0196dd092b072d1733d42b7d8cad78b9e4b66111b15dd9e0a18eb81c" exitCode=0 Dec 04 01:05:29.031056 master-0 kubenswrapper[33142]: I1204 01:05:29.030836 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-t89rl" event={"ID":"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c","Type":"ContainerDied","Data":"ed9aee9b0196dd092b072d1733d42b7d8cad78b9e4b66111b15dd9e0a18eb81c"} Dec 04 01:05:29.042019 master-0 kubenswrapper[33142]: I1204 01:05:29.041894 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-compute-ironic-compute-0" podStartSLOduration=3.186681162 podStartE2EDuration="16.04186818s" podCreationTimestamp="2025-12-04 01:05:13 +0000 UTC" firstStartedPulling="2025-12-04 01:05:14.834643063 +0000 UTC m=+1087.236644903" lastFinishedPulling="2025-12-04 01:05:27.689830071 +0000 UTC m=+1100.091831921" observedRunningTime="2025-12-04 01:05:29.025429267 +0000 UTC m=+1101.427431167" watchObservedRunningTime="2025-12-04 01:05:29.04186818 +0000 UTC m=+1101.443870030" Dec 04 01:05:29.046536 master-0 kubenswrapper[33142]: I1204 01:05:29.046344 33142 generic.go:334] "Generic (PLEG): container finished" podID="8cabadc5-6c02-4104-908c-3c631aedca44" containerID="232325de57a3e257c1d41403809d16b1d424d8cb2fb8a8135c5f6c212b122835" exitCode=143 Dec 04 01:05:29.046536 master-0 kubenswrapper[33142]: I1204 01:05:29.046431 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerDied","Data":"232325de57a3e257c1d41403809d16b1d424d8cb2fb8a8135c5f6c212b122835"} Dec 04 01:05:29.092804 master-0 kubenswrapper[33142]: I1204 01:05:29.089252 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 01:05:29.307284 master-0 kubenswrapper[33142]: I1204 01:05:29.307227 33142 scope.go:117] "RemoveContainer" containerID="6df093dcf659593543ee93cbebadd17672855f647f58279e013e7dc91dc4b343" Dec 04 01:05:29.377110 master-0 kubenswrapper[33142]: I1204 01:05:29.377019 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:05:29.402039 master-0 kubenswrapper[33142]: I1204 01:05:29.401727 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-65bf6dc599-wn4bp"] Dec 04 01:05:29.603888 master-0 kubenswrapper[33142]: E1204 01:05:29.603795 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30532606_4a55_430e_83e9_178201d7caaf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30532606_4a55_430e_83e9_178201d7caaf.slice/crio-7e5e7add67692c51a4d9bd481d9b2f60e91e31fac7576cb4f12b8e19e70dbcd0\": RecentStats: unable to find data in memory cache]" Dec 04 01:05:29.747326 master-0 kubenswrapper[33142]: E1204 01:05:29.747256 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:05:29.748980 master-0 kubenswrapper[33142]: E1204 01:05:29.748879 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:05:29.750114 master-0 kubenswrapper[33142]: E1204 01:05:29.750075 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:05:29.750316 master-0 kubenswrapper[33142]: E1204 01:05:29.750116 33142 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack/nova-scheduler-0" podUID="d2445fe3-c926-4000-9179-becf11db90f5" containerName="nova-scheduler-scheduler" Dec 04 01:05:29.929115 master-0 kubenswrapper[33142]: I1204 01:05:29.928152 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30532606-4a55-430e-83e9-178201d7caaf" path="/var/lib/kubelet/pods/30532606-4a55-430e-83e9-178201d7caaf/volumes" Dec 04 01:05:30.065013 master-0 kubenswrapper[33142]: I1204 01:05:30.064907 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"eade563e287e26e6999da5f2c3248e969e0cfef57f28dd1d2cf8a580d85e6f89"} Dec 04 01:05:30.812250 master-0 kubenswrapper[33142]: I1204 01:05:30.812171 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:30.908379 master-0 kubenswrapper[33142]: I1204 01:05:30.907943 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle\") pod \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " Dec 04 01:05:30.908379 master-0 kubenswrapper[33142]: I1204 01:05:30.908234 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts\") pod \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " Dec 04 01:05:30.914708 master-0 kubenswrapper[33142]: I1204 01:05:30.908434 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data\") pod \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " Dec 04 01:05:30.914708 master-0 kubenswrapper[33142]: I1204 01:05:30.908654 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fnlf\" (UniqueName: \"kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf\") pod \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\" (UID: \"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c\") " Dec 04 01:05:30.914708 master-0 kubenswrapper[33142]: I1204 01:05:30.912836 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf" (OuterVolumeSpecName: "kube-api-access-2fnlf") pod "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" (UID: "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c"). InnerVolumeSpecName "kube-api-access-2fnlf". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:30.914708 master-0 kubenswrapper[33142]: I1204 01:05:30.914062 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts" (OuterVolumeSpecName: "scripts") pod "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" (UID: "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:30.965193 master-0 kubenswrapper[33142]: I1204 01:05:30.965114 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data" (OuterVolumeSpecName: "config-data") pod "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" (UID: "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:30.973891 master-0 kubenswrapper[33142]: I1204 01:05:30.973793 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" (UID: "4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:31.013582 master-0 kubenswrapper[33142]: I1204 01:05:31.013244 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2fnlf\" (UniqueName: \"kubernetes.io/projected/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-kube-api-access-2fnlf\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.013582 master-0 kubenswrapper[33142]: I1204 01:05:31.013318 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.013582 master-0 kubenswrapper[33142]: I1204 01:05:31.013337 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.013582 master-0 kubenswrapper[33142]: I1204 01:05:31.013352 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.093714 master-0 kubenswrapper[33142]: I1204 01:05:31.093651 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"e02cbbadedb32ba4bad4785d8418081957b5641f2124c62ef6a82b9e299703a5"} Dec 04 01:05:31.099270 master-0 kubenswrapper[33142]: I1204 01:05:31.099207 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-t89rl" Dec 04 01:05:31.099374 master-0 kubenswrapper[33142]: I1204 01:05:31.099259 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-t89rl" event={"ID":"4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c","Type":"ContainerDied","Data":"f81103601814f0e39a05f9d37344ea3a615d44062a22ba55fd8918ee505a8013"} Dec 04 01:05:31.099374 master-0 kubenswrapper[33142]: I1204 01:05:31.099331 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f81103601814f0e39a05f9d37344ea3a615d44062a22ba55fd8918ee505a8013" Dec 04 01:05:31.102063 master-0 kubenswrapper[33142]: I1204 01:05:31.102027 33142 generic.go:334] "Generic (PLEG): container finished" podID="d2445fe3-c926-4000-9179-becf11db90f5" containerID="d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" exitCode=0 Dec 04 01:05:31.103501 master-0 kubenswrapper[33142]: I1204 01:05:31.103473 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"d2445fe3-c926-4000-9179-becf11db90f5","Type":"ContainerDied","Data":"d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26"} Dec 04 01:05:31.215007 master-0 kubenswrapper[33142]: I1204 01:05:31.214897 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 01:05:31.216016 master-0 kubenswrapper[33142]: E1204 01:05:31.215957 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" containerName="nova-cell1-conductor-db-sync" Dec 04 01:05:31.216016 master-0 kubenswrapper[33142]: I1204 01:05:31.215984 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" containerName="nova-cell1-conductor-db-sync" Dec 04 01:05:31.216120 master-0 kubenswrapper[33142]: E1204 01:05:31.216027 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ebe789b-7001-4f0a-b6fd-5a28815a7a10" containerName="nova-manage" Dec 04 01:05:31.216120 master-0 kubenswrapper[33142]: I1204 01:05:31.216038 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebe789b-7001-4f0a-b6fd-5a28815a7a10" containerName="nova-manage" Dec 04 01:05:31.216120 master-0 kubenswrapper[33142]: E1204 01:05:31.216059 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="dnsmasq-dns" Dec 04 01:05:31.216120 master-0 kubenswrapper[33142]: I1204 01:05:31.216068 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="dnsmasq-dns" Dec 04 01:05:31.216291 master-0 kubenswrapper[33142]: E1204 01:05:31.216139 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="init" Dec 04 01:05:31.216291 master-0 kubenswrapper[33142]: I1204 01:05:31.216150 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="init" Dec 04 01:05:31.216837 master-0 kubenswrapper[33142]: I1204 01:05:31.216658 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="30532606-4a55-430e-83e9-178201d7caaf" containerName="dnsmasq-dns" Dec 04 01:05:31.216837 master-0 kubenswrapper[33142]: I1204 01:05:31.216708 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" containerName="nova-cell1-conductor-db-sync" Dec 04 01:05:31.216837 master-0 kubenswrapper[33142]: I1204 01:05:31.216748 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ebe789b-7001-4f0a-b6fd-5a28815a7a10" containerName="nova-manage" Dec 04 01:05:31.239082 master-0 kubenswrapper[33142]: I1204 01:05:31.218075 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.239082 master-0 kubenswrapper[33142]: I1204 01:05:31.222955 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-config-data" Dec 04 01:05:31.239082 master-0 kubenswrapper[33142]: I1204 01:05:31.232848 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 01:05:31.320079 master-0 kubenswrapper[33142]: I1204 01:05:31.319756 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48rf\" (UniqueName: \"kubernetes.io/projected/00e32e45-ed4f-4486-a656-309503df2526-kube-api-access-j48rf\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.320079 master-0 kubenswrapper[33142]: I1204 01:05:31.320023 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.320613 master-0 kubenswrapper[33142]: I1204 01:05:31.320570 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.519666 master-0 kubenswrapper[33142]: I1204 01:05:31.519319 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.521784 master-0 kubenswrapper[33142]: I1204 01:05:31.521243 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j48rf\" (UniqueName: \"kubernetes.io/projected/00e32e45-ed4f-4486-a656-309503df2526-kube-api-access-j48rf\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.521784 master-0 kubenswrapper[33142]: I1204 01:05:31.521537 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.525388 master-0 kubenswrapper[33142]: I1204 01:05:31.525336 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.527794 master-0 kubenswrapper[33142]: I1204 01:05:31.527679 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00e32e45-ed4f-4486-a656-309503df2526-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.541298 master-0 kubenswrapper[33142]: I1204 01:05:31.541248 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48rf\" (UniqueName: \"kubernetes.io/projected/00e32e45-ed4f-4486-a656-309503df2526-kube-api-access-j48rf\") pod \"nova-cell1-conductor-0\" (UID: \"00e32e45-ed4f-4486-a656-309503df2526\") " pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.562462 master-0 kubenswrapper[33142]: I1204 01:05:31.562392 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:31.680756 master-0 kubenswrapper[33142]: I1204 01:05:31.679470 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:31.728351 master-0 kubenswrapper[33142]: I1204 01:05:31.727179 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsglj\" (UniqueName: \"kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj\") pod \"d2445fe3-c926-4000-9179-becf11db90f5\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " Dec 04 01:05:31.728351 master-0 kubenswrapper[33142]: I1204 01:05:31.727440 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle\") pod \"d2445fe3-c926-4000-9179-becf11db90f5\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " Dec 04 01:05:31.729084 master-0 kubenswrapper[33142]: I1204 01:05:31.728722 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data\") pod \"d2445fe3-c926-4000-9179-becf11db90f5\" (UID: \"d2445fe3-c926-4000-9179-becf11db90f5\") " Dec 04 01:05:31.735561 master-0 kubenswrapper[33142]: I1204 01:05:31.735502 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj" (OuterVolumeSpecName: "kube-api-access-tsglj") pod "d2445fe3-c926-4000-9179-becf11db90f5" (UID: "d2445fe3-c926-4000-9179-becf11db90f5"). InnerVolumeSpecName "kube-api-access-tsglj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:31.766166 master-0 kubenswrapper[33142]: I1204 01:05:31.766092 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data" (OuterVolumeSpecName: "config-data") pod "d2445fe3-c926-4000-9179-becf11db90f5" (UID: "d2445fe3-c926-4000-9179-becf11db90f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:31.776109 master-0 kubenswrapper[33142]: I1204 01:05:31.776044 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d2445fe3-c926-4000-9179-becf11db90f5" (UID: "d2445fe3-c926-4000-9179-becf11db90f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:31.832394 master-0 kubenswrapper[33142]: I1204 01:05:31.831074 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tsglj\" (UniqueName: \"kubernetes.io/projected/d2445fe3-c926-4000-9179-becf11db90f5-kube-api-access-tsglj\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.832394 master-0 kubenswrapper[33142]: I1204 01:05:31.831127 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:31.832394 master-0 kubenswrapper[33142]: I1204 01:05:31.831137 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2445fe3-c926-4000-9179-becf11db90f5-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:32.138427 master-0 kubenswrapper[33142]: I1204 01:05:32.138360 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"1cbaa187-8869-4d39-8ce7-c4fad127b6d5","Type":"ContainerStarted","Data":"ef624e067ef755601b315aba47d42852978a812215ae19cf46bc01b4de8df437"} Dec 04 01:05:32.139741 master-0 kubenswrapper[33142]: I1204 01:05:32.139571 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 01:05:32.148404 master-0 kubenswrapper[33142]: I1204 01:05:32.148285 33142 generic.go:334] "Generic (PLEG): container finished" podID="8cabadc5-6c02-4104-908c-3c631aedca44" containerID="c455fb7a1678fea6dd5d62104436b47b25bd3119afb7b9d1c8d4458508006259" exitCode=0 Dec 04 01:05:32.148404 master-0 kubenswrapper[33142]: I1204 01:05:32.148383 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerDied","Data":"c455fb7a1678fea6dd5d62104436b47b25bd3119afb7b9d1c8d4458508006259"} Dec 04 01:05:32.148757 master-0 kubenswrapper[33142]: I1204 01:05:32.148473 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"8cabadc5-6c02-4104-908c-3c631aedca44","Type":"ContainerDied","Data":"2d3dce0a2e3dd15f05a311668d86afdebd670f9f012695115790311495867f3f"} Dec 04 01:05:32.148757 master-0 kubenswrapper[33142]: I1204 01:05:32.148493 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d3dce0a2e3dd15f05a311668d86afdebd670f9f012695115790311495867f3f" Dec 04 01:05:32.162856 master-0 kubenswrapper[33142]: I1204 01:05:32.162753 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"d2445fe3-c926-4000-9179-becf11db90f5","Type":"ContainerDied","Data":"e9d45a7cc6901d1367485392e0be17535e07f2bc816d1ad301ffa8a68fd0288e"} Dec 04 01:05:32.163199 master-0 kubenswrapper[33142]: I1204 01:05:32.162893 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:32.163199 master-0 kubenswrapper[33142]: I1204 01:05:32.162976 33142 scope.go:117] "RemoveContainer" containerID="d4447462efecb590b263b003b84f495a8e8dbb7fa321c34f8795c9ebcc486a26" Dec 04 01:05:32.169963 master-0 kubenswrapper[33142]: I1204 01:05:32.169884 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:32.184157 master-0 kubenswrapper[33142]: I1204 01:05:32.184055 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 01:05:32.188134 master-0 kubenswrapper[33142]: W1204 01:05:32.188081 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00e32e45_ed4f_4486_a656_309503df2526.slice/crio-2bf2f6d9c555b9c3fbc4d971545feb57468c3d5f55801f48afa7cd1fb805714e WatchSource:0}: Error finding container 2bf2f6d9c555b9c3fbc4d971545feb57468c3d5f55801f48afa7cd1fb805714e: Status 404 returned error can't find the container with id 2bf2f6d9c555b9c3fbc4d971545feb57468c3d5f55801f48afa7cd1fb805714e Dec 04 01:05:32.190892 master-0 kubenswrapper[33142]: I1204 01:05:32.190762 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-conductor-0" podStartSLOduration=64.252638787 podStartE2EDuration="1m46.190729541s" podCreationTimestamp="2025-12-04 01:03:46 +0000 UTC" firstStartedPulling="2025-12-04 01:03:57.204145812 +0000 UTC m=+1009.606147662" lastFinishedPulling="2025-12-04 01:04:39.142236566 +0000 UTC m=+1051.544238416" observedRunningTime="2025-12-04 01:05:32.183867687 +0000 UTC m=+1104.585869557" watchObservedRunningTime="2025-12-04 01:05:32.190729541 +0000 UTC m=+1104.592731411" Dec 04 01:05:32.245341 master-0 kubenswrapper[33142]: I1204 01:05:32.245271 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:32.271670 master-0 kubenswrapper[33142]: I1204 01:05:32.263273 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:32.296941 master-0 kubenswrapper[33142]: I1204 01:05:32.296791 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:32.298176 master-0 kubenswrapper[33142]: E1204 01:05:32.298130 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-log" Dec 04 01:05:32.298176 master-0 kubenswrapper[33142]: I1204 01:05:32.298163 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-log" Dec 04 01:05:32.298507 master-0 kubenswrapper[33142]: E1204 01:05:32.298225 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-api" Dec 04 01:05:32.298507 master-0 kubenswrapper[33142]: I1204 01:05:32.298235 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-api" Dec 04 01:05:32.298507 master-0 kubenswrapper[33142]: E1204 01:05:32.298278 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2445fe3-c926-4000-9179-becf11db90f5" containerName="nova-scheduler-scheduler" Dec 04 01:05:32.298507 master-0 kubenswrapper[33142]: I1204 01:05:32.298287 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2445fe3-c926-4000-9179-becf11db90f5" containerName="nova-scheduler-scheduler" Dec 04 01:05:32.298887 master-0 kubenswrapper[33142]: I1204 01:05:32.298845 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2445fe3-c926-4000-9179-becf11db90f5" containerName="nova-scheduler-scheduler" Dec 04 01:05:32.299034 master-0 kubenswrapper[33142]: I1204 01:05:32.298934 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-api" Dec 04 01:05:32.299034 master-0 kubenswrapper[33142]: I1204 01:05:32.298979 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" containerName="nova-api-log" Dec 04 01:05:32.300750 master-0 kubenswrapper[33142]: I1204 01:05:32.300651 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:32.305185 master-0 kubenswrapper[33142]: I1204 01:05:32.304003 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 01:05:32.317267 master-0 kubenswrapper[33142]: I1204 01:05:32.317184 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:32.354068 master-0 kubenswrapper[33142]: I1204 01:05:32.354000 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data\") pod \"8cabadc5-6c02-4104-908c-3c631aedca44\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " Dec 04 01:05:32.354302 master-0 kubenswrapper[33142]: I1204 01:05:32.354189 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle\") pod \"8cabadc5-6c02-4104-908c-3c631aedca44\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " Dec 04 01:05:32.354302 master-0 kubenswrapper[33142]: I1204 01:05:32.354254 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzjt\" (UniqueName: \"kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt\") pod \"8cabadc5-6c02-4104-908c-3c631aedca44\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " Dec 04 01:05:32.354558 master-0 kubenswrapper[33142]: I1204 01:05:32.354527 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs\") pod \"8cabadc5-6c02-4104-908c-3c631aedca44\" (UID: \"8cabadc5-6c02-4104-908c-3c631aedca44\") " Dec 04 01:05:32.356700 master-0 kubenswrapper[33142]: I1204 01:05:32.356634 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs" (OuterVolumeSpecName: "logs") pod "8cabadc5-6c02-4104-908c-3c631aedca44" (UID: "8cabadc5-6c02-4104-908c-3c631aedca44"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:05:32.360638 master-0 kubenswrapper[33142]: I1204 01:05:32.360583 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt" (OuterVolumeSpecName: "kube-api-access-qpzjt") pod "8cabadc5-6c02-4104-908c-3c631aedca44" (UID: "8cabadc5-6c02-4104-908c-3c631aedca44"). InnerVolumeSpecName "kube-api-access-qpzjt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:32.401408 master-0 kubenswrapper[33142]: I1204 01:05:32.401317 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data" (OuterVolumeSpecName: "config-data") pod "8cabadc5-6c02-4104-908c-3c631aedca44" (UID: "8cabadc5-6c02-4104-908c-3c631aedca44"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:32.403007 master-0 kubenswrapper[33142]: I1204 01:05:32.402906 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8cabadc5-6c02-4104-908c-3c631aedca44" (UID: "8cabadc5-6c02-4104-908c-3c631aedca44"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:32.462399 master-0 kubenswrapper[33142]: I1204 01:05:32.462323 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmtb\" (UniqueName: \"kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.462805 master-0 kubenswrapper[33142]: I1204 01:05:32.462487 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.462862 master-0 kubenswrapper[33142]: I1204 01:05:32.462836 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.463474 master-0 kubenswrapper[33142]: I1204 01:05:32.463192 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cabadc5-6c02-4104-908c-3c631aedca44-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:32.463474 master-0 kubenswrapper[33142]: I1204 01:05:32.463222 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:32.463474 master-0 kubenswrapper[33142]: I1204 01:05:32.463237 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cabadc5-6c02-4104-908c-3c631aedca44-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:32.463474 master-0 kubenswrapper[33142]: I1204 01:05:32.463252 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qpzjt\" (UniqueName: \"kubernetes.io/projected/8cabadc5-6c02-4104-908c-3c631aedca44-kube-api-access-qpzjt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:32.566278 master-0 kubenswrapper[33142]: I1204 01:05:32.566116 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmtb\" (UniqueName: \"kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.566278 master-0 kubenswrapper[33142]: I1204 01:05:32.566213 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.566571 master-0 kubenswrapper[33142]: I1204 01:05:32.566311 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.570666 master-0 kubenswrapper[33142]: I1204 01:05:32.570148 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.571366 master-0 kubenswrapper[33142]: I1204 01:05:32.571315 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.637379 master-0 kubenswrapper[33142]: I1204 01:05:32.637307 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmtb\" (UniqueName: \"kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb\") pod \"nova-scheduler-0\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " pod="openstack/nova-scheduler-0" Dec 04 01:05:32.645648 master-0 kubenswrapper[33142]: I1204 01:05:32.645550 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:05:33.178203 master-0 kubenswrapper[33142]: I1204 01:05:33.178105 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:05:33.182768 master-0 kubenswrapper[33142]: W1204 01:05:33.182713 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda42e3233_2cf5_4f24_8bca_2ea3d4cd38cc.slice/crio-b08bc43a24a313fbaea5fb5d68c394a13a00453b98f5897aa5c6c97397deab30 WatchSource:0}: Error finding container b08bc43a24a313fbaea5fb5d68c394a13a00453b98f5897aa5c6c97397deab30: Status 404 returned error can't find the container with id b08bc43a24a313fbaea5fb5d68c394a13a00453b98f5897aa5c6c97397deab30 Dec 04 01:05:33.193762 master-0 kubenswrapper[33142]: I1204 01:05:33.193698 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:33.195996 master-0 kubenswrapper[33142]: I1204 01:05:33.195864 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-0" event={"ID":"00e32e45-ed4f-4486-a656-309503df2526","Type":"ContainerStarted","Data":"4254c9060da0fe8132c66bcf846b05a3b6a500c70441d3fa62c875c9b52384a9"} Dec 04 01:05:33.195996 master-0 kubenswrapper[33142]: I1204 01:05:33.195947 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-0" event={"ID":"00e32e45-ed4f-4486-a656-309503df2526","Type":"ContainerStarted","Data":"2bf2f6d9c555b9c3fbc4d971545feb57468c3d5f55801f48afa7cd1fb805714e"} Dec 04 01:05:33.197441 master-0 kubenswrapper[33142]: I1204 01:05:33.197369 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 01:05:33.197549 master-0 kubenswrapper[33142]: I1204 01:05:33.197464 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 01:05:33.197549 master-0 kubenswrapper[33142]: I1204 01:05:33.197484 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:33.248877 master-0 kubenswrapper[33142]: I1204 01:05:33.248754 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-conductor-0" podStartSLOduration=2.24872924 podStartE2EDuration="2.24872924s" podCreationTimestamp="2025-12-04 01:05:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:33.22242237 +0000 UTC m=+1105.624424240" watchObservedRunningTime="2025-12-04 01:05:33.24872924 +0000 UTC m=+1105.650731100" Dec 04 01:05:33.394134 master-0 kubenswrapper[33142]: I1204 01:05:33.394055 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:33.416306 master-0 kubenswrapper[33142]: I1204 01:05:33.416191 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:33.439663 master-0 kubenswrapper[33142]: I1204 01:05:33.439335 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:33.443974 master-0 kubenswrapper[33142]: I1204 01:05:33.442409 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:33.444707 master-0 kubenswrapper[33142]: I1204 01:05:33.444658 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 01:05:33.485118 master-0 kubenswrapper[33142]: I1204 01:05:33.484846 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:33.593957 master-0 kubenswrapper[33142]: I1204 01:05:33.593465 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.594194 master-0 kubenswrapper[33142]: I1204 01:05:33.593956 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.594194 master-0 kubenswrapper[33142]: I1204 01:05:33.594058 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.596095 master-0 kubenswrapper[33142]: I1204 01:05:33.594338 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vs8\" (UniqueName: \"kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.696520 master-0 kubenswrapper[33142]: I1204 01:05:33.696371 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vs8\" (UniqueName: \"kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.696735 master-0 kubenswrapper[33142]: I1204 01:05:33.696567 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.696735 master-0 kubenswrapper[33142]: I1204 01:05:33.696642 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.696735 master-0 kubenswrapper[33142]: I1204 01:05:33.696667 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.697203 master-0 kubenswrapper[33142]: I1204 01:05:33.697167 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.703215 master-0 kubenswrapper[33142]: I1204 01:05:33.703153 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.713427 master-0 kubenswrapper[33142]: I1204 01:05:33.713369 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.718596 master-0 kubenswrapper[33142]: I1204 01:05:33.718525 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vs8\" (UniqueName: \"kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8\") pod \"nova-api-0\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " pod="openstack/nova-api-0" Dec 04 01:05:33.795039 master-0 kubenswrapper[33142]: I1204 01:05:33.794961 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:05:33.933473 master-0 kubenswrapper[33142]: I1204 01:05:33.933405 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cabadc5-6c02-4104-908c-3c631aedca44" path="/var/lib/kubelet/pods/8cabadc5-6c02-4104-908c-3c631aedca44/volumes" Dec 04 01:05:33.934441 master-0 kubenswrapper[33142]: I1204 01:05:33.934405 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2445fe3-c926-4000-9179-becf11db90f5" path="/var/lib/kubelet/pods/d2445fe3-c926-4000-9179-becf11db90f5/volumes" Dec 04 01:05:34.225010 master-0 kubenswrapper[33142]: I1204 01:05:34.224833 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc","Type":"ContainerStarted","Data":"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e"} Dec 04 01:05:34.225010 master-0 kubenswrapper[33142]: I1204 01:05:34.224998 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc","Type":"ContainerStarted","Data":"b08bc43a24a313fbaea5fb5d68c394a13a00453b98f5897aa5c6c97397deab30"} Dec 04 01:05:34.251319 master-0 kubenswrapper[33142]: I1204 01:05:34.251077 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=2.251053843 podStartE2EDuration="2.251053843s" podCreationTimestamp="2025-12-04 01:05:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:34.25059648 +0000 UTC m=+1106.652598360" watchObservedRunningTime="2025-12-04 01:05:34.251053843 +0000 UTC m=+1106.653055693" Dec 04 01:05:34.264627 master-0 kubenswrapper[33142]: I1204 01:05:34.264567 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 01:05:34.287808 master-0 kubenswrapper[33142]: I1204 01:05:34.287738 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 01:05:34.348617 master-0 kubenswrapper[33142]: I1204 01:05:34.348518 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:35.240030 master-0 kubenswrapper[33142]: I1204 01:05:35.239957 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerStarted","Data":"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f"} Dec 04 01:05:35.240623 master-0 kubenswrapper[33142]: I1204 01:05:35.240050 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerStarted","Data":"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7"} Dec 04 01:05:35.240623 master-0 kubenswrapper[33142]: I1204 01:05:35.240082 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerStarted","Data":"8997eb9bde99683d5020f036752e9ac9890bb70c8c39d28bee02cc9b625a563d"} Dec 04 01:05:35.244576 master-0 kubenswrapper[33142]: I1204 01:05:35.244512 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 01:05:35.263594 master-0 kubenswrapper[33142]: I1204 01:05:35.263500 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.26347967 podStartE2EDuration="2.26347967s" podCreationTimestamp="2025-12-04 01:05:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:35.262133102 +0000 UTC m=+1107.664134962" watchObservedRunningTime="2025-12-04 01:05:35.26347967 +0000 UTC m=+1107.665481540" Dec 04 01:05:37.645759 master-0 kubenswrapper[33142]: I1204 01:05:37.645669 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 01:05:41.607670 master-0 kubenswrapper[33142]: I1204 01:05:41.607603 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-conductor-0" Dec 04 01:05:42.646059 master-0 kubenswrapper[33142]: I1204 01:05:42.645879 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 01:05:42.686458 master-0 kubenswrapper[33142]: I1204 01:05:42.686393 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 01:05:43.437461 master-0 kubenswrapper[33142]: I1204 01:05:43.434727 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 01:05:43.795668 master-0 kubenswrapper[33142]: I1204 01:05:43.795536 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:05:43.795668 master-0 kubenswrapper[33142]: I1204 01:05:43.795608 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:05:44.308048 master-0 kubenswrapper[33142]: I1204 01:05:44.306308 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:05:44.325965 master-0 kubenswrapper[33142]: I1204 01:05:44.324256 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.325965 master-0 kubenswrapper[33142]: I1204 01:05:44.324650 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:05:44.414961 master-0 kubenswrapper[33142]: I1204 01:05:44.414499 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhjwm\" (UniqueName: \"kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.414961 master-0 kubenswrapper[33142]: I1204 01:05:44.414780 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.418955 master-0 kubenswrapper[33142]: I1204 01:05:44.416908 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.519968 master-0 kubenswrapper[33142]: I1204 01:05:44.518541 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.519968 master-0 kubenswrapper[33142]: I1204 01:05:44.519156 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.519968 master-0 kubenswrapper[33142]: I1204 01:05:44.519371 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.519968 master-0 kubenswrapper[33142]: I1204 01:05:44.519411 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fhjwm\" (UniqueName: \"kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.520318 master-0 kubenswrapper[33142]: I1204 01:05:44.520083 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.539968 master-0 kubenswrapper[33142]: I1204 01:05:44.539586 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhjwm\" (UniqueName: \"kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm\") pod \"redhat-operators-gpn4w\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.703050 master-0 kubenswrapper[33142]: I1204 01:05:44.702977 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:44.882963 master-0 kubenswrapper[33142]: I1204 01:05:44.877598 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.128.1.19:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 01:05:44.882963 master-0 kubenswrapper[33142]: I1204 01:05:44.878052 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.128.1.19:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 01:05:45.234121 master-0 kubenswrapper[33142]: W1204 01:05:45.233372 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dffd7b0_29b5_4dd5_9b10_be9b401b13c3.slice/crio-cd8cccd5a862b4acee7a1fb26b3152bf9e9ede66a3d3e4de02f66baeb5ce165a WatchSource:0}: Error finding container cd8cccd5a862b4acee7a1fb26b3152bf9e9ede66a3d3e4de02f66baeb5ce165a: Status 404 returned error can't find the container with id cd8cccd5a862b4acee7a1fb26b3152bf9e9ede66a3d3e4de02f66baeb5ce165a Dec 04 01:05:45.254143 master-0 kubenswrapper[33142]: I1204 01:05:45.253924 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:05:45.417844 master-0 kubenswrapper[33142]: I1204 01:05:45.417768 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerStarted","Data":"cd8cccd5a862b4acee7a1fb26b3152bf9e9ede66a3d3e4de02f66baeb5ce165a"} Dec 04 01:05:46.540042 master-0 kubenswrapper[33142]: I1204 01:05:46.539962 33142 generic.go:334] "Generic (PLEG): container finished" podID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerID="b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c" exitCode=0 Dec 04 01:05:46.540042 master-0 kubenswrapper[33142]: I1204 01:05:46.540026 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerDied","Data":"b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c"} Dec 04 01:05:46.857253 master-0 kubenswrapper[33142]: I1204 01:05:46.857167 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:05:46.861150 master-0 kubenswrapper[33142]: I1204 01:05:46.861065 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:46.910041 master-0 kubenswrapper[33142]: I1204 01:05:46.899556 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:05:47.048242 master-0 kubenswrapper[33142]: I1204 01:05:47.048188 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8pkv\" (UniqueName: \"kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.048618 master-0 kubenswrapper[33142]: I1204 01:05:47.048602 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.048763 master-0 kubenswrapper[33142]: I1204 01:05:47.048744 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.151766 master-0 kubenswrapper[33142]: I1204 01:05:47.151233 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h8pkv\" (UniqueName: \"kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.151766 master-0 kubenswrapper[33142]: I1204 01:05:47.151433 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.151766 master-0 kubenswrapper[33142]: I1204 01:05:47.151522 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.155542 master-0 kubenswrapper[33142]: I1204 01:05:47.155282 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.155828 master-0 kubenswrapper[33142]: I1204 01:05:47.155541 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.186758 master-0 kubenswrapper[33142]: I1204 01:05:47.186652 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8pkv\" (UniqueName: \"kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv\") pod \"certified-operators-q2x64\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.487682 master-0 kubenswrapper[33142]: I1204 01:05:47.487599 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:47.559105 master-0 kubenswrapper[33142]: I1204 01:05:47.557124 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerStarted","Data":"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1"} Dec 04 01:05:48.576076 master-0 kubenswrapper[33142]: I1204 01:05:48.575856 33142 generic.go:334] "Generic (PLEG): container finished" podID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerID="2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1" exitCode=0 Dec 04 01:05:48.576076 master-0 kubenswrapper[33142]: I1204 01:05:48.576048 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerDied","Data":"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1"} Dec 04 01:05:49.681195 master-0 kubenswrapper[33142]: W1204 01:05:49.681132 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832a43d4_2b26_4222_afbe_269bd491a49c.slice/crio-5fdb041d81440c892eaaf42c97a4fdd45f97de5f89d5ce8b587a77a09a27e8d8 WatchSource:0}: Error finding container 5fdb041d81440c892eaaf42c97a4fdd45f97de5f89d5ce8b587a77a09a27e8d8: Status 404 returned error can't find the container with id 5fdb041d81440c892eaaf42c97a4fdd45f97de5f89d5ce8b587a77a09a27e8d8 Dec 04 01:05:49.695747 master-0 kubenswrapper[33142]: I1204 01:05:49.695678 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:05:50.038151 master-0 kubenswrapper[33142]: E1204 01:05:50.038094 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebca5772_11a8_43be_83e8_8a3825f1dc5d.slice/crio-conmon-44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:05:50.432729 master-0 kubenswrapper[33142]: I1204 01:05:50.432025 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:50.447723 master-0 kubenswrapper[33142]: I1204 01:05:50.445982 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.496239 master-0 kubenswrapper[33142]: I1204 01:05:50.496163 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs\") pod \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " Dec 04 01:05:50.498998 master-0 kubenswrapper[33142]: I1204 01:05:50.496761 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs" (OuterVolumeSpecName: "logs") pod "7c981842-a6cd-4dbe-b9d1-37d1628394fe" (UID: "7c981842-a6cd-4dbe-b9d1-37d1628394fe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:05:50.499242 master-0 kubenswrapper[33142]: I1204 01:05:50.499206 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle\") pod \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " Dec 04 01:05:50.499480 master-0 kubenswrapper[33142]: I1204 01:05:50.499461 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle\") pod \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " Dec 04 01:05:50.499659 master-0 kubenswrapper[33142]: I1204 01:05:50.499641 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data\") pod \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " Dec 04 01:05:50.499857 master-0 kubenswrapper[33142]: I1204 01:05:50.499840 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fsn8\" (UniqueName: \"kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8\") pod \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " Dec 04 01:05:50.500055 master-0 kubenswrapper[33142]: I1204 01:05:50.500035 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data\") pod \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\" (UID: \"7c981842-a6cd-4dbe-b9d1-37d1628394fe\") " Dec 04 01:05:50.506310 master-0 kubenswrapper[33142]: I1204 01:05:50.506226 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c981842-a6cd-4dbe-b9d1-37d1628394fe-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.509569 master-0 kubenswrapper[33142]: I1204 01:05:50.509452 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8" (OuterVolumeSpecName: "kube-api-access-5fsn8") pod "7c981842-a6cd-4dbe-b9d1-37d1628394fe" (UID: "7c981842-a6cd-4dbe-b9d1-37d1628394fe"). InnerVolumeSpecName "kube-api-access-5fsn8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:50.530196 master-0 kubenswrapper[33142]: I1204 01:05:50.530145 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data" (OuterVolumeSpecName: "config-data") pod "7c981842-a6cd-4dbe-b9d1-37d1628394fe" (UID: "7c981842-a6cd-4dbe-b9d1-37d1628394fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:50.537918 master-0 kubenswrapper[33142]: I1204 01:05:50.537831 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c981842-a6cd-4dbe-b9d1-37d1628394fe" (UID: "7c981842-a6cd-4dbe-b9d1-37d1628394fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:50.538530 master-0 kubenswrapper[33142]: I1204 01:05:50.538326 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ebca5772-11a8-43be-83e8-8a3825f1dc5d" (UID: "ebca5772-11a8-43be-83e8-8a3825f1dc5d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:50.543201 master-0 kubenswrapper[33142]: I1204 01:05:50.542988 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data" (OuterVolumeSpecName: "config-data") pod "ebca5772-11a8-43be-83e8-8a3825f1dc5d" (UID: "ebca5772-11a8-43be-83e8-8a3825f1dc5d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:05:50.605746 master-0 kubenswrapper[33142]: I1204 01:05:50.605678 33142 generic.go:334] "Generic (PLEG): container finished" podID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerID="f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954" exitCode=137 Dec 04 01:05:50.606220 master-0 kubenswrapper[33142]: I1204 01:05:50.605779 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:50.606330 master-0 kubenswrapper[33142]: I1204 01:05:50.605782 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerDied","Data":"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954"} Dec 04 01:05:50.606416 master-0 kubenswrapper[33142]: I1204 01:05:50.606372 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"7c981842-a6cd-4dbe-b9d1-37d1628394fe","Type":"ContainerDied","Data":"b6f0f0b3cbd5418057ab16947561ac904c95cb0c3d3b279e3314f74416f47bcc"} Dec 04 01:05:50.606497 master-0 kubenswrapper[33142]: I1204 01:05:50.606421 33142 scope.go:117] "RemoveContainer" containerID="f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954" Dec 04 01:05:50.607665 master-0 kubenswrapper[33142]: I1204 01:05:50.607626 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzmkz\" (UniqueName: \"kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz\") pod \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\" (UID: \"ebca5772-11a8-43be-83e8-8a3825f1dc5d\") " Dec 04 01:05:50.608645 master-0 kubenswrapper[33142]: I1204 01:05:50.608568 33142 generic.go:334] "Generic (PLEG): container finished" podID="832a43d4-2b26-4222-afbe-269bd491a49c" containerID="db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5" exitCode=0 Dec 04 01:05:50.608771 master-0 kubenswrapper[33142]: I1204 01:05:50.608669 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerDied","Data":"db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5"} Dec 04 01:05:50.608771 master-0 kubenswrapper[33142]: I1204 01:05:50.608712 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerStarted","Data":"5fdb041d81440c892eaaf42c97a4fdd45f97de5f89d5ce8b587a77a09a27e8d8"} Dec 04 01:05:50.609606 master-0 kubenswrapper[33142]: I1204 01:05:50.609565 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.609864 master-0 kubenswrapper[33142]: I1204 01:05:50.609836 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebca5772-11a8-43be-83e8-8a3825f1dc5d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.609864 master-0 kubenswrapper[33142]: I1204 01:05:50.609858 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5fsn8\" (UniqueName: \"kubernetes.io/projected/7c981842-a6cd-4dbe-b9d1-37d1628394fe-kube-api-access-5fsn8\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.609954 master-0 kubenswrapper[33142]: I1204 01:05:50.609869 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.609954 master-0 kubenswrapper[33142]: I1204 01:05:50.609880 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c981842-a6cd-4dbe-b9d1-37d1628394fe-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.614323 master-0 kubenswrapper[33142]: I1204 01:05:50.614286 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz" (OuterVolumeSpecName: "kube-api-access-xzmkz") pod "ebca5772-11a8-43be-83e8-8a3825f1dc5d" (UID: "ebca5772-11a8-43be-83e8-8a3825f1dc5d"). InnerVolumeSpecName "kube-api-access-xzmkz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:05:50.618490 master-0 kubenswrapper[33142]: I1204 01:05:50.618440 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerStarted","Data":"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40"} Dec 04 01:05:50.623135 master-0 kubenswrapper[33142]: I1204 01:05:50.623101 33142 generic.go:334] "Generic (PLEG): container finished" podID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" containerID="44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b" exitCode=137 Dec 04 01:05:50.623177 master-0 kubenswrapper[33142]: I1204 01:05:50.623153 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"ebca5772-11a8-43be-83e8-8a3825f1dc5d","Type":"ContainerDied","Data":"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b"} Dec 04 01:05:50.623207 master-0 kubenswrapper[33142]: I1204 01:05:50.623182 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"ebca5772-11a8-43be-83e8-8a3825f1dc5d","Type":"ContainerDied","Data":"feadebcbf1d447154dd1ee76e62067d3e51b1f356cbd279ec70d7f98cb59e494"} Dec 04 01:05:50.623660 master-0 kubenswrapper[33142]: I1204 01:05:50.623229 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.657431 master-0 kubenswrapper[33142]: I1204 01:05:50.657342 33142 scope.go:117] "RemoveContainer" containerID="4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1" Dec 04 01:05:50.669960 master-0 kubenswrapper[33142]: I1204 01:05:50.668560 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:50.704264 master-0 kubenswrapper[33142]: I1204 01:05:50.704196 33142 scope.go:117] "RemoveContainer" containerID="f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954" Dec 04 01:05:50.705548 master-0 kubenswrapper[33142]: E1204 01:05:50.705202 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954\": container with ID starting with f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954 not found: ID does not exist" containerID="f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954" Dec 04 01:05:50.705548 master-0 kubenswrapper[33142]: I1204 01:05:50.705295 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954"} err="failed to get container status \"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954\": rpc error: code = NotFound desc = could not find container \"f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954\": container with ID starting with f5edfe6ce16838bd137a89fa1f8ac9543e7a3458412d4442bb18c2ed4d0d8954 not found: ID does not exist" Dec 04 01:05:50.705548 master-0 kubenswrapper[33142]: I1204 01:05:50.705336 33142 scope.go:117] "RemoveContainer" containerID="4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1" Dec 04 01:05:50.705548 master-0 kubenswrapper[33142]: I1204 01:05:50.705409 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-gpn4w" podStartSLOduration=3.506364226 podStartE2EDuration="6.70538021s" podCreationTimestamp="2025-12-04 01:05:44 +0000 UTC" firstStartedPulling="2025-12-04 01:05:46.542366004 +0000 UTC m=+1118.944367854" lastFinishedPulling="2025-12-04 01:05:49.741381978 +0000 UTC m=+1122.143383838" observedRunningTime="2025-12-04 01:05:50.682302121 +0000 UTC m=+1123.084304231" watchObservedRunningTime="2025-12-04 01:05:50.70538021 +0000 UTC m=+1123.107382060" Dec 04 01:05:50.705741 master-0 kubenswrapper[33142]: I1204 01:05:50.705658 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:50.733695 master-0 kubenswrapper[33142]: I1204 01:05:50.733612 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xzmkz\" (UniqueName: \"kubernetes.io/projected/ebca5772-11a8-43be-83e8-8a3825f1dc5d-kube-api-access-xzmkz\") on node \"master-0\" DevicePath \"\"" Dec 04 01:05:50.755050 master-0 kubenswrapper[33142]: E1204 01:05:50.754912 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1\": container with ID starting with 4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1 not found: ID does not exist" containerID="4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1" Dec 04 01:05:50.755050 master-0 kubenswrapper[33142]: I1204 01:05:50.755004 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1"} err="failed to get container status \"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1\": rpc error: code = NotFound desc = could not find container \"4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1\": container with ID starting with 4069ab760ebca71a4588c6a66d014892e467b5627d52fee255fc8da639b9fec1 not found: ID does not exist" Dec 04 01:05:50.755050 master-0 kubenswrapper[33142]: I1204 01:05:50.755044 33142 scope.go:117] "RemoveContainer" containerID="44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b" Dec 04 01:05:50.763449 master-0 kubenswrapper[33142]: I1204 01:05:50.763371 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:50.764094 master-0 kubenswrapper[33142]: E1204 01:05:50.764063 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-metadata" Dec 04 01:05:50.764094 master-0 kubenswrapper[33142]: I1204 01:05:50.764091 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-metadata" Dec 04 01:05:50.764192 master-0 kubenswrapper[33142]: E1204 01:05:50.764152 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 01:05:50.764192 master-0 kubenswrapper[33142]: I1204 01:05:50.764161 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 01:05:50.764256 master-0 kubenswrapper[33142]: E1204 01:05:50.764216 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-log" Dec 04 01:05:50.764256 master-0 kubenswrapper[33142]: I1204 01:05:50.764225 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-log" Dec 04 01:05:50.764556 master-0 kubenswrapper[33142]: I1204 01:05:50.764523 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 01:05:50.764556 master-0 kubenswrapper[33142]: I1204 01:05:50.764556 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-metadata" Dec 04 01:05:50.764638 master-0 kubenswrapper[33142]: I1204 01:05:50.764578 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" containerName="nova-metadata-log" Dec 04 01:05:50.766291 master-0 kubenswrapper[33142]: I1204 01:05:50.766251 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:50.772993 master-0 kubenswrapper[33142]: I1204 01:05:50.770884 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 01:05:50.776860 master-0 kubenswrapper[33142]: I1204 01:05:50.776814 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Dec 04 01:05:50.777017 master-0 kubenswrapper[33142]: I1204 01:05:50.776975 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:50.787658 master-0 kubenswrapper[33142]: I1204 01:05:50.787610 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:50.806236 master-0 kubenswrapper[33142]: I1204 01:05:50.800142 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:50.814016 master-0 kubenswrapper[33142]: I1204 01:05:50.813947 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:50.824094 master-0 kubenswrapper[33142]: I1204 01:05:50.824034 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.827453 master-0 kubenswrapper[33142]: I1204 01:05:50.827402 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-novncproxy-config-data" Dec 04 01:05:50.827572 master-0 kubenswrapper[33142]: I1204 01:05:50.827524 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-novncproxy-cell1-vencrypt" Dec 04 01:05:50.831989 master-0 kubenswrapper[33142]: I1204 01:05:50.831277 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-novncproxy-cell1-public-svc" Dec 04 01:05:50.832837 master-0 kubenswrapper[33142]: I1204 01:05:50.832800 33142 scope.go:117] "RemoveContainer" containerID="44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b" Dec 04 01:05:50.833604 master-0 kubenswrapper[33142]: E1204 01:05:50.833554 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b\": container with ID starting with 44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b not found: ID does not exist" containerID="44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b" Dec 04 01:05:50.833659 master-0 kubenswrapper[33142]: I1204 01:05:50.833605 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b"} err="failed to get container status \"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b\": rpc error: code = NotFound desc = could not find container \"44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b\": container with ID starting with 44704d973d17314907795eb7ded1f72de0e412d53ab077e1bac78210d5c22d0b not found: ID does not exist" Dec 04 01:05:50.833996 master-0 kubenswrapper[33142]: I1204 01:05:50.833956 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:50.839341 master-0 kubenswrapper[33142]: I1204 01:05:50.839294 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.840003 master-0 kubenswrapper[33142]: I1204 01:05:50.839905 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhqjt\" (UniqueName: \"kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.840050 master-0 kubenswrapper[33142]: I1204 01:05:50.840036 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.840218 master-0 kubenswrapper[33142]: I1204 01:05:50.840183 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.842581 master-0 kubenswrapper[33142]: I1204 01:05:50.842506 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.945245 master-0 kubenswrapper[33142]: I1204 01:05:50.945146 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945268 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945313 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945368 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945398 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg4b9\" (UniqueName: \"kubernetes.io/projected/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-kube-api-access-rg4b9\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945458 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.945510 master-0 kubenswrapper[33142]: I1204 01:05:50.945498 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.945717 master-0 kubenswrapper[33142]: I1204 01:05:50.945537 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.945717 master-0 kubenswrapper[33142]: I1204 01:05:50.945605 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:50.945717 master-0 kubenswrapper[33142]: I1204 01:05:50.945657 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.946753 master-0 kubenswrapper[33142]: I1204 01:05:50.946712 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mhqjt\" (UniqueName: \"kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.949443 master-0 kubenswrapper[33142]: I1204 01:05:50.949394 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.949984 master-0 kubenswrapper[33142]: I1204 01:05:50.949954 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.952630 master-0 kubenswrapper[33142]: I1204 01:05:50.952592 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:50.966950 master-0 kubenswrapper[33142]: I1204 01:05:50.966888 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhqjt\" (UniqueName: \"kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt\") pod \"nova-metadata-0\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " pod="openstack/nova-metadata-0" Dec 04 01:05:51.057342 master-0 kubenswrapper[33142]: I1204 01:05:51.057182 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.057560 master-0 kubenswrapper[33142]: I1204 01:05:51.057373 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.057560 master-0 kubenswrapper[33142]: I1204 01:05:51.057401 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.057560 master-0 kubenswrapper[33142]: I1204 01:05:51.057459 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4b9\" (UniqueName: \"kubernetes.io/projected/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-kube-api-access-rg4b9\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.057560 master-0 kubenswrapper[33142]: I1204 01:05:51.057532 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.061567 master-0 kubenswrapper[33142]: I1204 01:05:51.061518 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.061960 master-0 kubenswrapper[33142]: I1204 01:05:51.061901 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.062199 master-0 kubenswrapper[33142]: I1204 01:05:51.062164 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.063898 master-0 kubenswrapper[33142]: I1204 01:05:51.063851 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.074101 master-0 kubenswrapper[33142]: I1204 01:05:51.074035 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4b9\" (UniqueName: \"kubernetes.io/projected/d4fe8a85-c0d8-4688-a1d0-3fdea2159e78-kube-api-access-rg4b9\") pod \"nova-cell1-novncproxy-0\" (UID: \"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.106368 master-0 kubenswrapper[33142]: I1204 01:05:51.106317 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:05:51.154666 master-0 kubenswrapper[33142]: I1204 01:05:51.154578 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:51.621664 master-0 kubenswrapper[33142]: I1204 01:05:51.621003 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:05:51.627250 master-0 kubenswrapper[33142]: W1204 01:05:51.627209 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f2994e_d176_484f_ae68_675829aca4df.slice/crio-6cdfdf7590fc02eedeb4a6d83f82d7fa74cb48b22bedef6a95a041d413912de3 WatchSource:0}: Error finding container 6cdfdf7590fc02eedeb4a6d83f82d7fa74cb48b22bedef6a95a041d413912de3: Status 404 returned error can't find the container with id 6cdfdf7590fc02eedeb4a6d83f82d7fa74cb48b22bedef6a95a041d413912de3 Dec 04 01:05:51.816075 master-0 kubenswrapper[33142]: W1204 01:05:51.816033 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4fe8a85_c0d8_4688_a1d0_3fdea2159e78.slice/crio-0a48759c8bfcf7ba50b82417ae6211caf1f47396d6e1e21d64bdf27223fbbb90 WatchSource:0}: Error finding container 0a48759c8bfcf7ba50b82417ae6211caf1f47396d6e1e21d64bdf27223fbbb90: Status 404 returned error can't find the container with id 0a48759c8bfcf7ba50b82417ae6211caf1f47396d6e1e21d64bdf27223fbbb90 Dec 04 01:05:51.817921 master-0 kubenswrapper[33142]: I1204 01:05:51.817665 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 01:05:51.913079 master-0 kubenswrapper[33142]: I1204 01:05:51.912172 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c981842-a6cd-4dbe-b9d1-37d1628394fe" path="/var/lib/kubelet/pods/7c981842-a6cd-4dbe-b9d1-37d1628394fe/volumes" Dec 04 01:05:51.913224 master-0 kubenswrapper[33142]: I1204 01:05:51.913208 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebca5772-11a8-43be-83e8-8a3825f1dc5d" path="/var/lib/kubelet/pods/ebca5772-11a8-43be-83e8-8a3825f1dc5d/volumes" Dec 04 01:05:52.664586 master-0 kubenswrapper[33142]: I1204 01:05:52.664436 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78","Type":"ContainerStarted","Data":"fef837a4dc306808418f260800cc848dae9cbf5f40915f8917a349bdcece16d7"} Dec 04 01:05:52.664586 master-0 kubenswrapper[33142]: I1204 01:05:52.664517 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"d4fe8a85-c0d8-4688-a1d0-3fdea2159e78","Type":"ContainerStarted","Data":"0a48759c8bfcf7ba50b82417ae6211caf1f47396d6e1e21d64bdf27223fbbb90"} Dec 04 01:05:52.671762 master-0 kubenswrapper[33142]: I1204 01:05:52.671688 33142 generic.go:334] "Generic (PLEG): container finished" podID="832a43d4-2b26-4222-afbe-269bd491a49c" containerID="c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366" exitCode=0 Dec 04 01:05:52.672007 master-0 kubenswrapper[33142]: I1204 01:05:52.671788 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerDied","Data":"c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366"} Dec 04 01:05:52.675106 master-0 kubenswrapper[33142]: I1204 01:05:52.674919 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerStarted","Data":"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9"} Dec 04 01:05:52.675106 master-0 kubenswrapper[33142]: I1204 01:05:52.675024 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerStarted","Data":"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1"} Dec 04 01:05:52.675106 master-0 kubenswrapper[33142]: I1204 01:05:52.675037 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerStarted","Data":"6cdfdf7590fc02eedeb4a6d83f82d7fa74cb48b22bedef6a95a041d413912de3"} Dec 04 01:05:52.696291 master-0 kubenswrapper[33142]: I1204 01:05:52.696210 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-novncproxy-0" podStartSLOduration=2.696183885 podStartE2EDuration="2.696183885s" podCreationTimestamp="2025-12-04 01:05:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:52.691705849 +0000 UTC m=+1125.093707709" watchObservedRunningTime="2025-12-04 01:05:52.696183885 +0000 UTC m=+1125.098185735" Dec 04 01:05:52.719958 master-0 kubenswrapper[33142]: I1204 01:05:52.717453 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=2.717429843 podStartE2EDuration="2.717429843s" podCreationTimestamp="2025-12-04 01:05:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:52.715593112 +0000 UTC m=+1125.117594962" watchObservedRunningTime="2025-12-04 01:05:52.717429843 +0000 UTC m=+1125.119431703" Dec 04 01:05:53.799096 master-0 kubenswrapper[33142]: I1204 01:05:53.799025 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 01:05:53.799662 master-0 kubenswrapper[33142]: I1204 01:05:53.799547 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 01:05:53.802054 master-0 kubenswrapper[33142]: I1204 01:05:53.801821 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 01:05:53.805224 master-0 kubenswrapper[33142]: I1204 01:05:53.805197 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 01:05:54.703229 master-0 kubenswrapper[33142]: I1204 01:05:54.703165 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:54.703229 master-0 kubenswrapper[33142]: I1204 01:05:54.703222 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:05:54.706761 master-0 kubenswrapper[33142]: I1204 01:05:54.706679 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerStarted","Data":"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d"} Dec 04 01:05:54.706958 master-0 kubenswrapper[33142]: I1204 01:05:54.706896 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 01:05:54.711355 master-0 kubenswrapper[33142]: I1204 01:05:54.711274 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 01:05:54.739588 master-0 kubenswrapper[33142]: I1204 01:05:54.739488 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-q2x64" podStartSLOduration=6.200009533 podStartE2EDuration="8.739458196s" podCreationTimestamp="2025-12-04 01:05:46 +0000 UTC" firstStartedPulling="2025-12-04 01:05:50.612071503 +0000 UTC m=+1123.014073353" lastFinishedPulling="2025-12-04 01:05:53.151520166 +0000 UTC m=+1125.553522016" observedRunningTime="2025-12-04 01:05:54.729254569 +0000 UTC m=+1127.131256419" watchObservedRunningTime="2025-12-04 01:05:54.739458196 +0000 UTC m=+1127.141460046" Dec 04 01:05:55.037281 master-0 kubenswrapper[33142]: I1204 01:05:55.030212 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7b6fbb8797-78ksw"] Dec 04 01:05:55.044586 master-0 kubenswrapper[33142]: I1204 01:05:55.039132 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.056617 master-0 kubenswrapper[33142]: I1204 01:05:55.049859 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7b6fbb8797-78ksw"] Dec 04 01:05:55.162369 master-0 kubenswrapper[33142]: I1204 01:05:55.162295 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxm4\" (UniqueName: \"kubernetes.io/projected/99626cca-9a85-4c6b-a263-ab52a57d4dee-kube-api-access-8dxm4\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.163478 master-0 kubenswrapper[33142]: I1204 01:05:55.163371 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-swift-storage-0\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.166080 master-0 kubenswrapper[33142]: I1204 01:05:55.164582 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-svc\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.166080 master-0 kubenswrapper[33142]: I1204 01:05:55.164695 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-config\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.166080 master-0 kubenswrapper[33142]: I1204 01:05:55.164920 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-nb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.166080 master-0 kubenswrapper[33142]: I1204 01:05:55.165056 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-sb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.269080 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxm4\" (UniqueName: \"kubernetes.io/projected/99626cca-9a85-4c6b-a263-ab52a57d4dee-kube-api-access-8dxm4\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.270152 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-swift-storage-0\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.270407 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-svc\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.270468 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-config\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.270563 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-nb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.270611 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-sb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.272433 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-svc\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.272470 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-config\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.272875 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-dns-swift-storage-0\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274063 master-0 kubenswrapper[33142]: I1204 01:05:55.273575 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-nb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.274694 master-0 kubenswrapper[33142]: I1204 01:05:55.274387 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/99626cca-9a85-4c6b-a263-ab52a57d4dee-ovsdbserver-sb\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.290025 master-0 kubenswrapper[33142]: I1204 01:05:55.289907 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxm4\" (UniqueName: \"kubernetes.io/projected/99626cca-9a85-4c6b-a263-ab52a57d4dee-kube-api-access-8dxm4\") pod \"dnsmasq-dns-7b6fbb8797-78ksw\" (UID: \"99626cca-9a85-4c6b-a263-ab52a57d4dee\") " pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.388313 master-0 kubenswrapper[33142]: I1204 01:05:55.388211 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:05:55.765337 master-0 kubenswrapper[33142]: I1204 01:05:55.764172 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-gpn4w" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" probeResult="failure" output=< Dec 04 01:05:55.765337 master-0 kubenswrapper[33142]: timeout: failed to connect service ":50051" within 1s Dec 04 01:05:55.765337 master-0 kubenswrapper[33142]: > Dec 04 01:05:55.998631 master-0 kubenswrapper[33142]: I1204 01:05:55.998561 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7b6fbb8797-78ksw"] Dec 04 01:05:56.001981 master-0 kubenswrapper[33142]: W1204 01:05:56.001865 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99626cca_9a85_4c6b_a263_ab52a57d4dee.slice/crio-4e2be49127c33f01c297ebde5b9210f396ecb35a2804bbff11af1ba10a13ea97 WatchSource:0}: Error finding container 4e2be49127c33f01c297ebde5b9210f396ecb35a2804bbff11af1ba10a13ea97: Status 404 returned error can't find the container with id 4e2be49127c33f01c297ebde5b9210f396ecb35a2804bbff11af1ba10a13ea97 Dec 04 01:05:56.107481 master-0 kubenswrapper[33142]: I1204 01:05:56.107404 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:05:56.109340 master-0 kubenswrapper[33142]: I1204 01:05:56.109247 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:05:56.154963 master-0 kubenswrapper[33142]: I1204 01:05:56.154883 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:05:56.774729 master-0 kubenswrapper[33142]: I1204 01:05:56.774633 33142 generic.go:334] "Generic (PLEG): container finished" podID="99626cca-9a85-4c6b-a263-ab52a57d4dee" containerID="f46dac08d8abef696d15d2ea70526efab9cf2d1c62fad681e429e1c7830fc874" exitCode=0 Dec 04 01:05:56.778599 master-0 kubenswrapper[33142]: I1204 01:05:56.777958 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" event={"ID":"99626cca-9a85-4c6b-a263-ab52a57d4dee","Type":"ContainerDied","Data":"f46dac08d8abef696d15d2ea70526efab9cf2d1c62fad681e429e1c7830fc874"} Dec 04 01:05:56.778599 master-0 kubenswrapper[33142]: I1204 01:05:56.778008 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" event={"ID":"99626cca-9a85-4c6b-a263-ab52a57d4dee","Type":"ContainerStarted","Data":"4e2be49127c33f01c297ebde5b9210f396ecb35a2804bbff11af1ba10a13ea97"} Dec 04 01:05:57.488720 master-0 kubenswrapper[33142]: I1204 01:05:57.488645 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:57.489259 master-0 kubenswrapper[33142]: I1204 01:05:57.489077 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:57.561442 master-0 kubenswrapper[33142]: I1204 01:05:57.561401 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:05:57.711059 master-0 kubenswrapper[33142]: I1204 01:05:57.710565 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:05:57.791334 master-0 kubenswrapper[33142]: I1204 01:05:57.791109 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" event={"ID":"99626cca-9a85-4c6b-a263-ab52a57d4dee","Type":"ContainerStarted","Data":"328f968dbf755f8022d3315c31815e4ce0f82dc4f404d81b557b2160594e1877"} Dec 04 01:05:57.791825 master-0 kubenswrapper[33142]: I1204 01:05:57.791716 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-log" containerID="cri-o://94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7" gracePeriod=30 Dec 04 01:05:57.791989 master-0 kubenswrapper[33142]: I1204 01:05:57.791863 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-api" containerID="cri-o://ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f" gracePeriod=30 Dec 04 01:05:57.838981 master-0 kubenswrapper[33142]: I1204 01:05:57.832235 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" podStartSLOduration=3.832209968 podStartE2EDuration="3.832209968s" podCreationTimestamp="2025-12-04 01:05:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:05:57.822539105 +0000 UTC m=+1130.224540955" watchObservedRunningTime="2025-12-04 01:05:57.832209968 +0000 UTC m=+1130.234211818" Dec 04 01:05:58.826495 master-0 kubenswrapper[33142]: I1204 01:05:58.826411 33142 generic.go:334] "Generic (PLEG): container finished" podID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerID="94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7" exitCode=143 Dec 04 01:05:58.827192 master-0 kubenswrapper[33142]: I1204 01:05:58.826479 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerDied","Data":"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7"} Dec 04 01:05:58.827507 master-0 kubenswrapper[33142]: I1204 01:05:58.827451 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:06:01.107407 master-0 kubenswrapper[33142]: I1204 01:06:01.107326 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 01:06:01.107407 master-0 kubenswrapper[33142]: I1204 01:06:01.107395 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 01:06:01.156426 master-0 kubenswrapper[33142]: I1204 01:06:01.156184 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:06:01.189249 master-0 kubenswrapper[33142]: I1204 01:06:01.185859 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:06:01.702062 master-0 kubenswrapper[33142]: I1204 01:06:01.701038 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:01.717514 master-0 kubenswrapper[33142]: I1204 01:06:01.717412 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle\") pod \"d75ef889-611f-408f-8f54-f7b8d18e16df\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " Dec 04 01:06:01.717875 master-0 kubenswrapper[33142]: I1204 01:06:01.717621 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7vs8\" (UniqueName: \"kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8\") pod \"d75ef889-611f-408f-8f54-f7b8d18e16df\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " Dec 04 01:06:01.717986 master-0 kubenswrapper[33142]: I1204 01:06:01.717916 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs\") pod \"d75ef889-611f-408f-8f54-f7b8d18e16df\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " Dec 04 01:06:01.718348 master-0 kubenswrapper[33142]: I1204 01:06:01.718311 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data\") pod \"d75ef889-611f-408f-8f54-f7b8d18e16df\" (UID: \"d75ef889-611f-408f-8f54-f7b8d18e16df\") " Dec 04 01:06:01.719090 master-0 kubenswrapper[33142]: I1204 01:06:01.719052 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs" (OuterVolumeSpecName: "logs") pod "d75ef889-611f-408f-8f54-f7b8d18e16df" (UID: "d75ef889-611f-408f-8f54-f7b8d18e16df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:01.720136 master-0 kubenswrapper[33142]: I1204 01:06:01.720103 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d75ef889-611f-408f-8f54-f7b8d18e16df-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:01.722605 master-0 kubenswrapper[33142]: I1204 01:06:01.722470 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8" (OuterVolumeSpecName: "kube-api-access-s7vs8") pod "d75ef889-611f-408f-8f54-f7b8d18e16df" (UID: "d75ef889-611f-408f-8f54-f7b8d18e16df"). InnerVolumeSpecName "kube-api-access-s7vs8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:01.778486 master-0 kubenswrapper[33142]: I1204 01:06:01.778405 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data" (OuterVolumeSpecName: "config-data") pod "d75ef889-611f-408f-8f54-f7b8d18e16df" (UID: "d75ef889-611f-408f-8f54-f7b8d18e16df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:01.788329 master-0 kubenswrapper[33142]: I1204 01:06:01.788251 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d75ef889-611f-408f-8f54-f7b8d18e16df" (UID: "d75ef889-611f-408f-8f54-f7b8d18e16df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:01.824824 master-0 kubenswrapper[33142]: I1204 01:06:01.824655 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:01.824824 master-0 kubenswrapper[33142]: I1204 01:06:01.824722 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s7vs8\" (UniqueName: \"kubernetes.io/projected/d75ef889-611f-408f-8f54-f7b8d18e16df-kube-api-access-s7vs8\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:01.824824 master-0 kubenswrapper[33142]: I1204 01:06:01.824738 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d75ef889-611f-408f-8f54-f7b8d18e16df-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:01.874514 master-0 kubenswrapper[33142]: I1204 01:06:01.874363 33142 generic.go:334] "Generic (PLEG): container finished" podID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerID="ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f" exitCode=0 Dec 04 01:06:01.883046 master-0 kubenswrapper[33142]: I1204 01:06:01.874523 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerDied","Data":"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f"} Dec 04 01:06:01.883046 master-0 kubenswrapper[33142]: I1204 01:06:01.874583 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"d75ef889-611f-408f-8f54-f7b8d18e16df","Type":"ContainerDied","Data":"8997eb9bde99683d5020f036752e9ac9890bb70c8c39d28bee02cc9b625a563d"} Dec 04 01:06:01.883046 master-0 kubenswrapper[33142]: I1204 01:06:01.874605 33142 scope.go:117] "RemoveContainer" containerID="ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f" Dec 04 01:06:01.883649 master-0 kubenswrapper[33142]: I1204 01:06:01.883587 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:01.897158 master-0 kubenswrapper[33142]: I1204 01:06:01.895801 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-novncproxy-0" Dec 04 01:06:01.950151 master-0 kubenswrapper[33142]: I1204 01:06:01.950091 33142 scope.go:117] "RemoveContainer" containerID="94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7" Dec 04 01:06:02.061652 master-0 kubenswrapper[33142]: I1204 01:06:02.060246 33142 scope.go:117] "RemoveContainer" containerID="ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f" Dec 04 01:06:02.063571 master-0 kubenswrapper[33142]: E1204 01:06:02.063519 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f\": container with ID starting with ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f not found: ID does not exist" containerID="ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f" Dec 04 01:06:02.063649 master-0 kubenswrapper[33142]: I1204 01:06:02.063583 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f"} err="failed to get container status \"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f\": rpc error: code = NotFound desc = could not find container \"ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f\": container with ID starting with ad1aeddde6296627478d9f11c83c11707efc5e0a83ce86f89e40f0e37c948a9f not found: ID does not exist" Dec 04 01:06:02.063649 master-0 kubenswrapper[33142]: I1204 01:06:02.063616 33142 scope.go:117] "RemoveContainer" containerID="94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7" Dec 04 01:06:02.064109 master-0 kubenswrapper[33142]: E1204 01:06:02.064057 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7\": container with ID starting with 94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7 not found: ID does not exist" containerID="94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7" Dec 04 01:06:02.064181 master-0 kubenswrapper[33142]: I1204 01:06:02.064125 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7"} err="failed to get container status \"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7\": rpc error: code = NotFound desc = could not find container \"94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7\": container with ID starting with 94e4e7fb3a9f245b51ba1a8417389918ba045fcacdf1617211295e2caae475e7 not found: ID does not exist" Dec 04 01:06:02.095913 master-0 kubenswrapper[33142]: I1204 01:06:02.095809 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:02.112629 master-0 kubenswrapper[33142]: I1204 01:06:02.112542 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:02.123464 master-0 kubenswrapper[33142]: I1204 01:06:02.123178 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.22:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:02.123857 master-0 kubenswrapper[33142]: I1204 01:06:02.123821 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.22:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:02.142872 master-0 kubenswrapper[33142]: I1204 01:06:02.142736 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:02.144245 master-0 kubenswrapper[33142]: E1204 01:06:02.144195 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-log" Dec 04 01:06:02.144326 master-0 kubenswrapper[33142]: I1204 01:06:02.144246 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-log" Dec 04 01:06:02.144326 master-0 kubenswrapper[33142]: E1204 01:06:02.144278 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-api" Dec 04 01:06:02.144326 master-0 kubenswrapper[33142]: I1204 01:06:02.144289 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-api" Dec 04 01:06:02.144871 master-0 kubenswrapper[33142]: I1204 01:06:02.144827 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-log" Dec 04 01:06:02.145009 master-0 kubenswrapper[33142]: I1204 01:06:02.144978 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" containerName="nova-api-api" Dec 04 01:06:02.146971 master-0 kubenswrapper[33142]: I1204 01:06:02.146912 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:02.150005 master-0 kubenswrapper[33142]: I1204 01:06:02.149911 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 01:06:02.150459 master-0 kubenswrapper[33142]: I1204 01:06:02.150418 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-internal-svc" Dec 04 01:06:02.150613 master-0 kubenswrapper[33142]: I1204 01:06:02.150581 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-public-svc" Dec 04 01:06:02.173587 master-0 kubenswrapper[33142]: I1204 01:06:02.173489 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:02.205494 master-0 kubenswrapper[33142]: I1204 01:06:02.205413 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-cell-mapping-g9gs4"] Dec 04 01:06:02.207817 master-0 kubenswrapper[33142]: I1204 01:06:02.207784 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.224508 master-0 kubenswrapper[33142]: I1204 01:06:02.219700 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-manage-config-data" Dec 04 01:06:02.224508 master-0 kubenswrapper[33142]: I1204 01:06:02.220311 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-manage-scripts" Dec 04 01:06:02.229974 master-0 kubenswrapper[33142]: I1204 01:06:02.229663 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.229974 master-0 kubenswrapper[33142]: I1204 01:06:02.229788 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.229974 master-0 kubenswrapper[33142]: I1204 01:06:02.229901 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.230196 master-0 kubenswrapper[33142]: I1204 01:06:02.230006 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.230196 master-0 kubenswrapper[33142]: I1204 01:06:02.230037 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.233690 master-0 kubenswrapper[33142]: I1204 01:06:02.232179 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.285508 master-0 kubenswrapper[33142]: I1204 01:06:02.285191 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-cell-mapping-g9gs4"] Dec 04 01:06:02.299894 master-0 kubenswrapper[33142]: I1204 01:06:02.299157 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-host-discover-v7zpg"] Dec 04 01:06:02.303843 master-0 kubenswrapper[33142]: I1204 01:06:02.302384 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.311737 master-0 kubenswrapper[33142]: I1204 01:06:02.311696 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-host-discover-v7zpg"] Dec 04 01:06:02.338356 master-0 kubenswrapper[33142]: I1204 01:06:02.338274 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.338541 master-0 kubenswrapper[33142]: I1204 01:06:02.338386 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.338541 master-0 kubenswrapper[33142]: I1204 01:06:02.338477 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.338617 master-0 kubenswrapper[33142]: I1204 01:06:02.338570 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52829\" (UniqueName: \"kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.338873 master-0 kubenswrapper[33142]: I1204 01:06:02.338847 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.338968 master-0 kubenswrapper[33142]: I1204 01:06:02.338915 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339016 master-0 kubenswrapper[33142]: I1204 01:06:02.338976 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dkk\" (UniqueName: \"kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.339063 master-0 kubenswrapper[33142]: I1204 01:06:02.338998 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339165 master-0 kubenswrapper[33142]: I1204 01:06:02.339141 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339427 master-0 kubenswrapper[33142]: I1204 01:06:02.339406 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339485 master-0 kubenswrapper[33142]: I1204 01:06:02.339436 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339485 master-0 kubenswrapper[33142]: I1204 01:06:02.339472 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.339548 master-0 kubenswrapper[33142]: I1204 01:06:02.339522 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.339874 master-0 kubenswrapper[33142]: I1204 01:06:02.339814 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.340263 master-0 kubenswrapper[33142]: I1204 01:06:02.340212 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.345611 master-0 kubenswrapper[33142]: I1204 01:06:02.345561 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.345974 master-0 kubenswrapper[33142]: I1204 01:06:02.345896 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.346337 master-0 kubenswrapper[33142]: I1204 01:06:02.346270 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.358746 master-0 kubenswrapper[33142]: I1204 01:06:02.358681 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.359388 master-0 kubenswrapper[33142]: I1204 01:06:02.359345 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42\") pod \"nova-api-0\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " pod="openstack/nova-api-0" Dec 04 01:06:02.444378 master-0 kubenswrapper[33142]: I1204 01:06:02.444277 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-52829\" (UniqueName: \"kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.444704 master-0 kubenswrapper[33142]: I1204 01:06:02.444403 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.444704 master-0 kubenswrapper[33142]: I1204 01:06:02.444488 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dkk\" (UniqueName: \"kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.444846 master-0 kubenswrapper[33142]: I1204 01:06:02.444732 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.444905 master-0 kubenswrapper[33142]: I1204 01:06:02.444849 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.445031 master-0 kubenswrapper[33142]: I1204 01:06:02.445005 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.445096 master-0 kubenswrapper[33142]: I1204 01:06:02.445052 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.445096 master-0 kubenswrapper[33142]: I1204 01:06:02.445090 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.451021 master-0 kubenswrapper[33142]: I1204 01:06:02.449589 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.451021 master-0 kubenswrapper[33142]: I1204 01:06:02.450650 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.451021 master-0 kubenswrapper[33142]: I1204 01:06:02.450880 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.451424 master-0 kubenswrapper[33142]: I1204 01:06:02.451186 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.451978 master-0 kubenswrapper[33142]: I1204 01:06:02.451950 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.453662 master-0 kubenswrapper[33142]: I1204 01:06:02.453640 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.467761 master-0 kubenswrapper[33142]: I1204 01:06:02.467694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dkk\" (UniqueName: \"kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk\") pod \"nova-cell1-cell-mapping-g9gs4\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.468961 master-0 kubenswrapper[33142]: I1204 01:06:02.468937 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-52829\" (UniqueName: \"kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829\") pod \"nova-cell1-host-discover-v7zpg\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:02.473034 master-0 kubenswrapper[33142]: I1204 01:06:02.472975 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:02.544820 master-0 kubenswrapper[33142]: I1204 01:06:02.544767 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:02.623051 master-0 kubenswrapper[33142]: I1204 01:06:02.622165 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:03.063805 master-0 kubenswrapper[33142]: I1204 01:06:03.063732 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:03.205448 master-0 kubenswrapper[33142]: I1204 01:06:03.205376 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-cell-mapping-g9gs4"] Dec 04 01:06:03.291304 master-0 kubenswrapper[33142]: I1204 01:06:03.291184 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-host-discover-v7zpg"] Dec 04 01:06:03.304828 master-0 kubenswrapper[33142]: W1204 01:06:03.304748 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b97a2d2_bdcb_4bc1_83e3_32a6271b948d.slice/crio-867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f WatchSource:0}: Error finding container 867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f: Status 404 returned error can't find the container with id 867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f Dec 04 01:06:03.916966 master-0 kubenswrapper[33142]: I1204 01:06:03.913973 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d75ef889-611f-408f-8f54-f7b8d18e16df" path="/var/lib/kubelet/pods/d75ef889-611f-408f-8f54-f7b8d18e16df/volumes" Dec 04 01:06:03.981694 master-0 kubenswrapper[33142]: I1204 01:06:03.981603 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerStarted","Data":"607c3ffbd1a3bd670503acd9c79298ad4e8c1b3423a6a56ec98f3ca0e53e88e4"} Dec 04 01:06:03.981694 master-0 kubenswrapper[33142]: I1204 01:06:03.981688 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerStarted","Data":"425a48612f08a21f66f377361609c75ff7e57722567793d28533efeae0cd8800"} Dec 04 01:06:03.981694 master-0 kubenswrapper[33142]: I1204 01:06:03.981704 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerStarted","Data":"34410feaa76b0ff024162549be4b71269eab023cb925d27e8c12efcd7840311b"} Dec 04 01:06:03.984453 master-0 kubenswrapper[33142]: I1204 01:06:03.984405 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-g9gs4" event={"ID":"351a4442-07ac-4457-93a0-be72109c30e8","Type":"ContainerStarted","Data":"cc6451d8ffcc254751afacadd21039d7b38877b493b218fe6d4b2ec647bae4ae"} Dec 04 01:06:03.984552 master-0 kubenswrapper[33142]: I1204 01:06:03.984455 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-g9gs4" event={"ID":"351a4442-07ac-4457-93a0-be72109c30e8","Type":"ContainerStarted","Data":"fb9ff0ad364134ae91627efb5b6c4af2a6cde89b0f4d23a95d5b6bee1ac827b6"} Dec 04 01:06:03.987013 master-0 kubenswrapper[33142]: I1204 01:06:03.986834 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-v7zpg" event={"ID":"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d","Type":"ContainerStarted","Data":"99e568d30abf731571f0e75d4ecff9d0473509b33ceb2b8ac456597685913255"} Dec 04 01:06:03.987013 master-0 kubenswrapper[33142]: I1204 01:06:03.986904 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-v7zpg" event={"ID":"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d","Type":"ContainerStarted","Data":"867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f"} Dec 04 01:06:04.030496 master-0 kubenswrapper[33142]: I1204 01:06:04.030316 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.030287465 podStartE2EDuration="2.030287465s" podCreationTimestamp="2025-12-04 01:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:04.009697755 +0000 UTC m=+1136.411699625" watchObservedRunningTime="2025-12-04 01:06:04.030287465 +0000 UTC m=+1136.432289325" Dec 04 01:06:04.049408 master-0 kubenswrapper[33142]: I1204 01:06:04.049220 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-host-discover-v7zpg" podStartSLOduration=2.049188547 podStartE2EDuration="2.049188547s" podCreationTimestamp="2025-12-04 01:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:04.037263102 +0000 UTC m=+1136.439264952" watchObservedRunningTime="2025-12-04 01:06:04.049188547 +0000 UTC m=+1136.451190407" Dec 04 01:06:04.067227 master-0 kubenswrapper[33142]: I1204 01:06:04.067134 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-cell-mapping-g9gs4" podStartSLOduration=2.067111392 podStartE2EDuration="2.067111392s" podCreationTimestamp="2025-12-04 01:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:04.053849239 +0000 UTC m=+1136.455851119" watchObservedRunningTime="2025-12-04 01:06:04.067111392 +0000 UTC m=+1136.469113242" Dec 04 01:06:05.391785 master-0 kubenswrapper[33142]: I1204 01:06:05.391700 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-7b6fbb8797-78ksw" Dec 04 01:06:05.498995 master-0 kubenswrapper[33142]: I1204 01:06:05.498651 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:06:05.499257 master-0 kubenswrapper[33142]: I1204 01:06:05.499179 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="dnsmasq-dns" containerID="cri-o://52978f34185694577001e152fe7e748d9418ab710e169fe28cc05d54532c17c1" gracePeriod=10 Dec 04 01:06:05.776196 master-0 kubenswrapper[33142]: I1204 01:06:05.776089 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-gpn4w" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" probeResult="failure" output=< Dec 04 01:06:05.776196 master-0 kubenswrapper[33142]: timeout: failed to connect service ":50051" within 1s Dec 04 01:06:05.776196 master-0 kubenswrapper[33142]: > Dec 04 01:06:06.076713 master-0 kubenswrapper[33142]: I1204 01:06:06.076652 33142 generic.go:334] "Generic (PLEG): container finished" podID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerID="52978f34185694577001e152fe7e748d9418ab710e169fe28cc05d54532c17c1" exitCode=0 Dec 04 01:06:06.077012 master-0 kubenswrapper[33142]: I1204 01:06:06.076988 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" event={"ID":"acdb4202-4e28-4123-ad00-808c14eb96b3","Type":"ContainerDied","Data":"52978f34185694577001e152fe7e748d9418ab710e169fe28cc05d54532c17c1"} Dec 04 01:06:06.160830 master-0 kubenswrapper[33142]: I1204 01:06:06.160542 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:06:06.203481 master-0 kubenswrapper[33142]: I1204 01:06:06.203411 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.203852 master-0 kubenswrapper[33142]: I1204 01:06:06.203504 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.203852 master-0 kubenswrapper[33142]: I1204 01:06:06.203549 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.203852 master-0 kubenswrapper[33142]: I1204 01:06:06.203688 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.203852 master-0 kubenswrapper[33142]: I1204 01:06:06.203795 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffff4\" (UniqueName: \"kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.204074 master-0 kubenswrapper[33142]: I1204 01:06:06.203951 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb\") pod \"acdb4202-4e28-4123-ad00-808c14eb96b3\" (UID: \"acdb4202-4e28-4123-ad00-808c14eb96b3\") " Dec 04 01:06:06.233977 master-0 kubenswrapper[33142]: I1204 01:06:06.232555 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4" (OuterVolumeSpecName: "kube-api-access-ffff4") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "kube-api-access-ffff4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:06.278102 master-0 kubenswrapper[33142]: I1204 01:06:06.277982 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:06:06.307568 master-0 kubenswrapper[33142]: I1204 01:06:06.307292 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config" (OuterVolumeSpecName: "config") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:06:06.308180 master-0 kubenswrapper[33142]: I1204 01:06:06.308089 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:06:06.315404 master-0 kubenswrapper[33142]: I1204 01:06:06.315283 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:06:06.320966 master-0 kubenswrapper[33142]: I1204 01:06:06.319232 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "acdb4202-4e28-4123-ad00-808c14eb96b3" (UID: "acdb4202-4e28-4123-ad00-808c14eb96b3"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:06:06.324382 master-0 kubenswrapper[33142]: I1204 01:06:06.324319 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ffff4\" (UniqueName: \"kubernetes.io/projected/acdb4202-4e28-4123-ad00-808c14eb96b3-kube-api-access-ffff4\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:06.324382 master-0 kubenswrapper[33142]: I1204 01:06:06.324369 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:06.324540 master-0 kubenswrapper[33142]: I1204 01:06:06.324387 33142 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:06.324540 master-0 kubenswrapper[33142]: I1204 01:06:06.324405 33142 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:06.324540 master-0 kubenswrapper[33142]: I1204 01:06:06.324419 33142 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:06.324540 master-0 kubenswrapper[33142]: I1204 01:06:06.324431 33142 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/acdb4202-4e28-4123-ad00-808c14eb96b3-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:07.114723 master-0 kubenswrapper[33142]: I1204 01:06:07.114637 33142 generic.go:334] "Generic (PLEG): container finished" podID="6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" containerID="99e568d30abf731571f0e75d4ecff9d0473509b33ceb2b8ac456597685913255" exitCode=0 Dec 04 01:06:07.115873 master-0 kubenswrapper[33142]: I1204 01:06:07.115830 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-v7zpg" event={"ID":"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d","Type":"ContainerDied","Data":"99e568d30abf731571f0e75d4ecff9d0473509b33ceb2b8ac456597685913255"} Dec 04 01:06:07.123270 master-0 kubenswrapper[33142]: I1204 01:06:07.123177 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" event={"ID":"acdb4202-4e28-4123-ad00-808c14eb96b3","Type":"ContainerDied","Data":"17271f6d410dee63df0ad99e40c26e0d2ef2b6a0b7bb4dddfbba1cb2d28909bd"} Dec 04 01:06:07.123517 master-0 kubenswrapper[33142]: I1204 01:06:07.123321 33142 scope.go:117] "RemoveContainer" containerID="52978f34185694577001e152fe7e748d9418ab710e169fe28cc05d54532c17c1" Dec 04 01:06:07.123794 master-0 kubenswrapper[33142]: I1204 01:06:07.123747 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-799464c6f-vmsnj" Dec 04 01:06:07.167409 master-0 kubenswrapper[33142]: I1204 01:06:07.167229 33142 scope.go:117] "RemoveContainer" containerID="583e1217d2c1dcf05b2a2fd4e2be4684b1cfa8bd55031d92030b9459cb61404d" Dec 04 01:06:07.199028 master-0 kubenswrapper[33142]: I1204 01:06:07.198147 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:06:07.211695 master-0 kubenswrapper[33142]: I1204 01:06:07.211330 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-799464c6f-vmsnj"] Dec 04 01:06:07.580490 master-0 kubenswrapper[33142]: I1204 01:06:07.579996 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:06:07.677566 master-0 kubenswrapper[33142]: I1204 01:06:07.677482 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:06:07.923461 master-0 kubenswrapper[33142]: I1204 01:06:07.923348 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" path="/var/lib/kubelet/pods/acdb4202-4e28-4123-ad00-808c14eb96b3/volumes" Dec 04 01:06:08.140799 master-0 kubenswrapper[33142]: I1204 01:06:08.140706 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-q2x64" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="registry-server" containerID="cri-o://dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d" gracePeriod=2 Dec 04 01:06:08.705801 master-0 kubenswrapper[33142]: I1204 01:06:08.705722 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:08.812661 master-0 kubenswrapper[33142]: I1204 01:06:08.812361 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle\") pod \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " Dec 04 01:06:08.812661 master-0 kubenswrapper[33142]: I1204 01:06:08.812480 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52829\" (UniqueName: \"kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829\") pod \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " Dec 04 01:06:08.813812 master-0 kubenswrapper[33142]: I1204 01:06:08.812970 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts\") pod \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " Dec 04 01:06:08.813812 master-0 kubenswrapper[33142]: I1204 01:06:08.813103 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data\") pod \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\" (UID: \"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d\") " Dec 04 01:06:08.817338 master-0 kubenswrapper[33142]: I1204 01:06:08.817251 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829" (OuterVolumeSpecName: "kube-api-access-52829") pod "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" (UID: "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d"). InnerVolumeSpecName "kube-api-access-52829". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:08.818266 master-0 kubenswrapper[33142]: I1204 01:06:08.818138 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts" (OuterVolumeSpecName: "scripts") pod "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" (UID: "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:08.854232 master-0 kubenswrapper[33142]: I1204 01:06:08.854143 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data" (OuterVolumeSpecName: "config-data") pod "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" (UID: "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:08.875121 master-0 kubenswrapper[33142]: I1204 01:06:08.875030 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" (UID: "6b97a2d2-bdcb-4bc1-83e3-32a6271b948d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:08.916409 master-0 kubenswrapper[33142]: I1204 01:06:08.916309 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-52829\" (UniqueName: \"kubernetes.io/projected/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-kube-api-access-52829\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:08.916409 master-0 kubenswrapper[33142]: I1204 01:06:08.916380 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:08.916409 master-0 kubenswrapper[33142]: I1204 01:06:08.916396 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:08.916409 master-0 kubenswrapper[33142]: I1204 01:06:08.916409 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:08.946004 master-0 kubenswrapper[33142]: I1204 01:06:08.945958 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:06:09.122615 master-0 kubenswrapper[33142]: I1204 01:06:09.122519 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content\") pod \"832a43d4-2b26-4222-afbe-269bd491a49c\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " Dec 04 01:06:09.122892 master-0 kubenswrapper[33142]: I1204 01:06:09.122667 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8pkv\" (UniqueName: \"kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv\") pod \"832a43d4-2b26-4222-afbe-269bd491a49c\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " Dec 04 01:06:09.122892 master-0 kubenswrapper[33142]: I1204 01:06:09.122834 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities\") pod \"832a43d4-2b26-4222-afbe-269bd491a49c\" (UID: \"832a43d4-2b26-4222-afbe-269bd491a49c\") " Dec 04 01:06:09.124879 master-0 kubenswrapper[33142]: I1204 01:06:09.124825 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities" (OuterVolumeSpecName: "utilities") pod "832a43d4-2b26-4222-afbe-269bd491a49c" (UID: "832a43d4-2b26-4222-afbe-269bd491a49c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:09.127447 master-0 kubenswrapper[33142]: I1204 01:06:09.127368 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv" (OuterVolumeSpecName: "kube-api-access-h8pkv") pod "832a43d4-2b26-4222-afbe-269bd491a49c" (UID: "832a43d4-2b26-4222-afbe-269bd491a49c"). InnerVolumeSpecName "kube-api-access-h8pkv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:09.159057 master-0 kubenswrapper[33142]: I1204 01:06:09.158984 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-v7zpg" event={"ID":"6b97a2d2-bdcb-4bc1-83e3-32a6271b948d","Type":"ContainerDied","Data":"867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f"} Dec 04 01:06:09.159057 master-0 kubenswrapper[33142]: I1204 01:06:09.159056 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="867115f410da122cfcb5fb595c0a2703b69b0830c57e88fa1e976f601d4ee76f" Dec 04 01:06:09.160426 master-0 kubenswrapper[33142]: I1204 01:06:09.159122 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-v7zpg" Dec 04 01:06:09.168159 master-0 kubenswrapper[33142]: I1204 01:06:09.168085 33142 generic.go:334] "Generic (PLEG): container finished" podID="351a4442-07ac-4457-93a0-be72109c30e8" containerID="cc6451d8ffcc254751afacadd21039d7b38877b493b218fe6d4b2ec647bae4ae" exitCode=0 Dec 04 01:06:09.168347 master-0 kubenswrapper[33142]: I1204 01:06:09.168166 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-g9gs4" event={"ID":"351a4442-07ac-4457-93a0-be72109c30e8","Type":"ContainerDied","Data":"cc6451d8ffcc254751afacadd21039d7b38877b493b218fe6d4b2ec647bae4ae"} Dec 04 01:06:09.176571 master-0 kubenswrapper[33142]: I1204 01:06:09.176428 33142 generic.go:334] "Generic (PLEG): container finished" podID="832a43d4-2b26-4222-afbe-269bd491a49c" containerID="dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d" exitCode=0 Dec 04 01:06:09.177226 master-0 kubenswrapper[33142]: I1204 01:06:09.176722 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerDied","Data":"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d"} Dec 04 01:06:09.177226 master-0 kubenswrapper[33142]: I1204 01:06:09.176782 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-q2x64" event={"ID":"832a43d4-2b26-4222-afbe-269bd491a49c","Type":"ContainerDied","Data":"5fdb041d81440c892eaaf42c97a4fdd45f97de5f89d5ce8b587a77a09a27e8d8"} Dec 04 01:06:09.177226 master-0 kubenswrapper[33142]: I1204 01:06:09.176819 33142 scope.go:117] "RemoveContainer" containerID="dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d" Dec 04 01:06:09.177226 master-0 kubenswrapper[33142]: I1204 01:06:09.176846 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-q2x64" Dec 04 01:06:09.197119 master-0 kubenswrapper[33142]: I1204 01:06:09.196987 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "832a43d4-2b26-4222-afbe-269bd491a49c" (UID: "832a43d4-2b26-4222-afbe-269bd491a49c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:09.227253 master-0 kubenswrapper[33142]: I1204 01:06:09.227156 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h8pkv\" (UniqueName: \"kubernetes.io/projected/832a43d4-2b26-4222-afbe-269bd491a49c-kube-api-access-h8pkv\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:09.227253 master-0 kubenswrapper[33142]: I1204 01:06:09.227218 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:09.227253 master-0 kubenswrapper[33142]: I1204 01:06:09.227234 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/832a43d4-2b26-4222-afbe-269bd491a49c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:09.231657 master-0 kubenswrapper[33142]: I1204 01:06:09.231591 33142 scope.go:117] "RemoveContainer" containerID="c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366" Dec 04 01:06:09.265749 master-0 kubenswrapper[33142]: I1204 01:06:09.265692 33142 scope.go:117] "RemoveContainer" containerID="db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5" Dec 04 01:06:09.349951 master-0 kubenswrapper[33142]: I1204 01:06:09.349867 33142 scope.go:117] "RemoveContainer" containerID="dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d" Dec 04 01:06:09.352987 master-0 kubenswrapper[33142]: E1204 01:06:09.352891 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d\": container with ID starting with dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d not found: ID does not exist" containerID="dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d" Dec 04 01:06:09.353152 master-0 kubenswrapper[33142]: I1204 01:06:09.353105 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d"} err="failed to get container status \"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d\": rpc error: code = NotFound desc = could not find container \"dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d\": container with ID starting with dbccd3b38df0aa58384baa380d37ebcb904203eb6bf52cd900680b6f9e00257d not found: ID does not exist" Dec 04 01:06:09.353208 master-0 kubenswrapper[33142]: I1204 01:06:09.353160 33142 scope.go:117] "RemoveContainer" containerID="c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366" Dec 04 01:06:09.354577 master-0 kubenswrapper[33142]: E1204 01:06:09.354478 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366\": container with ID starting with c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366 not found: ID does not exist" containerID="c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366" Dec 04 01:06:09.354739 master-0 kubenswrapper[33142]: I1204 01:06:09.354594 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366"} err="failed to get container status \"c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366\": rpc error: code = NotFound desc = could not find container \"c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366\": container with ID starting with c8d0ae98c964cd26e12e5ec924900925dada32c63d27dc21b45988017995b366 not found: ID does not exist" Dec 04 01:06:09.354739 master-0 kubenswrapper[33142]: I1204 01:06:09.354634 33142 scope.go:117] "RemoveContainer" containerID="db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5" Dec 04 01:06:09.356141 master-0 kubenswrapper[33142]: E1204 01:06:09.356105 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5\": container with ID starting with db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5 not found: ID does not exist" containerID="db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5" Dec 04 01:06:09.356403 master-0 kubenswrapper[33142]: I1204 01:06:09.356154 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5"} err="failed to get container status \"db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5\": rpc error: code = NotFound desc = could not find container \"db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5\": container with ID starting with db9b4ddc6b5162ea7382796a2eb2f0565df2180314bd945751b2a4b6f75ff7d5 not found: ID does not exist" Dec 04 01:06:09.564967 master-0 kubenswrapper[33142]: I1204 01:06:09.561213 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:06:09.579966 master-0 kubenswrapper[33142]: I1204 01:06:09.577707 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-q2x64"] Dec 04 01:06:09.914513 master-0 kubenswrapper[33142]: I1204 01:06:09.914447 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" path="/var/lib/kubelet/pods/832a43d4-2b26-4222-afbe-269bd491a49c/volumes" Dec 04 01:06:10.721160 master-0 kubenswrapper[33142]: I1204 01:06:10.721080 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:10.878045 master-0 kubenswrapper[33142]: I1204 01:06:10.877822 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7dkk\" (UniqueName: \"kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk\") pod \"351a4442-07ac-4457-93a0-be72109c30e8\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " Dec 04 01:06:10.878352 master-0 kubenswrapper[33142]: I1204 01:06:10.878308 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data\") pod \"351a4442-07ac-4457-93a0-be72109c30e8\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " Dec 04 01:06:10.878449 master-0 kubenswrapper[33142]: I1204 01:06:10.878412 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts\") pod \"351a4442-07ac-4457-93a0-be72109c30e8\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " Dec 04 01:06:10.878509 master-0 kubenswrapper[33142]: I1204 01:06:10.878483 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle\") pod \"351a4442-07ac-4457-93a0-be72109c30e8\" (UID: \"351a4442-07ac-4457-93a0-be72109c30e8\") " Dec 04 01:06:10.881529 master-0 kubenswrapper[33142]: I1204 01:06:10.881437 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk" (OuterVolumeSpecName: "kube-api-access-f7dkk") pod "351a4442-07ac-4457-93a0-be72109c30e8" (UID: "351a4442-07ac-4457-93a0-be72109c30e8"). InnerVolumeSpecName "kube-api-access-f7dkk". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:10.884215 master-0 kubenswrapper[33142]: I1204 01:06:10.884085 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts" (OuterVolumeSpecName: "scripts") pod "351a4442-07ac-4457-93a0-be72109c30e8" (UID: "351a4442-07ac-4457-93a0-be72109c30e8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:10.916519 master-0 kubenswrapper[33142]: I1204 01:06:10.916447 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data" (OuterVolumeSpecName: "config-data") pod "351a4442-07ac-4457-93a0-be72109c30e8" (UID: "351a4442-07ac-4457-93a0-be72109c30e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:10.917979 master-0 kubenswrapper[33142]: I1204 01:06:10.917877 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "351a4442-07ac-4457-93a0-be72109c30e8" (UID: "351a4442-07ac-4457-93a0-be72109c30e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:10.981862 master-0 kubenswrapper[33142]: I1204 01:06:10.981775 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:10.981862 master-0 kubenswrapper[33142]: I1204 01:06:10.981853 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f7dkk\" (UniqueName: \"kubernetes.io/projected/351a4442-07ac-4457-93a0-be72109c30e8-kube-api-access-f7dkk\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:10.982181 master-0 kubenswrapper[33142]: I1204 01:06:10.981871 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:10.982181 master-0 kubenswrapper[33142]: I1204 01:06:10.981883 33142 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/351a4442-07ac-4457-93a0-be72109c30e8-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:11.113093 master-0 kubenswrapper[33142]: I1204 01:06:11.113027 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 01:06:11.113400 master-0 kubenswrapper[33142]: I1204 01:06:11.113342 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 01:06:11.117497 master-0 kubenswrapper[33142]: I1204 01:06:11.117464 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 01:06:11.253210 master-0 kubenswrapper[33142]: I1204 01:06:11.251537 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-g9gs4" Dec 04 01:06:11.253210 master-0 kubenswrapper[33142]: I1204 01:06:11.251533 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-g9gs4" event={"ID":"351a4442-07ac-4457-93a0-be72109c30e8","Type":"ContainerDied","Data":"fb9ff0ad364134ae91627efb5b6c4af2a6cde89b0f4d23a95d5b6bee1ac827b6"} Dec 04 01:06:11.253210 master-0 kubenswrapper[33142]: I1204 01:06:11.252377 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb9ff0ad364134ae91627efb5b6c4af2a6cde89b0f4d23a95d5b6bee1ac827b6" Dec 04 01:06:11.258368 master-0 kubenswrapper[33142]: I1204 01:06:11.258304 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 01:06:11.536318 master-0 kubenswrapper[33142]: I1204 01:06:11.536146 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:11.536667 master-0 kubenswrapper[33142]: I1204 01:06:11.536588 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-log" containerID="cri-o://425a48612f08a21f66f377361609c75ff7e57722567793d28533efeae0cd8800" gracePeriod=30 Dec 04 01:06:11.536847 master-0 kubenswrapper[33142]: I1204 01:06:11.536744 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-api" containerID="cri-o://607c3ffbd1a3bd670503acd9c79298ad4e8c1b3423a6a56ec98f3ca0e53e88e4" gracePeriod=30 Dec 04 01:06:11.557795 master-0 kubenswrapper[33142]: I1204 01:06:11.557647 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:11.558050 master-0 kubenswrapper[33142]: I1204 01:06:11.558016 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-0" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerName="nova-scheduler-scheduler" containerID="cri-o://62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" gracePeriod=30 Dec 04 01:06:11.586098 master-0 kubenswrapper[33142]: I1204 01:06:11.586010 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:12.275047 master-0 kubenswrapper[33142]: I1204 01:06:12.274975 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerDied","Data":"607c3ffbd1a3bd670503acd9c79298ad4e8c1b3423a6a56ec98f3ca0e53e88e4"} Dec 04 01:06:12.275047 master-0 kubenswrapper[33142]: I1204 01:06:12.274983 33142 generic.go:334] "Generic (PLEG): container finished" podID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerID="607c3ffbd1a3bd670503acd9c79298ad4e8c1b3423a6a56ec98f3ca0e53e88e4" exitCode=0 Dec 04 01:06:12.275047 master-0 kubenswrapper[33142]: I1204 01:06:12.275050 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerDied","Data":"425a48612f08a21f66f377361609c75ff7e57722567793d28533efeae0cd8800"} Dec 04 01:06:12.275674 master-0 kubenswrapper[33142]: I1204 01:06:12.275052 33142 generic.go:334] "Generic (PLEG): container finished" podID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerID="425a48612f08a21f66f377361609c75ff7e57722567793d28533efeae0cd8800" exitCode=143 Dec 04 01:06:12.275674 master-0 kubenswrapper[33142]: I1204 01:06:12.275132 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"b64b3212-a904-468c-bcc2-9896fbf8b58d","Type":"ContainerDied","Data":"34410feaa76b0ff024162549be4b71269eab023cb925d27e8c12efcd7840311b"} Dec 04 01:06:12.275674 master-0 kubenswrapper[33142]: I1204 01:06:12.275166 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34410feaa76b0ff024162549be4b71269eab023cb925d27e8c12efcd7840311b" Dec 04 01:06:12.353613 master-0 kubenswrapper[33142]: I1204 01:06:12.353558 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:12.470454 master-0 kubenswrapper[33142]: I1204 01:06:12.470346 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.470702 master-0 kubenswrapper[33142]: I1204 01:06:12.470525 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.470759 master-0 kubenswrapper[33142]: I1204 01:06:12.470697 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.470849 master-0 kubenswrapper[33142]: I1204 01:06:12.470827 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.470909 master-0 kubenswrapper[33142]: I1204 01:06:12.470885 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.472220 master-0 kubenswrapper[33142]: I1204 01:06:12.472125 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs\") pod \"b64b3212-a904-468c-bcc2-9896fbf8b58d\" (UID: \"b64b3212-a904-468c-bcc2-9896fbf8b58d\") " Dec 04 01:06:12.473819 master-0 kubenswrapper[33142]: I1204 01:06:12.473028 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs" (OuterVolumeSpecName: "logs") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:12.474233 master-0 kubenswrapper[33142]: I1204 01:06:12.474138 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b64b3212-a904-468c-bcc2-9896fbf8b58d-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.476144 master-0 kubenswrapper[33142]: I1204 01:06:12.476038 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42" (OuterVolumeSpecName: "kube-api-access-m4v42") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "kube-api-access-m4v42". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:12.510011 master-0 kubenswrapper[33142]: I1204 01:06:12.509819 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data" (OuterVolumeSpecName: "config-data") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:12.532796 master-0 kubenswrapper[33142]: I1204 01:06:12.532710 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:12.555224 master-0 kubenswrapper[33142]: I1204 01:06:12.555119 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:12.571708 master-0 kubenswrapper[33142]: I1204 01:06:12.571632 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b64b3212-a904-468c-bcc2-9896fbf8b58d" (UID: "b64b3212-a904-468c-bcc2-9896fbf8b58d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:12.579376 master-0 kubenswrapper[33142]: I1204 01:06:12.578096 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.579376 master-0 kubenswrapper[33142]: I1204 01:06:12.578145 33142 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.579376 master-0 kubenswrapper[33142]: I1204 01:06:12.578157 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m4v42\" (UniqueName: \"kubernetes.io/projected/b64b3212-a904-468c-bcc2-9896fbf8b58d-kube-api-access-m4v42\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.579376 master-0 kubenswrapper[33142]: I1204 01:06:12.578170 33142 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-public-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.579376 master-0 kubenswrapper[33142]: I1204 01:06:12.578183 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b64b3212-a904-468c-bcc2-9896fbf8b58d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:12.648674 master-0 kubenswrapper[33142]: E1204 01:06:12.648540 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:06:12.650212 master-0 kubenswrapper[33142]: E1204 01:06:12.650128 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:06:12.652447 master-0 kubenswrapper[33142]: E1204 01:06:12.652399 33142 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 01:06:12.652563 master-0 kubenswrapper[33142]: E1204 01:06:12.652461 33142 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack/nova-scheduler-0" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerName="nova-scheduler-scheduler" Dec 04 01:06:13.288036 master-0 kubenswrapper[33142]: I1204 01:06:13.287919 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:13.288825 master-0 kubenswrapper[33142]: I1204 01:06:13.288108 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" containerID="cri-o://aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1" gracePeriod=30 Dec 04 01:06:13.289413 master-0 kubenswrapper[33142]: I1204 01:06:13.288235 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" containerID="cri-o://e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9" gracePeriod=30 Dec 04 01:06:13.342208 master-0 kubenswrapper[33142]: I1204 01:06:13.342125 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:13.354334 master-0 kubenswrapper[33142]: I1204 01:06:13.353851 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:13.425811 master-0 kubenswrapper[33142]: I1204 01:06:13.425234 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426260 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="init" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426294 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="init" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426314 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426323 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426357 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-api" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426367 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-api" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426392 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="extract-utilities" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426404 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="extract-utilities" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426426 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-log" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426434 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-log" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426450 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="dnsmasq-dns" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426458 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="dnsmasq-dns" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426495 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="extract-content" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426504 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="extract-content" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426523 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="registry-server" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426531 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="registry-server" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: E1204 01:06:13.426555 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="351a4442-07ac-4457-93a0-be72109c30e8" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426564 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="351a4442-07ac-4457-93a0-be72109c30e8" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426887 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="832a43d4-2b26-4222-afbe-269bd491a49c" containerName="registry-server" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426950 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="acdb4202-4e28-4123-ad00-808c14eb96b3" containerName="dnsmasq-dns" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426968 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.426991 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="351a4442-07ac-4457-93a0-be72109c30e8" containerName="nova-manage" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.427013 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-api" Dec 04 01:06:13.428034 master-0 kubenswrapper[33142]: I1204 01:06:13.427030 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" containerName="nova-api-log" Dec 04 01:06:13.435537 master-0 kubenswrapper[33142]: I1204 01:06:13.429218 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:13.435537 master-0 kubenswrapper[33142]: I1204 01:06:13.432101 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-public-svc" Dec 04 01:06:13.435537 master-0 kubenswrapper[33142]: I1204 01:06:13.432137 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 01:06:13.435537 master-0 kubenswrapper[33142]: I1204 01:06:13.434361 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-internal-svc" Dec 04 01:06:13.463726 master-0 kubenswrapper[33142]: I1204 01:06:13.463489 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:13.503469 master-0 kubenswrapper[33142]: I1204 01:06:13.503277 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.503852 master-0 kubenswrapper[33142]: I1204 01:06:13.503807 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-config-data\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.504107 master-0 kubenswrapper[33142]: I1204 01:06:13.504066 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.504287 master-0 kubenswrapper[33142]: I1204 01:06:13.504252 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4ll\" (UniqueName: \"kubernetes.io/projected/c4816d57-d999-48ff-9657-42ddb3f7d04a-kube-api-access-jz4ll\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.504347 master-0 kubenswrapper[33142]: I1204 01:06:13.504306 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c4816d57-d999-48ff-9657-42ddb3f7d04a-logs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.504482 master-0 kubenswrapper[33142]: I1204 01:06:13.504449 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-public-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606296 master-0 kubenswrapper[33142]: I1204 01:06:13.606191 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-config-data\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606296 master-0 kubenswrapper[33142]: I1204 01:06:13.606301 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606849 master-0 kubenswrapper[33142]: I1204 01:06:13.606362 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4ll\" (UniqueName: \"kubernetes.io/projected/c4816d57-d999-48ff-9657-42ddb3f7d04a-kube-api-access-jz4ll\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606849 master-0 kubenswrapper[33142]: I1204 01:06:13.606395 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c4816d57-d999-48ff-9657-42ddb3f7d04a-logs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606849 master-0 kubenswrapper[33142]: I1204 01:06:13.606428 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-public-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.606849 master-0 kubenswrapper[33142]: I1204 01:06:13.606587 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.607084 master-0 kubenswrapper[33142]: I1204 01:06:13.607063 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c4816d57-d999-48ff-9657-42ddb3f7d04a-logs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.614075 master-0 kubenswrapper[33142]: I1204 01:06:13.610951 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.614075 master-0 kubenswrapper[33142]: I1204 01:06:13.611297 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-public-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.614075 master-0 kubenswrapper[33142]: I1204 01:06:13.611731 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.614075 master-0 kubenswrapper[33142]: I1204 01:06:13.612814 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c4816d57-d999-48ff-9657-42ddb3f7d04a-config-data\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.626221 master-0 kubenswrapper[33142]: I1204 01:06:13.626159 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4ll\" (UniqueName: \"kubernetes.io/projected/c4816d57-d999-48ff-9657-42ddb3f7d04a-kube-api-access-jz4ll\") pod \"nova-api-0\" (UID: \"c4816d57-d999-48ff-9657-42ddb3f7d04a\") " pod="openstack/nova-api-0" Dec 04 01:06:13.796659 master-0 kubenswrapper[33142]: I1204 01:06:13.796506 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 01:06:13.937168 master-0 kubenswrapper[33142]: I1204 01:06:13.937037 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64b3212-a904-468c-bcc2-9896fbf8b58d" path="/var/lib/kubelet/pods/b64b3212-a904-468c-bcc2-9896fbf8b58d/volumes" Dec 04 01:06:14.313706 master-0 kubenswrapper[33142]: I1204 01:06:14.313494 33142 generic.go:334] "Generic (PLEG): container finished" podID="d0f2994e-d176-484f-ae68-675829aca4df" containerID="aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1" exitCode=143 Dec 04 01:06:14.313706 master-0 kubenswrapper[33142]: I1204 01:06:14.313638 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerDied","Data":"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1"} Dec 04 01:06:14.337457 master-0 kubenswrapper[33142]: W1204 01:06:14.337315 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4816d57_d999_48ff_9657_42ddb3f7d04a.slice/crio-04c5a2cebe3999688df382587c899d21ce41e34ecae8db6923e490220678f40f WatchSource:0}: Error finding container 04c5a2cebe3999688df382587c899d21ce41e34ecae8db6923e490220678f40f: Status 404 returned error can't find the container with id 04c5a2cebe3999688df382587c899d21ce41e34ecae8db6923e490220678f40f Dec 04 01:06:14.348479 master-0 kubenswrapper[33142]: I1204 01:06:14.346811 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 01:06:14.750945 master-0 kubenswrapper[33142]: I1204 01:06:14.750805 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:06:14.908221 master-0 kubenswrapper[33142]: I1204 01:06:14.898191 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:06:15.010591 master-0 kubenswrapper[33142]: I1204 01:06:15.010508 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:06:15.339815 master-0 kubenswrapper[33142]: I1204 01:06:15.339598 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"c4816d57-d999-48ff-9657-42ddb3f7d04a","Type":"ContainerStarted","Data":"354be612406a127f7223dd29882846982b91ba71b57e34da1381024806b79f86"} Dec 04 01:06:15.339815 master-0 kubenswrapper[33142]: I1204 01:06:15.339697 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"c4816d57-d999-48ff-9657-42ddb3f7d04a","Type":"ContainerStarted","Data":"1866fa1935f9af90d1513d594d2fa4ba4cca3a9aea1c714661cff8d3af8a5cf7"} Dec 04 01:06:15.339815 master-0 kubenswrapper[33142]: I1204 01:06:15.339736 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"c4816d57-d999-48ff-9657-42ddb3f7d04a","Type":"ContainerStarted","Data":"04c5a2cebe3999688df382587c899d21ce41e34ecae8db6923e490220678f40f"} Dec 04 01:06:15.372455 master-0 kubenswrapper[33142]: I1204 01:06:15.372325 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.372292708 podStartE2EDuration="2.372292708s" podCreationTimestamp="2025-12-04 01:06:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:15.369575431 +0000 UTC m=+1147.771577291" watchObservedRunningTime="2025-12-04 01:06:15.372292708 +0000 UTC m=+1147.774294598" Dec 04 01:06:16.358169 master-0 kubenswrapper[33142]: I1204 01:06:16.358095 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-gpn4w" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" containerID="cri-o://e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40" gracePeriod=2 Dec 04 01:06:16.461373 master-0 kubenswrapper[33142]: I1204 01:06:16.460951 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.22:8775/\": read tcp 10.128.0.2:48910->10.128.1.22:8775: read: connection reset by peer" Dec 04 01:06:16.461373 master-0 kubenswrapper[33142]: I1204 01:06:16.461336 33142 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-0" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.22:8775/\": read tcp 10.128.0.2:48912->10.128.1.22:8775: read: connection reset by peer" Dec 04 01:06:16.966657 master-0 kubenswrapper[33142]: I1204 01:06:16.966475 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:06:17.013595 master-0 kubenswrapper[33142]: I1204 01:06:17.013514 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content\") pod \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " Dec 04 01:06:17.014056 master-0 kubenswrapper[33142]: I1204 01:06:17.014032 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities\") pod \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " Dec 04 01:06:17.014254 master-0 kubenswrapper[33142]: I1204 01:06:17.014232 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhjwm\" (UniqueName: \"kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm\") pod \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\" (UID: \"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3\") " Dec 04 01:06:17.017589 master-0 kubenswrapper[33142]: I1204 01:06:17.017520 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities" (OuterVolumeSpecName: "utilities") pod "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" (UID: "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:17.020906 master-0 kubenswrapper[33142]: I1204 01:06:17.020872 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm" (OuterVolumeSpecName: "kube-api-access-fhjwm") pod "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" (UID: "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3"). InnerVolumeSpecName "kube-api-access-fhjwm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:17.085248 master-0 kubenswrapper[33142]: I1204 01:06:17.084781 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:06:17.116786 master-0 kubenswrapper[33142]: I1204 01:06:17.116251 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhqjt\" (UniqueName: \"kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt\") pod \"d0f2994e-d176-484f-ae68-675829aca4df\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " Dec 04 01:06:17.116786 master-0 kubenswrapper[33142]: I1204 01:06:17.116526 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs\") pod \"d0f2994e-d176-484f-ae68-675829aca4df\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " Dec 04 01:06:17.116786 master-0 kubenswrapper[33142]: I1204 01:06:17.116664 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle\") pod \"d0f2994e-d176-484f-ae68-675829aca4df\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " Dec 04 01:06:17.116786 master-0 kubenswrapper[33142]: I1204 01:06:17.116744 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data\") pod \"d0f2994e-d176-484f-ae68-675829aca4df\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " Dec 04 01:06:17.117397 master-0 kubenswrapper[33142]: I1204 01:06:17.116901 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs\") pod \"d0f2994e-d176-484f-ae68-675829aca4df\" (UID: \"d0f2994e-d176-484f-ae68-675829aca4df\") " Dec 04 01:06:17.117490 master-0 kubenswrapper[33142]: I1204 01:06:17.117460 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.117490 master-0 kubenswrapper[33142]: I1204 01:06:17.117487 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fhjwm\" (UniqueName: \"kubernetes.io/projected/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-kube-api-access-fhjwm\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.118854 master-0 kubenswrapper[33142]: I1204 01:06:17.117653 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs" (OuterVolumeSpecName: "logs") pod "d0f2994e-d176-484f-ae68-675829aca4df" (UID: "d0f2994e-d176-484f-ae68-675829aca4df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:17.120903 master-0 kubenswrapper[33142]: I1204 01:06:17.120838 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt" (OuterVolumeSpecName: "kube-api-access-mhqjt") pod "d0f2994e-d176-484f-ae68-675829aca4df" (UID: "d0f2994e-d176-484f-ae68-675829aca4df"). InnerVolumeSpecName "kube-api-access-mhqjt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:17.160598 master-0 kubenswrapper[33142]: I1204 01:06:17.159398 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" (UID: "5dffd7b0-29b5-4dd5-9b10-be9b401b13c3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:06:17.178272 master-0 kubenswrapper[33142]: I1204 01:06:17.177768 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data" (OuterVolumeSpecName: "config-data") pod "d0f2994e-d176-484f-ae68-675829aca4df" (UID: "d0f2994e-d176-484f-ae68-675829aca4df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:17.185374 master-0 kubenswrapper[33142]: I1204 01:06:17.185292 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0f2994e-d176-484f-ae68-675829aca4df" (UID: "d0f2994e-d176-484f-ae68-675829aca4df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:17.204868 master-0 kubenswrapper[33142]: I1204 01:06:17.202953 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d0f2994e-d176-484f-ae68-675829aca4df" (UID: "d0f2994e-d176-484f-ae68-675829aca4df"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220299 33142 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0f2994e-d176-484f-ae68-675829aca4df-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220353 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mhqjt\" (UniqueName: \"kubernetes.io/projected/d0f2994e-d176-484f-ae68-675829aca4df-kube-api-access-mhqjt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220365 33142 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-nova-metadata-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220376 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220388 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0f2994e-d176-484f-ae68-675829aca4df-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.220477 master-0 kubenswrapper[33142]: I1204 01:06:17.220398 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.315823 master-0 kubenswrapper[33142]: I1204 01:06:17.315747 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:06:17.322569 master-0 kubenswrapper[33142]: I1204 01:06:17.321882 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle\") pod \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " Dec 04 01:06:17.372756 master-0 kubenswrapper[33142]: I1204 01:06:17.372664 33142 generic.go:334] "Generic (PLEG): container finished" podID="d0f2994e-d176-484f-ae68-675829aca4df" containerID="e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9" exitCode=0 Dec 04 01:06:17.373395 master-0 kubenswrapper[33142]: I1204 01:06:17.372760 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerDied","Data":"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9"} Dec 04 01:06:17.373395 master-0 kubenswrapper[33142]: I1204 01:06:17.372801 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:06:17.373395 master-0 kubenswrapper[33142]: I1204 01:06:17.372819 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"d0f2994e-d176-484f-ae68-675829aca4df","Type":"ContainerDied","Data":"6cdfdf7590fc02eedeb4a6d83f82d7fa74cb48b22bedef6a95a041d413912de3"} Dec 04 01:06:17.373395 master-0 kubenswrapper[33142]: I1204 01:06:17.372834 33142 scope.go:117] "RemoveContainer" containerID="e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9" Dec 04 01:06:17.378011 master-0 kubenswrapper[33142]: I1204 01:06:17.375726 33142 generic.go:334] "Generic (PLEG): container finished" podID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" exitCode=0 Dec 04 01:06:17.378011 master-0 kubenswrapper[33142]: I1204 01:06:17.375794 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc","Type":"ContainerDied","Data":"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e"} Dec 04 01:06:17.378011 master-0 kubenswrapper[33142]: I1204 01:06:17.375827 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc","Type":"ContainerDied","Data":"b08bc43a24a313fbaea5fb5d68c394a13a00453b98f5897aa5c6c97397deab30"} Dec 04 01:06:17.378011 master-0 kubenswrapper[33142]: I1204 01:06:17.375796 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:06:17.378444 master-0 kubenswrapper[33142]: I1204 01:06:17.378358 33142 generic.go:334] "Generic (PLEG): container finished" podID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerID="e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40" exitCode=0 Dec 04 01:06:17.378444 master-0 kubenswrapper[33142]: I1204 01:06:17.378396 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerDied","Data":"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40"} Dec 04 01:06:17.378444 master-0 kubenswrapper[33142]: I1204 01:06:17.378421 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gpn4w" event={"ID":"5dffd7b0-29b5-4dd5-9b10-be9b401b13c3","Type":"ContainerDied","Data":"cd8cccd5a862b4acee7a1fb26b3152bf9e9ede66a3d3e4de02f66baeb5ce165a"} Dec 04 01:06:17.378444 master-0 kubenswrapper[33142]: I1204 01:06:17.378425 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gpn4w" Dec 04 01:06:17.383444 master-0 kubenswrapper[33142]: I1204 01:06:17.383407 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" (UID: "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:17.418687 master-0 kubenswrapper[33142]: I1204 01:06:17.418583 33142 scope.go:117] "RemoveContainer" containerID="aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1" Dec 04 01:06:17.426222 master-0 kubenswrapper[33142]: I1204 01:06:17.425951 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data\") pod \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " Dec 04 01:06:17.426513 master-0 kubenswrapper[33142]: I1204 01:06:17.426475 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbmtb\" (UniqueName: \"kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb\") pod \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\" (UID: \"a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc\") " Dec 04 01:06:17.427569 master-0 kubenswrapper[33142]: I1204 01:06:17.427540 33142 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.437700 master-0 kubenswrapper[33142]: I1204 01:06:17.437608 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:06:17.453302 master-0 kubenswrapper[33142]: I1204 01:06:17.453236 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb" (OuterVolumeSpecName: "kube-api-access-dbmtb") pod "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" (UID: "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc"). InnerVolumeSpecName "kube-api-access-dbmtb". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:06:17.453414 master-0 kubenswrapper[33142]: I1204 01:06:17.453296 33142 scope.go:117] "RemoveContainer" containerID="e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9" Dec 04 01:06:17.453774 master-0 kubenswrapper[33142]: E1204 01:06:17.453726 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9\": container with ID starting with e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9 not found: ID does not exist" containerID="e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9" Dec 04 01:06:17.453846 master-0 kubenswrapper[33142]: I1204 01:06:17.453773 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9"} err="failed to get container status \"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9\": rpc error: code = NotFound desc = could not find container \"e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9\": container with ID starting with e59786e8c9e0fce0f48f30923cb36a55296268ecd607f7e72980bc957d86b5f9 not found: ID does not exist" Dec 04 01:06:17.453846 master-0 kubenswrapper[33142]: I1204 01:06:17.453799 33142 scope.go:117] "RemoveContainer" containerID="aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1" Dec 04 01:06:17.454287 master-0 kubenswrapper[33142]: E1204 01:06:17.454266 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1\": container with ID starting with aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1 not found: ID does not exist" containerID="aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1" Dec 04 01:06:17.454341 master-0 kubenswrapper[33142]: I1204 01:06:17.454288 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1"} err="failed to get container status \"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1\": rpc error: code = NotFound desc = could not find container \"aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1\": container with ID starting with aa26cd02b972112e2bb68ed92c62b3d957a709bee75dbeefd9b5d1efb73d5aa1 not found: ID does not exist" Dec 04 01:06:17.454341 master-0 kubenswrapper[33142]: I1204 01:06:17.454303 33142 scope.go:117] "RemoveContainer" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" Dec 04 01:06:17.454847 master-0 kubenswrapper[33142]: I1204 01:06:17.454816 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-gpn4w"] Dec 04 01:06:17.469721 master-0 kubenswrapper[33142]: I1204 01:06:17.469662 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:17.478589 master-0 kubenswrapper[33142]: I1204 01:06:17.478422 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data" (OuterVolumeSpecName: "config-data") pod "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" (UID: "a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:06:17.486264 master-0 kubenswrapper[33142]: I1204 01:06:17.483317 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:17.501547 master-0 kubenswrapper[33142]: I1204 01:06:17.501426 33142 scope.go:117] "RemoveContainer" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" Dec 04 01:06:17.502779 master-0 kubenswrapper[33142]: E1204 01:06:17.501980 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e\": container with ID starting with 62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e not found: ID does not exist" containerID="62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e" Dec 04 01:06:17.502779 master-0 kubenswrapper[33142]: I1204 01:06:17.502008 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e"} err="failed to get container status \"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e\": rpc error: code = NotFound desc = could not find container \"62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e\": container with ID starting with 62624e56fdd04393ded0d93204b05b648d5600132dcf013ad769a4a03e81116e not found: ID does not exist" Dec 04 01:06:17.502779 master-0 kubenswrapper[33142]: I1204 01:06:17.502031 33142 scope.go:117] "RemoveContainer" containerID="e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40" Dec 04 01:06:17.539786 master-0 kubenswrapper[33142]: I1204 01:06:17.539681 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542018 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="extract-utilities" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542054 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="extract-utilities" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542104 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerName="nova-scheduler-scheduler" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542112 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerName="nova-scheduler-scheduler" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542134 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542144 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542216 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="extract-content" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542224 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="extract-content" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542253 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542259 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: E1204 01:06:17.542301 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.542310 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.543200 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-log" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.543233 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="d0f2994e-d176-484f-ae68-675829aca4df" containerName="nova-metadata-metadata" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.543252 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" containerName="registry-server" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.543299 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" containerName="nova-scheduler-scheduler" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.547452 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.551921 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.553067 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 01:06:17.553660 master-0 kubenswrapper[33142]: I1204 01:06:17.553662 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2764fcf5-3d5f-4e74-87ce-3921f791f481-logs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.555201 master-0 kubenswrapper[33142]: I1204 01:06:17.554108 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.555201 master-0 kubenswrapper[33142]: I1204 01:06:17.554296 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcrgn\" (UniqueName: \"kubernetes.io/projected/2764fcf5-3d5f-4e74-87ce-3921f791f481-kube-api-access-lcrgn\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.555201 master-0 kubenswrapper[33142]: I1204 01:06:17.554728 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.555201 master-0 kubenswrapper[33142]: I1204 01:06:17.555009 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-config-data\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.555459 master-0 kubenswrapper[33142]: I1204 01:06:17.555309 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbmtb\" (UniqueName: \"kubernetes.io/projected/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-kube-api-access-dbmtb\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.555459 master-0 kubenswrapper[33142]: I1204 01:06:17.555341 33142 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 01:06:17.561822 master-0 kubenswrapper[33142]: I1204 01:06:17.561399 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:17.617340 master-0 kubenswrapper[33142]: I1204 01:06:17.617125 33142 scope.go:117] "RemoveContainer" containerID="2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1" Dec 04 01:06:17.649857 master-0 kubenswrapper[33142]: I1204 01:06:17.649781 33142 scope.go:117] "RemoveContainer" containerID="b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c" Dec 04 01:06:17.658947 master-0 kubenswrapper[33142]: I1204 01:06:17.658170 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.658947 master-0 kubenswrapper[33142]: I1204 01:06:17.658312 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-config-data\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.659769 master-0 kubenswrapper[33142]: I1204 01:06:17.659710 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2764fcf5-3d5f-4e74-87ce-3921f791f481-logs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.660334 master-0 kubenswrapper[33142]: I1204 01:06:17.660276 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.660439 master-0 kubenswrapper[33142]: I1204 01:06:17.660415 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lcrgn\" (UniqueName: \"kubernetes.io/projected/2764fcf5-3d5f-4e74-87ce-3921f791f481-kube-api-access-lcrgn\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.663046 master-0 kubenswrapper[33142]: I1204 01:06:17.661145 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2764fcf5-3d5f-4e74-87ce-3921f791f481-logs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.663631 master-0 kubenswrapper[33142]: I1204 01:06:17.663576 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.664077 master-0 kubenswrapper[33142]: I1204 01:06:17.664035 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-config-data\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.664827 master-0 kubenswrapper[33142]: I1204 01:06:17.664726 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2764fcf5-3d5f-4e74-87ce-3921f791f481-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.679414 master-0 kubenswrapper[33142]: I1204 01:06:17.679320 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcrgn\" (UniqueName: \"kubernetes.io/projected/2764fcf5-3d5f-4e74-87ce-3921f791f481-kube-api-access-lcrgn\") pod \"nova-metadata-0\" (UID: \"2764fcf5-3d5f-4e74-87ce-3921f791f481\") " pod="openstack/nova-metadata-0" Dec 04 01:06:17.781334 master-0 kubenswrapper[33142]: I1204 01:06:17.781264 33142 scope.go:117] "RemoveContainer" containerID="e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40" Dec 04 01:06:17.782017 master-0 kubenswrapper[33142]: E1204 01:06:17.781974 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40\": container with ID starting with e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40 not found: ID does not exist" containerID="e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40" Dec 04 01:06:17.782169 master-0 kubenswrapper[33142]: I1204 01:06:17.782131 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40"} err="failed to get container status \"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40\": rpc error: code = NotFound desc = could not find container \"e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40\": container with ID starting with e5bc8c348fcca32d1666f837a5de76ac6c21dfbca1b6c752b608d84cd35ace40 not found: ID does not exist" Dec 04 01:06:17.782279 master-0 kubenswrapper[33142]: I1204 01:06:17.782263 33142 scope.go:117] "RemoveContainer" containerID="2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1" Dec 04 01:06:17.783998 master-0 kubenswrapper[33142]: E1204 01:06:17.783915 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1\": container with ID starting with 2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1 not found: ID does not exist" containerID="2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1" Dec 04 01:06:17.784085 master-0 kubenswrapper[33142]: I1204 01:06:17.784004 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1"} err="failed to get container status \"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1\": rpc error: code = NotFound desc = could not find container \"2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1\": container with ID starting with 2f62ca0924c03b807055c219bb912eadffc518dfa34774f48bd9ebae5a850ea1 not found: ID does not exist" Dec 04 01:06:17.784085 master-0 kubenswrapper[33142]: I1204 01:06:17.784050 33142 scope.go:117] "RemoveContainer" containerID="b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c" Dec 04 01:06:17.785513 master-0 kubenswrapper[33142]: E1204 01:06:17.784835 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c\": container with ID starting with b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c not found: ID does not exist" containerID="b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c" Dec 04 01:06:17.785596 master-0 kubenswrapper[33142]: I1204 01:06:17.785565 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c"} err="failed to get container status \"b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c\": rpc error: code = NotFound desc = could not find container \"b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c\": container with ID starting with b2b4573a0c3cfa5950c2ef0745475d1924d2132614898c9ba89aae2d8dd9150c not found: ID does not exist" Dec 04 01:06:17.854752 master-0 kubenswrapper[33142]: I1204 01:06:17.854676 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:17.876680 master-0 kubenswrapper[33142]: I1204 01:06:17.876594 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:17.897120 master-0 kubenswrapper[33142]: I1204 01:06:17.897057 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:17.917364 master-0 kubenswrapper[33142]: I1204 01:06:17.914947 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:06:17.929794 master-0 kubenswrapper[33142]: I1204 01:06:17.929701 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 01:06:17.930603 master-0 kubenswrapper[33142]: I1204 01:06:17.930517 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 01:06:17.942237 master-0 kubenswrapper[33142]: I1204 01:06:17.942138 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dffd7b0-29b5-4dd5-9b10-be9b401b13c3" path="/var/lib/kubelet/pods/5dffd7b0-29b5-4dd5-9b10-be9b401b13c3/volumes" Dec 04 01:06:17.943193 master-0 kubenswrapper[33142]: I1204 01:06:17.943160 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc" path="/var/lib/kubelet/pods/a42e3233-2cf5-4f24-8bca-2ea3d4cd38cc/volumes" Dec 04 01:06:17.944083 master-0 kubenswrapper[33142]: I1204 01:06:17.944009 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f2994e-d176-484f-ae68-675829aca4df" path="/var/lib/kubelet/pods/d0f2994e-d176-484f-ae68-675829aca4df/volumes" Dec 04 01:06:17.947789 master-0 kubenswrapper[33142]: I1204 01:06:17.947735 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:17.968946 master-0 kubenswrapper[33142]: I1204 01:06:17.968854 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:17.969826 master-0 kubenswrapper[33142]: I1204 01:06:17.969772 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-config-data\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:17.970170 master-0 kubenswrapper[33142]: I1204 01:06:17.970124 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljhr\" (UniqueName: \"kubernetes.io/projected/83728dae-6448-4082-bef8-4e764143425c-kube-api-access-nljhr\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.072548 master-0 kubenswrapper[33142]: I1204 01:06:18.072467 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nljhr\" (UniqueName: \"kubernetes.io/projected/83728dae-6448-4082-bef8-4e764143425c-kube-api-access-nljhr\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.072769 master-0 kubenswrapper[33142]: I1204 01:06:18.072574 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.072769 master-0 kubenswrapper[33142]: I1204 01:06:18.072670 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-config-data\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.076443 master-0 kubenswrapper[33142]: I1204 01:06:18.076400 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-config-data\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.076994 master-0 kubenswrapper[33142]: I1204 01:06:18.076916 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83728dae-6448-4082-bef8-4e764143425c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.088545 master-0 kubenswrapper[33142]: I1204 01:06:18.088484 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljhr\" (UniqueName: \"kubernetes.io/projected/83728dae-6448-4082-bef8-4e764143425c-kube-api-access-nljhr\") pod \"nova-scheduler-0\" (UID: \"83728dae-6448-4082-bef8-4e764143425c\") " pod="openstack/nova-scheduler-0" Dec 04 01:06:18.254153 master-0 kubenswrapper[33142]: I1204 01:06:18.254059 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 01:06:18.415633 master-0 kubenswrapper[33142]: W1204 01:06:18.415566 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2764fcf5_3d5f_4e74_87ce_3921f791f481.slice/crio-5ae3121bcd3985e3f30c68b0dbbf19ef52711e39542018e5d3ef7d82abd17c96 WatchSource:0}: Error finding container 5ae3121bcd3985e3f30c68b0dbbf19ef52711e39542018e5d3ef7d82abd17c96: Status 404 returned error can't find the container with id 5ae3121bcd3985e3f30c68b0dbbf19ef52711e39542018e5d3ef7d82abd17c96 Dec 04 01:06:18.426654 master-0 kubenswrapper[33142]: I1204 01:06:18.426569 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 01:06:18.773016 master-0 kubenswrapper[33142]: I1204 01:06:18.772906 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 01:06:18.777740 master-0 kubenswrapper[33142]: W1204 01:06:18.777664 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83728dae_6448_4082_bef8_4e764143425c.slice/crio-3f6d6314fb2b0c3e3729ec59aff40b5815ea90794022fb9b9411d78cff419fac WatchSource:0}: Error finding container 3f6d6314fb2b0c3e3729ec59aff40b5815ea90794022fb9b9411d78cff419fac: Status 404 returned error can't find the container with id 3f6d6314fb2b0c3e3729ec59aff40b5815ea90794022fb9b9411d78cff419fac Dec 04 01:06:19.432969 master-0 kubenswrapper[33142]: I1204 01:06:19.432470 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"83728dae-6448-4082-bef8-4e764143425c","Type":"ContainerStarted","Data":"672f5080dbabc0f0f7327b9ba9e31bc0d417c7add3113b87fd7b39a6f706b43e"} Dec 04 01:06:19.432969 master-0 kubenswrapper[33142]: I1204 01:06:19.432557 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"83728dae-6448-4082-bef8-4e764143425c","Type":"ContainerStarted","Data":"3f6d6314fb2b0c3e3729ec59aff40b5815ea90794022fb9b9411d78cff419fac"} Dec 04 01:06:19.438952 master-0 kubenswrapper[33142]: I1204 01:06:19.437210 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"2764fcf5-3d5f-4e74-87ce-3921f791f481","Type":"ContainerStarted","Data":"075239fdc9a5450898be86a6e0afb9452f3b084da78c8dd7d58e46ca798b9222"} Dec 04 01:06:19.438952 master-0 kubenswrapper[33142]: I1204 01:06:19.438144 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"2764fcf5-3d5f-4e74-87ce-3921f791f481","Type":"ContainerStarted","Data":"e0e3fee2cc0c77fca2e9dcaf8f52dbdd97c875980ab339294b36cfd516599373"} Dec 04 01:06:19.438952 master-0 kubenswrapper[33142]: I1204 01:06:19.438163 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"2764fcf5-3d5f-4e74-87ce-3921f791f481","Type":"ContainerStarted","Data":"5ae3121bcd3985e3f30c68b0dbbf19ef52711e39542018e5d3ef7d82abd17c96"} Dec 04 01:06:19.480306 master-0 kubenswrapper[33142]: I1204 01:06:19.479842 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=2.479811491 podStartE2EDuration="2.479811491s" podCreationTimestamp="2025-12-04 01:06:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:19.461889077 +0000 UTC m=+1151.863890937" watchObservedRunningTime="2025-12-04 01:06:19.479811491 +0000 UTC m=+1151.881813351" Dec 04 01:06:19.512709 master-0 kubenswrapper[33142]: I1204 01:06:19.512590 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=2.512561664 podStartE2EDuration="2.512561664s" podCreationTimestamp="2025-12-04 01:06:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:06:19.486429938 +0000 UTC m=+1151.888431788" watchObservedRunningTime="2025-12-04 01:06:19.512561664 +0000 UTC m=+1151.914563534" Dec 04 01:06:22.931054 master-0 kubenswrapper[33142]: I1204 01:06:22.930963 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:06:22.931805 master-0 kubenswrapper[33142]: I1204 01:06:22.931470 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 01:06:23.255126 master-0 kubenswrapper[33142]: I1204 01:06:23.254906 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 01:06:23.797702 master-0 kubenswrapper[33142]: I1204 01:06:23.797583 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:06:23.797702 master-0 kubenswrapper[33142]: I1204 01:06:23.797712 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 01:06:24.817551 master-0 kubenswrapper[33142]: I1204 01:06:24.817408 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="c4816d57-d999-48ff-9657-42ddb3f7d04a" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.128.1.28:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:24.818725 master-0 kubenswrapper[33142]: I1204 01:06:24.817406 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="c4816d57-d999-48ff-9657-42ddb3f7d04a" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.128.1.28:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:27.931319 master-0 kubenswrapper[33142]: I1204 01:06:27.931183 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 01:06:27.932226 master-0 kubenswrapper[33142]: I1204 01:06:27.931367 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 01:06:28.254497 master-0 kubenswrapper[33142]: I1204 01:06:28.254362 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 01:06:28.308684 master-0 kubenswrapper[33142]: I1204 01:06:28.308607 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 01:06:28.650966 master-0 kubenswrapper[33142]: I1204 01:06:28.650846 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 01:06:28.950302 master-0 kubenswrapper[33142]: I1204 01:06:28.950100 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="2764fcf5-3d5f-4e74-87ce-3921f791f481" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.29:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:28.950302 master-0 kubenswrapper[33142]: I1204 01:06:28.950166 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="2764fcf5-3d5f-4e74-87ce-3921f791f481" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.29:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 01:06:33.804452 master-0 kubenswrapper[33142]: I1204 01:06:33.804365 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 01:06:33.805040 master-0 kubenswrapper[33142]: I1204 01:06:33.804971 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 01:06:33.805663 master-0 kubenswrapper[33142]: I1204 01:06:33.805634 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 01:06:33.818618 master-0 kubenswrapper[33142]: I1204 01:06:33.818537 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 01:06:34.703260 master-0 kubenswrapper[33142]: I1204 01:06:34.703054 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 01:06:34.712462 master-0 kubenswrapper[33142]: I1204 01:06:34.712385 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 01:06:37.937049 master-0 kubenswrapper[33142]: I1204 01:06:37.936951 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 01:06:37.940250 master-0 kubenswrapper[33142]: I1204 01:06:37.940196 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 01:06:37.945776 master-0 kubenswrapper[33142]: I1204 01:06:37.945340 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 01:06:38.773795 master-0 kubenswrapper[33142]: I1204 01:06:38.773708 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 01:07:06.267556 master-0 kubenswrapper[33142]: I1204 01:07:06.265567 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 01:07:06.267556 master-0 kubenswrapper[33142]: I1204 01:07:06.265856 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" podUID="e9095d9b-8127-4abe-9519-53049c22eca9" containerName="sushy-emulator" containerID="cri-o://4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38" gracePeriod=30 Dec 04 01:07:06.891099 master-0 kubenswrapper[33142]: I1204 01:07:06.891044 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 01:07:07.002020 master-0 kubenswrapper[33142]: I1204 01:07:06.996494 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config\") pod \"e9095d9b-8127-4abe-9519-53049c22eca9\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " Dec 04 01:07:07.002020 master-0 kubenswrapper[33142]: I1204 01:07:06.999158 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config\") pod \"e9095d9b-8127-4abe-9519-53049c22eca9\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " Dec 04 01:07:07.002020 master-0 kubenswrapper[33142]: I1204 01:07:06.999373 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrjt\" (UniqueName: \"kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt\") pod \"e9095d9b-8127-4abe-9519-53049c22eca9\" (UID: \"e9095d9b-8127-4abe-9519-53049c22eca9\") " Dec 04 01:07:07.002020 master-0 kubenswrapper[33142]: I1204 01:07:07.000199 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config" (OuterVolumeSpecName: "sushy-emulator-config") pod "e9095d9b-8127-4abe-9519-53049c22eca9" (UID: "e9095d9b-8127-4abe-9519-53049c22eca9"). InnerVolumeSpecName "sushy-emulator-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:07:07.002837 master-0 kubenswrapper[33142]: I1204 01:07:07.002801 33142 reconciler_common.go:293] "Volume detached for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e9095d9b-8127-4abe-9519-53049c22eca9-sushy-emulator-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:07.003523 master-0 kubenswrapper[33142]: I1204 01:07:07.003468 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config" (OuterVolumeSpecName: "os-client-config") pod "e9095d9b-8127-4abe-9519-53049c22eca9" (UID: "e9095d9b-8127-4abe-9519-53049c22eca9"). InnerVolumeSpecName "os-client-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:07:07.005173 master-0 kubenswrapper[33142]: I1204 01:07:07.005121 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt" (OuterVolumeSpecName: "kube-api-access-nbrjt") pod "e9095d9b-8127-4abe-9519-53049c22eca9" (UID: "e9095d9b-8127-4abe-9519-53049c22eca9"). InnerVolumeSpecName "kube-api-access-nbrjt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:07:07.017841 master-0 kubenswrapper[33142]: I1204 01:07:07.017782 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-xf8bb"] Dec 04 01:07:07.019478 master-0 kubenswrapper[33142]: E1204 01:07:07.019402 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9095d9b-8127-4abe-9519-53049c22eca9" containerName="sushy-emulator" Dec 04 01:07:07.019478 master-0 kubenswrapper[33142]: I1204 01:07:07.019464 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9095d9b-8127-4abe-9519-53049c22eca9" containerName="sushy-emulator" Dec 04 01:07:07.020078 master-0 kubenswrapper[33142]: I1204 01:07:07.020040 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9095d9b-8127-4abe-9519-53049c22eca9" containerName="sushy-emulator" Dec 04 01:07:07.021122 master-0 kubenswrapper[33142]: I1204 01:07:07.021081 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.034347 master-0 kubenswrapper[33142]: I1204 01:07:07.034260 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-xf8bb"] Dec 04 01:07:07.115892 master-0 kubenswrapper[33142]: I1204 01:07:07.115783 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82c9z\" (UniqueName: \"kubernetes.io/projected/e105e4fb-9e29-4c96-bf69-f9766a49332e-kube-api-access-82c9z\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.116222 master-0 kubenswrapper[33142]: I1204 01:07:07.116137 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e105e4fb-9e29-4c96-bf69-f9766a49332e-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.116222 master-0 kubenswrapper[33142]: I1204 01:07:07.116188 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e105e4fb-9e29-4c96-bf69-f9766a49332e-os-client-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.116645 master-0 kubenswrapper[33142]: I1204 01:07:07.116615 33142 reconciler_common.go:293] "Volume detached for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e9095d9b-8127-4abe-9519-53049c22eca9-os-client-config\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:07.116645 master-0 kubenswrapper[33142]: I1204 01:07:07.116642 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nbrjt\" (UniqueName: \"kubernetes.io/projected/e9095d9b-8127-4abe-9519-53049c22eca9-kube-api-access-nbrjt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:07.213202 master-0 kubenswrapper[33142]: I1204 01:07:07.213128 33142 generic.go:334] "Generic (PLEG): container finished" podID="e9095d9b-8127-4abe-9519-53049c22eca9" containerID="4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38" exitCode=0 Dec 04 01:07:07.213202 master-0 kubenswrapper[33142]: I1204 01:07:07.213193 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" event={"ID":"e9095d9b-8127-4abe-9519-53049c22eca9","Type":"ContainerDied","Data":"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38"} Dec 04 01:07:07.213503 master-0 kubenswrapper[33142]: I1204 01:07:07.213227 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" event={"ID":"e9095d9b-8127-4abe-9519-53049c22eca9","Type":"ContainerDied","Data":"49609a32729795c6d8c6b1f9a9a9507e5cb4f17821035d6dcc6a8869d5494ccc"} Dec 04 01:07:07.213503 master-0 kubenswrapper[33142]: I1204 01:07:07.213257 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-spf9s" Dec 04 01:07:07.213503 master-0 kubenswrapper[33142]: I1204 01:07:07.213272 33142 scope.go:117] "RemoveContainer" containerID="4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38" Dec 04 01:07:07.218511 master-0 kubenswrapper[33142]: I1204 01:07:07.218458 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-82c9z\" (UniqueName: \"kubernetes.io/projected/e105e4fb-9e29-4c96-bf69-f9766a49332e-kube-api-access-82c9z\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.218602 master-0 kubenswrapper[33142]: I1204 01:07:07.218571 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e105e4fb-9e29-4c96-bf69-f9766a49332e-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.218602 master-0 kubenswrapper[33142]: I1204 01:07:07.218598 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e105e4fb-9e29-4c96-bf69-f9766a49332e-os-client-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.219656 master-0 kubenswrapper[33142]: I1204 01:07:07.219609 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/e105e4fb-9e29-4c96-bf69-f9766a49332e-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.222213 master-0 kubenswrapper[33142]: I1204 01:07:07.222134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/e105e4fb-9e29-4c96-bf69-f9766a49332e-os-client-config\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.237215 master-0 kubenswrapper[33142]: I1204 01:07:07.237164 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-82c9z\" (UniqueName: \"kubernetes.io/projected/e105e4fb-9e29-4c96-bf69-f9766a49332e-kube-api-access-82c9z\") pod \"sushy-emulator-64488c485f-xf8bb\" (UID: \"e105e4fb-9e29-4c96-bf69-f9766a49332e\") " pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.266764 master-0 kubenswrapper[33142]: I1204 01:07:07.266717 33142 scope.go:117] "RemoveContainer" containerID="4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38" Dec 04 01:07:07.267328 master-0 kubenswrapper[33142]: E1204 01:07:07.267297 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38\": container with ID starting with 4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38 not found: ID does not exist" containerID="4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38" Dec 04 01:07:07.267403 master-0 kubenswrapper[33142]: I1204 01:07:07.267337 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38"} err="failed to get container status \"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38\": rpc error: code = NotFound desc = could not find container \"4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38\": container with ID starting with 4c0bb7b5facd05fe976ab389f560d421813dc342f95b20e935b0b1565e3b1e38 not found: ID does not exist" Dec 04 01:07:07.268630 master-0 kubenswrapper[33142]: I1204 01:07:07.268598 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 01:07:07.284181 master-0 kubenswrapper[33142]: I1204 01:07:07.284087 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-spf9s"] Dec 04 01:07:07.450100 master-0 kubenswrapper[33142]: I1204 01:07:07.449966 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:07.916834 master-0 kubenswrapper[33142]: I1204 01:07:07.916772 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9095d9b-8127-4abe-9519-53049c22eca9" path="/var/lib/kubelet/pods/e9095d9b-8127-4abe-9519-53049c22eca9/volumes" Dec 04 01:07:08.052632 master-0 kubenswrapper[33142]: I1204 01:07:08.052545 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-xf8bb"] Dec 04 01:07:08.229357 master-0 kubenswrapper[33142]: I1204 01:07:08.229310 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" event={"ID":"e105e4fb-9e29-4c96-bf69-f9766a49332e","Type":"ContainerStarted","Data":"6f076bd12541c2404ef49ba83cba878493555c61cd5467968a07f5e88ab7c577"} Dec 04 01:07:09.250064 master-0 kubenswrapper[33142]: I1204 01:07:09.249978 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" event={"ID":"e105e4fb-9e29-4c96-bf69-f9766a49332e","Type":"ContainerStarted","Data":"35b66346f7d8ad9ddfc171a7e7ede79267c056874dc5fc5b18cda0650128fd66"} Dec 04 01:07:09.284986 master-0 kubenswrapper[33142]: I1204 01:07:09.284863 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" podStartSLOduration=3.284840593 podStartE2EDuration="3.284840593s" podCreationTimestamp="2025-12-04 01:07:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:07:09.273550635 +0000 UTC m=+1201.675552485" watchObservedRunningTime="2025-12-04 01:07:09.284840593 +0000 UTC m=+1201.686842443" Dec 04 01:07:17.450614 master-0 kubenswrapper[33142]: I1204 01:07:17.450509 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:17.451568 master-0 kubenswrapper[33142]: I1204 01:07:17.450740 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:17.461131 master-0 kubenswrapper[33142]: I1204 01:07:17.461044 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:18.383738 master-0 kubenswrapper[33142]: I1204 01:07:18.383645 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="sushy-emulator/sushy-emulator-64488c485f-xf8bb" Dec 04 01:07:21.427499 master-0 kubenswrapper[33142]: I1204 01:07:21.427408 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:21.433395 master-0 kubenswrapper[33142]: I1204 01:07:21.433102 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.449225 master-0 kubenswrapper[33142]: I1204 01:07:21.446937 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:21.537890 master-0 kubenswrapper[33142]: I1204 01:07:21.537622 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.538389 master-0 kubenswrapper[33142]: I1204 01:07:21.538325 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5qn\" (UniqueName: \"kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.538651 master-0 kubenswrapper[33142]: I1204 01:07:21.538598 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.641571 master-0 kubenswrapper[33142]: I1204 01:07:21.641470 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.641854 master-0 kubenswrapper[33142]: I1204 01:07:21.641634 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5qn\" (UniqueName: \"kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.641854 master-0 kubenswrapper[33142]: I1204 01:07:21.641680 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.642282 master-0 kubenswrapper[33142]: I1204 01:07:21.642227 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.642363 master-0 kubenswrapper[33142]: I1204 01:07:21.642312 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.664511 master-0 kubenswrapper[33142]: I1204 01:07:21.664439 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5qn\" (UniqueName: \"kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn\") pod \"community-operators-9tgx2\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:21.763580 master-0 kubenswrapper[33142]: I1204 01:07:21.763417 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:22.339327 master-0 kubenswrapper[33142]: W1204 01:07:22.339250 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbec7bb_75c9_4723_8d6a_a994c5235663.slice/crio-0d7af9e2281816de7db5698ddb1d884dca07c2a4c08cd5d34a3d6f4c540d7dac WatchSource:0}: Error finding container 0d7af9e2281816de7db5698ddb1d884dca07c2a4c08cd5d34a3d6f4c540d7dac: Status 404 returned error can't find the container with id 0d7af9e2281816de7db5698ddb1d884dca07c2a4c08cd5d34a3d6f4c540d7dac Dec 04 01:07:22.341424 master-0 kubenswrapper[33142]: I1204 01:07:22.341348 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:22.452594 master-0 kubenswrapper[33142]: I1204 01:07:22.452491 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerStarted","Data":"0d7af9e2281816de7db5698ddb1d884dca07c2a4c08cd5d34a3d6f4c540d7dac"} Dec 04 01:07:22.823410 master-0 kubenswrapper[33142]: E1204 01:07:22.823158 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbec7bb_75c9_4723_8d6a_a994c5235663.slice/crio-conmon-3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:07:23.470440 master-0 kubenswrapper[33142]: I1204 01:07:23.470237 33142 generic.go:334] "Generic (PLEG): container finished" podID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerID="3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14" exitCode=0 Dec 04 01:07:23.470440 master-0 kubenswrapper[33142]: I1204 01:07:23.470303 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerDied","Data":"3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14"} Dec 04 01:07:23.472826 master-0 kubenswrapper[33142]: I1204 01:07:23.472779 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 01:07:24.491549 master-0 kubenswrapper[33142]: I1204 01:07:24.491447 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerStarted","Data":"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027"} Dec 04 01:07:25.510438 master-0 kubenswrapper[33142]: I1204 01:07:25.510333 33142 generic.go:334] "Generic (PLEG): container finished" podID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerID="2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027" exitCode=0 Dec 04 01:07:25.510981 master-0 kubenswrapper[33142]: I1204 01:07:25.510456 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerDied","Data":"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027"} Dec 04 01:07:26.530278 master-0 kubenswrapper[33142]: I1204 01:07:26.530214 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerStarted","Data":"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d"} Dec 04 01:07:26.584981 master-0 kubenswrapper[33142]: I1204 01:07:26.583793 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-9tgx2" podStartSLOduration=3.13949999 podStartE2EDuration="5.583764643s" podCreationTimestamp="2025-12-04 01:07:21 +0000 UTC" firstStartedPulling="2025-12-04 01:07:23.472734437 +0000 UTC m=+1215.874736287" lastFinishedPulling="2025-12-04 01:07:25.91699909 +0000 UTC m=+1218.319000940" observedRunningTime="2025-12-04 01:07:26.557322358 +0000 UTC m=+1218.959324248" watchObservedRunningTime="2025-12-04 01:07:26.583764643 +0000 UTC m=+1218.985766513" Dec 04 01:07:31.763681 master-0 kubenswrapper[33142]: I1204 01:07:31.763594 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:31.763681 master-0 kubenswrapper[33142]: I1204 01:07:31.763683 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:31.827374 master-0 kubenswrapper[33142]: I1204 01:07:31.827309 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:32.695201 master-0 kubenswrapper[33142]: I1204 01:07:32.695109 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:32.778538 master-0 kubenswrapper[33142]: I1204 01:07:32.778452 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:34.504717 master-0 kubenswrapper[33142]: I1204 01:07:34.504640 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:34.509173 master-0 kubenswrapper[33142]: I1204 01:07:34.509085 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.525776 master-0 kubenswrapper[33142]: I1204 01:07:34.525658 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:34.549438 master-0 kubenswrapper[33142]: I1204 01:07:34.549313 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.550362 master-0 kubenswrapper[33142]: I1204 01:07:34.550279 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.550483 master-0 kubenswrapper[33142]: I1204 01:07:34.550396 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4mx\" (UniqueName: \"kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.654907 master-0 kubenswrapper[33142]: I1204 01:07:34.654842 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.654907 master-0 kubenswrapper[33142]: I1204 01:07:34.654135 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.655295 master-0 kubenswrapper[33142]: I1204 01:07:34.655253 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.655710 master-0 kubenswrapper[33142]: I1204 01:07:34.655684 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.655805 master-0 kubenswrapper[33142]: I1204 01:07:34.655733 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4mx\" (UniqueName: \"kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.658673 master-0 kubenswrapper[33142]: I1204 01:07:34.658589 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-9tgx2" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="registry-server" containerID="cri-o://eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d" gracePeriod=2 Dec 04 01:07:34.675429 master-0 kubenswrapper[33142]: I1204 01:07:34.675357 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4mx\" (UniqueName: \"kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx\") pod \"redhat-marketplace-bjf89\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:34.836829 master-0 kubenswrapper[33142]: I1204 01:07:34.836760 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:35.224275 master-0 kubenswrapper[33142]: I1204 01:07:35.224221 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:35.280379 master-0 kubenswrapper[33142]: I1204 01:07:35.280315 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq5qn\" (UniqueName: \"kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn\") pod \"9dbec7bb-75c9-4723-8d6a-a994c5235663\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " Dec 04 01:07:35.280806 master-0 kubenswrapper[33142]: I1204 01:07:35.280786 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content\") pod \"9dbec7bb-75c9-4723-8d6a-a994c5235663\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " Dec 04 01:07:35.280975 master-0 kubenswrapper[33142]: I1204 01:07:35.280956 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities\") pod \"9dbec7bb-75c9-4723-8d6a-a994c5235663\" (UID: \"9dbec7bb-75c9-4723-8d6a-a994c5235663\") " Dec 04 01:07:35.282071 master-0 kubenswrapper[33142]: I1204 01:07:35.281997 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities" (OuterVolumeSpecName: "utilities") pod "9dbec7bb-75c9-4723-8d6a-a994c5235663" (UID: "9dbec7bb-75c9-4723-8d6a-a994c5235663"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:07:35.282479 master-0 kubenswrapper[33142]: I1204 01:07:35.282452 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:35.288275 master-0 kubenswrapper[33142]: I1204 01:07:35.288183 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn" (OuterVolumeSpecName: "kube-api-access-nq5qn") pod "9dbec7bb-75c9-4723-8d6a-a994c5235663" (UID: "9dbec7bb-75c9-4723-8d6a-a994c5235663"). InnerVolumeSpecName "kube-api-access-nq5qn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:07:35.386213 master-0 kubenswrapper[33142]: I1204 01:07:35.386090 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nq5qn\" (UniqueName: \"kubernetes.io/projected/9dbec7bb-75c9-4723-8d6a-a994c5235663-kube-api-access-nq5qn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:35.639690 master-0 kubenswrapper[33142]: I1204 01:07:35.639520 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9dbec7bb-75c9-4723-8d6a-a994c5235663" (UID: "9dbec7bb-75c9-4723-8d6a-a994c5235663"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:07:35.670857 master-0 kubenswrapper[33142]: W1204 01:07:35.670499 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aa9bf7_65ce_4a06_b0f4_f9075032f77a.slice/crio-cfe4a823cf8ed23dd9318629e2905b6034616eff7e0594bd5e555a2133012445 WatchSource:0}: Error finding container cfe4a823cf8ed23dd9318629e2905b6034616eff7e0594bd5e555a2133012445: Status 404 returned error can't find the container with id cfe4a823cf8ed23dd9318629e2905b6034616eff7e0594bd5e555a2133012445 Dec 04 01:07:35.683384 master-0 kubenswrapper[33142]: I1204 01:07:35.683249 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:35.686461 master-0 kubenswrapper[33142]: I1204 01:07:35.686392 33142 generic.go:334] "Generic (PLEG): container finished" podID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerID="eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d" exitCode=0 Dec 04 01:07:35.686564 master-0 kubenswrapper[33142]: I1204 01:07:35.686471 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerDied","Data":"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d"} Dec 04 01:07:35.686564 master-0 kubenswrapper[33142]: I1204 01:07:35.686512 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-9tgx2" event={"ID":"9dbec7bb-75c9-4723-8d6a-a994c5235663","Type":"ContainerDied","Data":"0d7af9e2281816de7db5698ddb1d884dca07c2a4c08cd5d34a3d6f4c540d7dac"} Dec 04 01:07:35.686564 master-0 kubenswrapper[33142]: I1204 01:07:35.686535 33142 scope.go:117] "RemoveContainer" containerID="eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d" Dec 04 01:07:35.686791 master-0 kubenswrapper[33142]: I1204 01:07:35.686763 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-9tgx2" Dec 04 01:07:35.695330 master-0 kubenswrapper[33142]: I1204 01:07:35.695253 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9dbec7bb-75c9-4723-8d6a-a994c5235663-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:35.750499 master-0 kubenswrapper[33142]: I1204 01:07:35.750368 33142 scope.go:117] "RemoveContainer" containerID="2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027" Dec 04 01:07:35.771378 master-0 kubenswrapper[33142]: I1204 01:07:35.771329 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:35.784906 master-0 kubenswrapper[33142]: I1204 01:07:35.784845 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-9tgx2"] Dec 04 01:07:35.787169 master-0 kubenswrapper[33142]: I1204 01:07:35.786483 33142 scope.go:117] "RemoveContainer" containerID="3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14" Dec 04 01:07:35.881794 master-0 kubenswrapper[33142]: I1204 01:07:35.881688 33142 scope.go:117] "RemoveContainer" containerID="eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d" Dec 04 01:07:35.882361 master-0 kubenswrapper[33142]: E1204 01:07:35.882268 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d\": container with ID starting with eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d not found: ID does not exist" containerID="eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d" Dec 04 01:07:35.882361 master-0 kubenswrapper[33142]: I1204 01:07:35.882315 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d"} err="failed to get container status \"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d\": rpc error: code = NotFound desc = could not find container \"eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d\": container with ID starting with eadf1a87bacc41e9916129e62126b05cda27a20cc3510fe4d48c0239fb51a75d not found: ID does not exist" Dec 04 01:07:35.882361 master-0 kubenswrapper[33142]: I1204 01:07:35.882349 33142 scope.go:117] "RemoveContainer" containerID="2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027" Dec 04 01:07:35.882909 master-0 kubenswrapper[33142]: E1204 01:07:35.882794 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027\": container with ID starting with 2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027 not found: ID does not exist" containerID="2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027" Dec 04 01:07:35.882909 master-0 kubenswrapper[33142]: I1204 01:07:35.882824 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027"} err="failed to get container status \"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027\": rpc error: code = NotFound desc = could not find container \"2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027\": container with ID starting with 2419d5f572eb69795051e227ff843e8a513e12e439c3c5f078900733dec76027 not found: ID does not exist" Dec 04 01:07:35.882909 master-0 kubenswrapper[33142]: I1204 01:07:35.882844 33142 scope.go:117] "RemoveContainer" containerID="3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14" Dec 04 01:07:35.883427 master-0 kubenswrapper[33142]: E1204 01:07:35.883079 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14\": container with ID starting with 3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14 not found: ID does not exist" containerID="3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14" Dec 04 01:07:35.883427 master-0 kubenswrapper[33142]: I1204 01:07:35.883109 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14"} err="failed to get container status \"3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14\": rpc error: code = NotFound desc = could not find container \"3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14\": container with ID starting with 3f6a405293f2e2b7415bbde636d641750c3aba3d11f4fa14860cb3d2b3bb3d14 not found: ID does not exist" Dec 04 01:07:35.922442 master-0 kubenswrapper[33142]: I1204 01:07:35.922207 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" path="/var/lib/kubelet/pods/9dbec7bb-75c9-4723-8d6a-a994c5235663/volumes" Dec 04 01:07:36.702794 master-0 kubenswrapper[33142]: I1204 01:07:36.702670 33142 generic.go:334] "Generic (PLEG): container finished" podID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerID="76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79" exitCode=0 Dec 04 01:07:36.702794 master-0 kubenswrapper[33142]: I1204 01:07:36.702727 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerDied","Data":"76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79"} Dec 04 01:07:36.702794 master-0 kubenswrapper[33142]: I1204 01:07:36.702794 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerStarted","Data":"cfe4a823cf8ed23dd9318629e2905b6034616eff7e0594bd5e555a2133012445"} Dec 04 01:07:37.717603 master-0 kubenswrapper[33142]: I1204 01:07:37.717543 33142 generic.go:334] "Generic (PLEG): container finished" podID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerID="781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c" exitCode=0 Dec 04 01:07:37.717603 master-0 kubenswrapper[33142]: I1204 01:07:37.717596 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerDied","Data":"781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c"} Dec 04 01:07:37.795057 master-0 kubenswrapper[33142]: E1204 01:07:37.794875 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aa9bf7_65ce_4a06_b0f4_f9075032f77a.slice/crio-781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aa9bf7_65ce_4a06_b0f4_f9075032f77a.slice/crio-conmon-781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:07:37.795303 master-0 kubenswrapper[33142]: E1204 01:07:37.794874 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aa9bf7_65ce_4a06_b0f4_f9075032f77a.slice/crio-781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aa9bf7_65ce_4a06_b0f4_f9075032f77a.slice/crio-conmon-781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:07:38.734710 master-0 kubenswrapper[33142]: I1204 01:07:38.734534 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerStarted","Data":"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572"} Dec 04 01:07:38.760469 master-0 kubenswrapper[33142]: I1204 01:07:38.760344 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-bjf89" podStartSLOduration=3.333606176 podStartE2EDuration="4.760311552s" podCreationTimestamp="2025-12-04 01:07:34 +0000 UTC" firstStartedPulling="2025-12-04 01:07:36.704712335 +0000 UTC m=+1229.106714185" lastFinishedPulling="2025-12-04 01:07:38.131417701 +0000 UTC m=+1230.533419561" observedRunningTime="2025-12-04 01:07:38.755074354 +0000 UTC m=+1231.157076214" watchObservedRunningTime="2025-12-04 01:07:38.760311552 +0000 UTC m=+1231.162313422" Dec 04 01:07:44.837999 master-0 kubenswrapper[33142]: I1204 01:07:44.837894 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:44.837999 master-0 kubenswrapper[33142]: I1204 01:07:44.838005 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:44.910668 master-0 kubenswrapper[33142]: I1204 01:07:44.909876 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:45.916161 master-0 kubenswrapper[33142]: I1204 01:07:45.916111 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:45.987186 master-0 kubenswrapper[33142]: I1204 01:07:45.987117 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:47.882533 master-0 kubenswrapper[33142]: I1204 01:07:47.882428 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-bjf89" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="registry-server" containerID="cri-o://8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572" gracePeriod=2 Dec 04 01:07:48.556625 master-0 kubenswrapper[33142]: I1204 01:07:48.556563 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:48.682018 master-0 kubenswrapper[33142]: I1204 01:07:48.679678 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content\") pod \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " Dec 04 01:07:48.682018 master-0 kubenswrapper[33142]: I1204 01:07:48.681810 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities\") pod \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " Dec 04 01:07:48.682018 master-0 kubenswrapper[33142]: I1204 01:07:48.681965 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs4mx\" (UniqueName: \"kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx\") pod \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\" (UID: \"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a\") " Dec 04 01:07:48.687310 master-0 kubenswrapper[33142]: I1204 01:07:48.687159 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities" (OuterVolumeSpecName: "utilities") pod "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" (UID: "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:07:48.690676 master-0 kubenswrapper[33142]: I1204 01:07:48.690588 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx" (OuterVolumeSpecName: "kube-api-access-fs4mx") pod "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" (UID: "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a"). InnerVolumeSpecName "kube-api-access-fs4mx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:07:48.717785 master-0 kubenswrapper[33142]: I1204 01:07:48.717697 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" (UID: "b0aa9bf7-65ce-4a06-b0f4-f9075032f77a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:07:48.786977 master-0 kubenswrapper[33142]: I1204 01:07:48.786865 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:48.786977 master-0 kubenswrapper[33142]: I1204 01:07:48.786951 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:48.786977 master-0 kubenswrapper[33142]: I1204 01:07:48.786962 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fs4mx\" (UniqueName: \"kubernetes.io/projected/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a-kube-api-access-fs4mx\") on node \"master-0\" DevicePath \"\"" Dec 04 01:07:48.897068 master-0 kubenswrapper[33142]: I1204 01:07:48.896990 33142 generic.go:334] "Generic (PLEG): container finished" podID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerID="8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572" exitCode=0 Dec 04 01:07:48.897670 master-0 kubenswrapper[33142]: I1204 01:07:48.897073 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-bjf89" Dec 04 01:07:48.897670 master-0 kubenswrapper[33142]: I1204 01:07:48.897076 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerDied","Data":"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572"} Dec 04 01:07:48.897670 master-0 kubenswrapper[33142]: I1204 01:07:48.897376 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-bjf89" event={"ID":"b0aa9bf7-65ce-4a06-b0f4-f9075032f77a","Type":"ContainerDied","Data":"cfe4a823cf8ed23dd9318629e2905b6034616eff7e0594bd5e555a2133012445"} Dec 04 01:07:48.897670 master-0 kubenswrapper[33142]: I1204 01:07:48.897480 33142 scope.go:117] "RemoveContainer" containerID="8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572" Dec 04 01:07:48.943696 master-0 kubenswrapper[33142]: I1204 01:07:48.943531 33142 scope.go:117] "RemoveContainer" containerID="781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c" Dec 04 01:07:48.956746 master-0 kubenswrapper[33142]: I1204 01:07:48.956658 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:48.988681 master-0 kubenswrapper[33142]: I1204 01:07:48.988559 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-bjf89"] Dec 04 01:07:49.006457 master-0 kubenswrapper[33142]: I1204 01:07:49.006409 33142 scope.go:117] "RemoveContainer" containerID="76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79" Dec 04 01:07:49.059573 master-0 kubenswrapper[33142]: I1204 01:07:49.059488 33142 scope.go:117] "RemoveContainer" containerID="8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572" Dec 04 01:07:49.060481 master-0 kubenswrapper[33142]: E1204 01:07:49.060378 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572\": container with ID starting with 8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572 not found: ID does not exist" containerID="8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572" Dec 04 01:07:49.060481 master-0 kubenswrapper[33142]: I1204 01:07:49.060432 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572"} err="failed to get container status \"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572\": rpc error: code = NotFound desc = could not find container \"8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572\": container with ID starting with 8b502abeac4a064d856aacaa21b83aef59734cb8074a6580818ef8e844944572 not found: ID does not exist" Dec 04 01:07:49.060481 master-0 kubenswrapper[33142]: I1204 01:07:49.060463 33142 scope.go:117] "RemoveContainer" containerID="781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c" Dec 04 01:07:49.061137 master-0 kubenswrapper[33142]: E1204 01:07:49.061085 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c\": container with ID starting with 781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c not found: ID does not exist" containerID="781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c" Dec 04 01:07:49.061221 master-0 kubenswrapper[33142]: I1204 01:07:49.061156 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c"} err="failed to get container status \"781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c\": rpc error: code = NotFound desc = could not find container \"781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c\": container with ID starting with 781cde47679d07aec3db4d606b585b8d48774b522cc3e60dc1cfe403cc735b2c not found: ID does not exist" Dec 04 01:07:49.061221 master-0 kubenswrapper[33142]: I1204 01:07:49.061206 33142 scope.go:117] "RemoveContainer" containerID="76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79" Dec 04 01:07:49.061676 master-0 kubenswrapper[33142]: E1204 01:07:49.061619 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79\": container with ID starting with 76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79 not found: ID does not exist" containerID="76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79" Dec 04 01:07:49.061757 master-0 kubenswrapper[33142]: I1204 01:07:49.061694 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79"} err="failed to get container status \"76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79\": rpc error: code = NotFound desc = could not find container \"76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79\": container with ID starting with 76bb5f6f16746d51d8002a6a278b3476e1eff80479ab873514d83bc8c6913d79 not found: ID does not exist" Dec 04 01:07:49.914561 master-0 kubenswrapper[33142]: I1204 01:07:49.914478 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" path="/var/lib/kubelet/pods/b0aa9bf7-65ce-4a06-b0f4-f9075032f77a/volumes" Dec 04 01:08:15.198611 master-0 kubenswrapper[33142]: I1204 01:08:15.198482 33142 scope.go:117] "RemoveContainer" containerID="adb976b65cc27698aba117e0a2ebe1e8b07615e47d5b55a4684e5e4b17657a5a" Dec 04 01:08:15.227281 master-0 kubenswrapper[33142]: I1204 01:08:15.227214 33142 scope.go:117] "RemoveContainer" containerID="b7b26acabdaa55a8c44e7fdbabdb4d4941489421964a4ea46acce2f01b26ecce" Dec 04 01:09:15.360101 master-0 kubenswrapper[33142]: I1204 01:09:15.360029 33142 scope.go:117] "RemoveContainer" containerID="a300518533bfe9f38c86a41ff778da16a919b21033f45e1b80bbe58145e6f4f0" Dec 04 01:09:15.403638 master-0 kubenswrapper[33142]: I1204 01:09:15.402292 33142 scope.go:117] "RemoveContainer" containerID="74836ace3f856ae90c3f027921bc8b96b7a45feee9ed64cb26eac5b0419d52f4" Dec 04 01:09:15.443633 master-0 kubenswrapper[33142]: I1204 01:09:15.443583 33142 scope.go:117] "RemoveContainer" containerID="1ea58279fa62fdfdf1596dd46d4b465ef6cfc0f3bbbf920b0146b76ae883ff71" Dec 04 01:09:15.504708 master-0 kubenswrapper[33142]: I1204 01:09:15.504640 33142 scope.go:117] "RemoveContainer" containerID="0e6dfaf27ac90b0f6ca2302ccd5cbbd9907078df503f3aee5d36e1230393fe3b" Dec 04 01:09:15.566183 master-0 kubenswrapper[33142]: I1204 01:09:15.566115 33142 scope.go:117] "RemoveContainer" containerID="8a4a32a68918c7c2c02dc4f9e4b1a913c917e1d22cd9c29e85df0da93e47f23b" Dec 04 01:09:15.619504 master-0 kubenswrapper[33142]: I1204 01:09:15.619431 33142 scope.go:117] "RemoveContainer" containerID="78446d3325aec54ecb3e60f698657f74182c8fe8aa8837352b71aa034a22f212" Dec 04 01:09:15.660470 master-0 kubenswrapper[33142]: I1204 01:09:15.660411 33142 scope.go:117] "RemoveContainer" containerID="aa50042ecba39c07f14c6cf4387963475a006dc1bd7af76149e80e04659e09c9" Dec 04 01:09:27.655310 master-0 kubenswrapper[33142]: E1204 01:09:27.655190 33142 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 192.168.32.10:47872->192.168.32.10:43811: read tcp 192.168.32.10:47872->192.168.32.10:43811: read: connection reset by peer Dec 04 01:10:15.803531 master-0 kubenswrapper[33142]: I1204 01:10:15.803429 33142 scope.go:117] "RemoveContainer" containerID="101a56872548c49880477917a27fb329e7cc2f55da6dc7baf4f946bdd8feb2d4" Dec 04 01:10:15.833054 master-0 kubenswrapper[33142]: I1204 01:10:15.833006 33142 scope.go:117] "RemoveContainer" containerID="c95f5cd2ee4faef7f39bb5ee350add098b202d68175c9f2586aa5695c11976f0" Dec 04 01:12:15.961185 master-0 kubenswrapper[33142]: I1204 01:12:15.961093 33142 scope.go:117] "RemoveContainer" containerID="607c3ffbd1a3bd670503acd9c79298ad4e8c1b3423a6a56ec98f3ca0e53e88e4" Dec 04 01:12:15.999329 master-0 kubenswrapper[33142]: I1204 01:12:15.999262 33142 scope.go:117] "RemoveContainer" containerID="232325de57a3e257c1d41403809d16b1d424d8cb2fb8a8135c5f6c212b122835" Dec 04 01:12:16.025410 master-0 kubenswrapper[33142]: I1204 01:12:16.025346 33142 scope.go:117] "RemoveContainer" containerID="425a48612f08a21f66f377361609c75ff7e57722567793d28533efeae0cd8800" Dec 04 01:12:16.059519 master-0 kubenswrapper[33142]: I1204 01:12:16.059459 33142 scope.go:117] "RemoveContainer" containerID="c455fb7a1678fea6dd5d62104436b47b25bd3119afb7b9d1c8d4458508006259" Dec 04 01:12:24.071252 master-0 kubenswrapper[33142]: I1204 01:12:24.071144 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-3055-account-create-update-wzvdp"] Dec 04 01:12:24.087176 master-0 kubenswrapper[33142]: I1204 01:12:24.087073 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-db-create-dznzz"] Dec 04 01:12:24.103086 master-0 kubenswrapper[33142]: I1204 01:12:24.102896 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-3055-account-create-update-wzvdp"] Dec 04 01:12:24.116102 master-0 kubenswrapper[33142]: I1204 01:12:24.116033 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-db-create-dznzz"] Dec 04 01:12:25.925949 master-0 kubenswrapper[33142]: I1204 01:12:25.925846 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81563256-d2c5-4528-8e4f-d0aa5ed88bc7" path="/var/lib/kubelet/pods/81563256-d2c5-4528-8e4f-d0aa5ed88bc7/volumes" Dec 04 01:12:25.926820 master-0 kubenswrapper[33142]: I1204 01:12:25.926786 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d803fea-abf9-409b-ba05-3859cddb9a61" path="/var/lib/kubelet/pods/8d803fea-abf9-409b-ba05-3859cddb9a61/volumes" Dec 04 01:12:40.067211 master-0 kubenswrapper[33142]: I1204 01:12:40.066844 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-e4ec-account-create-update-dp9v4"] Dec 04 01:12:40.084317 master-0 kubenswrapper[33142]: I1204 01:12:40.084241 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-e4ec-account-create-update-dp9v4"] Dec 04 01:12:41.187800 master-0 kubenswrapper[33142]: I1204 01:12:41.187687 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-5b74-account-create-update-jdwpk"] Dec 04 01:12:41.201033 master-0 kubenswrapper[33142]: I1204 01:12:41.200958 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-db-create-25l22"] Dec 04 01:12:41.218144 master-0 kubenswrapper[33142]: I1204 01:12:41.218084 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-db-create-58skt"] Dec 04 01:12:41.229649 master-0 kubenswrapper[33142]: I1204 01:12:41.229526 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-5b74-account-create-update-jdwpk"] Dec 04 01:12:41.240579 master-0 kubenswrapper[33142]: I1204 01:12:41.240467 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-db-create-25l22"] Dec 04 01:12:41.253070 master-0 kubenswrapper[33142]: I1204 01:12:41.252981 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-db-create-58skt"] Dec 04 01:12:41.917684 master-0 kubenswrapper[33142]: I1204 01:12:41.917598 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1184467a-cc92-43c0-81d8-43f3c56d3760" path="/var/lib/kubelet/pods/1184467a-cc92-43c0-81d8-43f3c56d3760/volumes" Dec 04 01:12:41.918687 master-0 kubenswrapper[33142]: I1204 01:12:41.918655 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c316750-7605-4e15-8a2b-ffb9877de6e4" path="/var/lib/kubelet/pods/2c316750-7605-4e15-8a2b-ffb9877de6e4/volumes" Dec 04 01:12:41.919747 master-0 kubenswrapper[33142]: I1204 01:12:41.919718 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b2062a-68af-4067-861b-fc33151f7a10" path="/var/lib/kubelet/pods/57b2062a-68af-4067-861b-fc33151f7a10/volumes" Dec 04 01:12:41.920689 master-0 kubenswrapper[33142]: I1204 01:12:41.920618 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6b31b9a-5aa5-475d-a093-86ae2ce98694" path="/var/lib/kubelet/pods/f6b31b9a-5aa5-475d-a093-86ae2ce98694/volumes" Dec 04 01:12:47.232992 master-0 kubenswrapper[33142]: I1204 01:12:47.232854 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-db-create-lgnv9"] Dec 04 01:12:47.250162 master-0 kubenswrapper[33142]: I1204 01:12:47.250010 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-732e-account-create-update-r5lnh"] Dec 04 01:12:47.285141 master-0 kubenswrapper[33142]: I1204 01:12:47.285025 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-db-create-lgnv9"] Dec 04 01:12:47.312539 master-0 kubenswrapper[33142]: I1204 01:12:47.311120 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-732e-account-create-update-r5lnh"] Dec 04 01:12:47.325905 master-0 kubenswrapper[33142]: I1204 01:12:47.325834 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-db-create-2wcw4"] Dec 04 01:12:47.339916 master-0 kubenswrapper[33142]: I1204 01:12:47.339821 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-4e38-account-create-update-ktrnh"] Dec 04 01:12:47.356281 master-0 kubenswrapper[33142]: I1204 01:12:47.356188 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-4e38-account-create-update-ktrnh"] Dec 04 01:12:47.371823 master-0 kubenswrapper[33142]: I1204 01:12:47.371686 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-db-create-2wcw4"] Dec 04 01:12:47.918227 master-0 kubenswrapper[33142]: I1204 01:12:47.918130 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16464e54-554e-4e4f-beb7-27229e08fc4b" path="/var/lib/kubelet/pods/16464e54-554e-4e4f-beb7-27229e08fc4b/volumes" Dec 04 01:12:47.919266 master-0 kubenswrapper[33142]: I1204 01:12:47.919219 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b920064-b05e-4929-a352-f7d2fd03e688" path="/var/lib/kubelet/pods/1b920064-b05e-4929-a352-f7d2fd03e688/volumes" Dec 04 01:12:47.920181 master-0 kubenswrapper[33142]: I1204 01:12:47.920131 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4085e59-a2cf-46bd-9d24-980a0423a6c6" path="/var/lib/kubelet/pods/a4085e59-a2cf-46bd-9d24-980a0423a6c6/volumes" Dec 04 01:12:47.922093 master-0 kubenswrapper[33142]: I1204 01:12:47.920904 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d571241f-d1c4-43fb-ad16-450fd86e9575" path="/var/lib/kubelet/pods/d571241f-d1c4-43fb-ad16-450fd86e9575/volumes" Dec 04 01:12:52.065540 master-0 kubenswrapper[33142]: I1204 01:12:52.065442 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-db-sync-lflzk"] Dec 04 01:12:52.100791 master-0 kubenswrapper[33142]: I1204 01:12:52.100697 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-db-sync-lflzk"] Dec 04 01:12:53.916903 master-0 kubenswrapper[33142]: I1204 01:12:53.916143 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d14747-33b8-47fd-b63c-25f4982d6308" path="/var/lib/kubelet/pods/45d14747-33b8-47fd-b63c-25f4982d6308/volumes" Dec 04 01:12:59.065322 master-0 kubenswrapper[33142]: I1204 01:12:59.065245 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-db-sync-qbvdt"] Dec 04 01:12:59.077825 master-0 kubenswrapper[33142]: I1204 01:12:59.077756 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-db-sync-qbvdt"] Dec 04 01:12:59.920431 master-0 kubenswrapper[33142]: I1204 01:12:59.920309 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba" path="/var/lib/kubelet/pods/bf0bcf9c-3c0e-4a2b-9088-71bb133f62ba/volumes" Dec 04 01:13:05.052056 master-0 kubenswrapper[33142]: I1204 01:13:05.051608 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-db-create-m84rq"] Dec 04 01:13:05.067504 master-0 kubenswrapper[33142]: I1204 01:13:05.067427 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-db-create-m84rq"] Dec 04 01:13:05.917225 master-0 kubenswrapper[33142]: I1204 01:13:05.917135 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29205676-7f10-4874-915c-b51cb930c167" path="/var/lib/kubelet/pods/29205676-7f10-4874-915c-b51cb930c167/volumes" Dec 04 01:13:06.067521 master-0 kubenswrapper[33142]: I1204 01:13:06.067397 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-f3f8-account-create-update-fk7gt"] Dec 04 01:13:06.084217 master-0 kubenswrapper[33142]: I1204 01:13:06.084144 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-f3f8-account-create-update-fk7gt"] Dec 04 01:13:07.928961 master-0 kubenswrapper[33142]: I1204 01:13:07.928652 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125375c7-fdde-48fe-a995-35943901b8ca" path="/var/lib/kubelet/pods/125375c7-fdde-48fe-a995-35943901b8ca/volumes" Dec 04 01:13:16.167446 master-0 kubenswrapper[33142]: I1204 01:13:16.167386 33142 scope.go:117] "RemoveContainer" containerID="dfc658322c3522148f451458560f615c07f8acba09c6466b8378985bc947fe8f" Dec 04 01:13:16.200648 master-0 kubenswrapper[33142]: I1204 01:13:16.200487 33142 scope.go:117] "RemoveContainer" containerID="e57c1757ae785f2973640a0625edaa45799660ff2542d9382184af2765f5e48c" Dec 04 01:13:16.303593 master-0 kubenswrapper[33142]: I1204 01:13:16.303536 33142 scope.go:117] "RemoveContainer" containerID="d278891a9bc725a4065ecbb2f41a64daec59fbb6aaefc0db046e4f1f5889df80" Dec 04 01:13:16.347192 master-0 kubenswrapper[33142]: I1204 01:13:16.347138 33142 scope.go:117] "RemoveContainer" containerID="5a7dc8a2c839a793f49bcb27969212972c083d3d12d184f2c543c34c2b4cbaad" Dec 04 01:13:16.406633 master-0 kubenswrapper[33142]: I1204 01:13:16.406571 33142 scope.go:117] "RemoveContainer" containerID="97406cf5455ed24c46eba551e7c329b83da958b3d731f40612c67eb2cf228234" Dec 04 01:13:16.479543 master-0 kubenswrapper[33142]: I1204 01:13:16.479444 33142 scope.go:117] "RemoveContainer" containerID="a64601a695eec1270bb2fc37480e88cec18c1cfaf5569cdc2b9cb5869f6bd66f" Dec 04 01:13:16.535645 master-0 kubenswrapper[33142]: I1204 01:13:16.535536 33142 scope.go:117] "RemoveContainer" containerID="74f3c369fa4dd53f62d7ff24f43bd40742766ed54cb869e202077b7abd58abad" Dec 04 01:13:16.566141 master-0 kubenswrapper[33142]: I1204 01:13:16.566008 33142 scope.go:117] "RemoveContainer" containerID="13e4ea8bb4876387d87dd6646c84e4927d4c1fcb8cfd693dac49a4cbf7762892" Dec 04 01:13:16.622332 master-0 kubenswrapper[33142]: I1204 01:13:16.622265 33142 scope.go:117] "RemoveContainer" containerID="ffb444dab5c1bd9f0e45fa9dcc12924c1271914e6b6a488955d04092508278fe" Dec 04 01:13:16.662970 master-0 kubenswrapper[33142]: I1204 01:13:16.662857 33142 scope.go:117] "RemoveContainer" containerID="4ac38acd5edb6d343da73dd6cd6d8e23942fe2f84cbc2ba06a600e56a448014f" Dec 04 01:13:16.696118 master-0 kubenswrapper[33142]: I1204 01:13:16.694760 33142 scope.go:117] "RemoveContainer" containerID="089fc0fb72d14986e2b5656005f959fb02ef2ea610c1ec2b57fb37911312627b" Dec 04 01:13:16.732708 master-0 kubenswrapper[33142]: I1204 01:13:16.732664 33142 scope.go:117] "RemoveContainer" containerID="4e7306a064f2e09abfee29feeb76f35824f786b7128cdd43a36e3b2f6c39dc6d" Dec 04 01:13:16.770981 master-0 kubenswrapper[33142]: I1204 01:13:16.770915 33142 scope.go:117] "RemoveContainer" containerID="cd3bae5feaace0e8c1b62f5fba7247a81e94714a4a439dd0fd1e24fb0b05dea0" Dec 04 01:13:16.807634 master-0 kubenswrapper[33142]: I1204 01:13:16.807579 33142 scope.go:117] "RemoveContainer" containerID="8f9f493caf985b4f4ff7f89f4036ab389e1fdfdde539c98755c5337450c5b855" Dec 04 01:13:22.062654 master-0 kubenswrapper[33142]: I1204 01:13:22.062479 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-db-sync-58zcd"] Dec 04 01:13:22.080868 master-0 kubenswrapper[33142]: I1204 01:13:22.080762 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-db-sync-58zcd"] Dec 04 01:13:23.069269 master-0 kubenswrapper[33142]: I1204 01:13:23.069177 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-bootstrap-lkjzz"] Dec 04 01:13:23.082039 master-0 kubenswrapper[33142]: I1204 01:13:23.081656 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-bootstrap-lkjzz"] Dec 04 01:13:23.913839 master-0 kubenswrapper[33142]: I1204 01:13:23.913739 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a2beb48-192c-4487-8d69-6f673f6b2902" path="/var/lib/kubelet/pods/2a2beb48-192c-4487-8d69-6f673f6b2902/volumes" Dec 04 01:13:23.917749 master-0 kubenswrapper[33142]: I1204 01:13:23.917662 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2babf62-20c4-489b-9996-abb9a74b6fe0" path="/var/lib/kubelet/pods/d2babf62-20c4-489b-9996-abb9a74b6fe0/volumes" Dec 04 01:13:31.068620 master-0 kubenswrapper[33142]: I1204 01:13:31.068326 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-db-sync-sm4dc"] Dec 04 01:13:31.083241 master-0 kubenswrapper[33142]: I1204 01:13:31.082220 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-db-sync-sm4dc"] Dec 04 01:13:31.916004 master-0 kubenswrapper[33142]: I1204 01:13:31.915891 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88cf271-c65e-4b97-8145-3b27c194747c" path="/var/lib/kubelet/pods/c88cf271-c65e-4b97-8145-3b27c194747c/volumes" Dec 04 01:13:37.046061 master-0 kubenswrapper[33142]: I1204 01:13:37.045946 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-10f14-db-sync-2gqvs"] Dec 04 01:13:37.060349 master-0 kubenswrapper[33142]: I1204 01:13:37.060246 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-10f14-db-sync-2gqvs"] Dec 04 01:13:37.921520 master-0 kubenswrapper[33142]: I1204 01:13:37.921455 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dae1eb-04ee-4e59-b07a-d50dd95bbca5" path="/var/lib/kubelet/pods/59dae1eb-04ee-4e59-b07a-d50dd95bbca5/volumes" Dec 04 01:13:46.057392 master-0 kubenswrapper[33142]: I1204 01:13:46.056995 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-db-sync-7jmp5"] Dec 04 01:13:46.069338 master-0 kubenswrapper[33142]: I1204 01:13:46.068983 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-db-sync-7jmp5"] Dec 04 01:13:47.920068 master-0 kubenswrapper[33142]: I1204 01:13:47.919856 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b60ff8-26fd-4896-966a-24078d04bfbf" path="/var/lib/kubelet/pods/58b60ff8-26fd-4896-966a-24078d04bfbf/volumes" Dec 04 01:13:53.055623 master-0 kubenswrapper[33142]: I1204 01:13:53.055535 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-db-create-dqvwx"] Dec 04 01:13:53.073312 master-0 kubenswrapper[33142]: I1204 01:13:53.073191 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-05b7-account-create-update-9pb5q"] Dec 04 01:13:53.091287 master-0 kubenswrapper[33142]: I1204 01:13:53.091175 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-db-create-dqvwx"] Dec 04 01:13:53.111125 master-0 kubenswrapper[33142]: I1204 01:13:53.111043 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-05b7-account-create-update-9pb5q"] Dec 04 01:13:53.916676 master-0 kubenswrapper[33142]: I1204 01:13:53.916591 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a3bddd-ade5-4f66-995d-ce71f0a04b5f" path="/var/lib/kubelet/pods/15a3bddd-ade5-4f66-995d-ce71f0a04b5f/volumes" Dec 04 01:13:53.918999 master-0 kubenswrapper[33142]: I1204 01:13:53.918908 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9316ecfd-a283-41ed-a77e-225a9e118d4e" path="/var/lib/kubelet/pods/9316ecfd-a283-41ed-a77e-225a9e118d4e/volumes" Dec 04 01:14:13.063219 master-0 kubenswrapper[33142]: I1204 01:14:13.063091 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-db-create-l2gwx"] Dec 04 01:14:13.076180 master-0 kubenswrapper[33142]: I1204 01:14:13.076066 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-db-create-l2gwx"] Dec 04 01:14:13.913467 master-0 kubenswrapper[33142]: I1204 01:14:13.913331 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e188023-eca9-47e4-ac09-df6f8e493921" path="/var/lib/kubelet/pods/2e188023-eca9-47e4-ac09-df6f8e493921/volumes" Dec 04 01:14:17.218292 master-0 kubenswrapper[33142]: I1204 01:14:17.218221 33142 scope.go:117] "RemoveContainer" containerID="2fe812c39cd76ac5b0fe8b278f98c8b8cb5339ce17113c310010895eee019184" Dec 04 01:14:17.284915 master-0 kubenswrapper[33142]: I1204 01:14:17.284857 33142 scope.go:117] "RemoveContainer" containerID="a2fee84d6d01ffcdcf4710e79b29cedb8137be5e626cc00a124da408bd00f405" Dec 04 01:14:17.355533 master-0 kubenswrapper[33142]: I1204 01:14:17.355465 33142 scope.go:117] "RemoveContainer" containerID="65b2c8662a5081c12f6c8cbc2ca0fbbc3b9f28f33769ca04ced16a18ea3ac440" Dec 04 01:14:17.421855 master-0 kubenswrapper[33142]: I1204 01:14:17.421793 33142 scope.go:117] "RemoveContainer" containerID="85b7e26c17dcfe2624defd6e1dc1ae0f6985a68ef47cda7e1a7ead51b8149e0d" Dec 04 01:14:17.457107 master-0 kubenswrapper[33142]: I1204 01:14:17.457062 33142 scope.go:117] "RemoveContainer" containerID="553b25d966bb2fca72ed90c996b55eeb4147aad9853d8a7cf2abbf172ad44faf" Dec 04 01:14:17.518709 master-0 kubenswrapper[33142]: I1204 01:14:17.518633 33142 scope.go:117] "RemoveContainer" containerID="8cbb2f1dc31ebb1f1e0a69df6ac0be55d3e04892e565bcff8bd3af318ada64d8" Dec 04 01:14:17.551940 master-0 kubenswrapper[33142]: I1204 01:14:17.551868 33142 scope.go:117] "RemoveContainer" containerID="952873a598e4610a0b37cf6fa37af74cf426d4627113b18c934e47799445a020" Dec 04 01:14:17.582181 master-0 kubenswrapper[33142]: I1204 01:14:17.582133 33142 scope.go:117] "RemoveContainer" containerID="104f0fda26869ae0955d8751b2df4164c625dbef7a3a6bbcbf286cde410ced76" Dec 04 01:14:17.605053 master-0 kubenswrapper[33142]: I1204 01:14:17.605007 33142 scope.go:117] "RemoveContainer" containerID="9b2b8f16edfb8779700075ee642590335913fc12d212a5a35429654ecd4b23cf" Dec 04 01:14:18.056861 master-0 kubenswrapper[33142]: I1204 01:14:18.056659 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-db-create-lgv5d"] Dec 04 01:14:18.080497 master-0 kubenswrapper[33142]: I1204 01:14:18.079737 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-8b00-account-create-update-q75wg"] Dec 04 01:14:18.090491 master-0 kubenswrapper[33142]: I1204 01:14:18.090431 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-db-create-85tml"] Dec 04 01:14:18.100138 master-0 kubenswrapper[33142]: I1204 01:14:18.100091 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-435d-account-create-update-9c4j5"] Dec 04 01:14:18.110671 master-0 kubenswrapper[33142]: I1204 01:14:18.110580 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-db-create-lgv5d"] Dec 04 01:14:18.125146 master-0 kubenswrapper[33142]: I1204 01:14:18.125050 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-db-create-85tml"] Dec 04 01:14:18.139333 master-0 kubenswrapper[33142]: I1204 01:14:18.139247 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-6366-account-create-update-jxntm"] Dec 04 01:14:18.157275 master-0 kubenswrapper[33142]: I1204 01:14:18.157166 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-8b00-account-create-update-q75wg"] Dec 04 01:14:18.172139 master-0 kubenswrapper[33142]: I1204 01:14:18.172033 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-6366-account-create-update-jxntm"] Dec 04 01:14:18.186938 master-0 kubenswrapper[33142]: I1204 01:14:18.186827 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-435d-account-create-update-9c4j5"] Dec 04 01:14:19.913764 master-0 kubenswrapper[33142]: I1204 01:14:19.913678 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2365f76d-99b8-47bd-a60f-c2d5bfb019d4" path="/var/lib/kubelet/pods/2365f76d-99b8-47bd-a60f-c2d5bfb019d4/volumes" Dec 04 01:14:19.914611 master-0 kubenswrapper[33142]: I1204 01:14:19.914339 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374a1faa-b897-416f-a67a-e12a6ab22f87" path="/var/lib/kubelet/pods/374a1faa-b897-416f-a67a-e12a6ab22f87/volumes" Dec 04 01:14:19.915047 master-0 kubenswrapper[33142]: I1204 01:14:19.914920 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d9718c-28a1-4841-9258-10f477cfcbf5" path="/var/lib/kubelet/pods/42d9718c-28a1-4841-9258-10f477cfcbf5/volumes" Dec 04 01:14:19.915558 master-0 kubenswrapper[33142]: I1204 01:14:19.915523 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8134968-9742-489a-a71b-ae48af42f8fe" path="/var/lib/kubelet/pods/a8134968-9742-489a-a71b-ae48af42f8fe/volumes" Dec 04 01:14:19.916802 master-0 kubenswrapper[33142]: I1204 01:14:19.916766 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76d6e99-a5be-4091-a768-a9724f60d131" path="/var/lib/kubelet/pods/d76d6e99-a5be-4091-a768-a9724f60d131/volumes" Dec 04 01:14:26.047469 master-0 kubenswrapper[33142]: I1204 01:14:26.046748 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-db-sync-dj4f6"] Dec 04 01:14:26.066171 master-0 kubenswrapper[33142]: I1204 01:14:26.061675 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-db-sync-dj4f6"] Dec 04 01:14:27.912035 master-0 kubenswrapper[33142]: I1204 01:14:27.911941 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1810313a-9368-4f9b-9457-205dadd3a2b7" path="/var/lib/kubelet/pods/1810313a-9368-4f9b-9457-205dadd3a2b7/volumes" Dec 04 01:15:00.172311 master-0 kubenswrapper[33142]: I1204 01:15:00.172240 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs"] Dec 04 01:15:00.173149 master-0 kubenswrapper[33142]: E1204 01:15:00.173116 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="extract-utilities" Dec 04 01:15:00.173207 master-0 kubenswrapper[33142]: I1204 01:15:00.173151 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="extract-utilities" Dec 04 01:15:00.173246 master-0 kubenswrapper[33142]: E1204 01:15:00.173223 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="extract-content" Dec 04 01:15:00.173246 master-0 kubenswrapper[33142]: I1204 01:15:00.173240 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="extract-content" Dec 04 01:15:00.173306 master-0 kubenswrapper[33142]: E1204 01:15:00.173274 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="extract-content" Dec 04 01:15:00.173306 master-0 kubenswrapper[33142]: I1204 01:15:00.173283 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="extract-content" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: E1204 01:15:00.173308 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="registry-server" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: I1204 01:15:00.173317 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="registry-server" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: E1204 01:15:00.173334 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="registry-server" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: I1204 01:15:00.173342 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="registry-server" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: E1204 01:15:00.173358 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="extract-utilities" Dec 04 01:15:00.173374 master-0 kubenswrapper[33142]: I1204 01:15:00.173367 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="extract-utilities" Dec 04 01:15:00.173885 master-0 kubenswrapper[33142]: I1204 01:15:00.173648 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0aa9bf7-65ce-4a06-b0f4-f9075032f77a" containerName="registry-server" Dec 04 01:15:00.173885 master-0 kubenswrapper[33142]: I1204 01:15:00.173696 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dbec7bb-75c9-4723-8d6a-a994c5235663" containerName="registry-server" Dec 04 01:15:00.174886 master-0 kubenswrapper[33142]: I1204 01:15:00.174852 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.177682 master-0 kubenswrapper[33142]: I1204 01:15:00.177582 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-zx2gd" Dec 04 01:15:00.178229 master-0 kubenswrapper[33142]: I1204 01:15:00.178174 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 01:15:00.204737 master-0 kubenswrapper[33142]: I1204 01:15:00.204387 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs"] Dec 04 01:15:00.261551 master-0 kubenswrapper[33142]: I1204 01:15:00.261472 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdm7m\" (UniqueName: \"kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.261818 master-0 kubenswrapper[33142]: I1204 01:15:00.261612 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.261818 master-0 kubenswrapper[33142]: I1204 01:15:00.261667 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.364574 master-0 kubenswrapper[33142]: I1204 01:15:00.364485 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gdm7m\" (UniqueName: \"kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.364850 master-0 kubenswrapper[33142]: I1204 01:15:00.364672 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.364850 master-0 kubenswrapper[33142]: I1204 01:15:00.364743 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.366854 master-0 kubenswrapper[33142]: I1204 01:15:00.366805 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.376131 master-0 kubenswrapper[33142]: I1204 01:15:00.375370 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.385740 master-0 kubenswrapper[33142]: I1204 01:15:00.385661 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdm7m\" (UniqueName: \"kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m\") pod \"collect-profiles-29413515-mcszs\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:00.512237 master-0 kubenswrapper[33142]: I1204 01:15:00.511789 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:01.065679 master-0 kubenswrapper[33142]: I1204 01:15:01.065593 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs"] Dec 04 01:15:01.072547 master-0 kubenswrapper[33142]: W1204 01:15:01.072462 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf732128c_d40e_46c8_9efa_0cc7d4171e3c.slice/crio-87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4 WatchSource:0}: Error finding container 87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4: Status 404 returned error can't find the container with id 87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4 Dec 04 01:15:01.086088 master-0 kubenswrapper[33142]: I1204 01:15:01.086035 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-nmfnt"] Dec 04 01:15:01.097005 master-0 kubenswrapper[33142]: I1204 01:15:01.096906 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-nmfnt"] Dec 04 01:15:01.201309 master-0 kubenswrapper[33142]: I1204 01:15:01.201226 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" event={"ID":"f732128c-d40e-46c8-9efa-0cc7d4171e3c","Type":"ContainerStarted","Data":"87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4"} Dec 04 01:15:01.911129 master-0 kubenswrapper[33142]: I1204 01:15:01.910986 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9e20f8-5e76-46ee-bd45-da2d6f2b6583" path="/var/lib/kubelet/pods/9c9e20f8-5e76-46ee-bd45-da2d6f2b6583/volumes" Dec 04 01:15:02.215607 master-0 kubenswrapper[33142]: I1204 01:15:02.215429 33142 generic.go:334] "Generic (PLEG): container finished" podID="f732128c-d40e-46c8-9efa-0cc7d4171e3c" containerID="8a187de2baa515621b0a68a691f4b2894d8aa8631b52828d410842ba15fe8167" exitCode=0 Dec 04 01:15:02.215607 master-0 kubenswrapper[33142]: I1204 01:15:02.215518 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" event={"ID":"f732128c-d40e-46c8-9efa-0cc7d4171e3c","Type":"ContainerDied","Data":"8a187de2baa515621b0a68a691f4b2894d8aa8631b52828d410842ba15fe8167"} Dec 04 01:15:03.714054 master-0 kubenswrapper[33142]: I1204 01:15:03.713961 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:03.799481 master-0 kubenswrapper[33142]: I1204 01:15:03.799285 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdm7m\" (UniqueName: \"kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m\") pod \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " Dec 04 01:15:03.799740 master-0 kubenswrapper[33142]: I1204 01:15:03.799577 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume\") pod \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " Dec 04 01:15:03.800359 master-0 kubenswrapper[33142]: I1204 01:15:03.800280 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume" (OuterVolumeSpecName: "config-volume") pod "f732128c-d40e-46c8-9efa-0cc7d4171e3c" (UID: "f732128c-d40e-46c8-9efa-0cc7d4171e3c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:15:03.804544 master-0 kubenswrapper[33142]: I1204 01:15:03.804436 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m" (OuterVolumeSpecName: "kube-api-access-gdm7m") pod "f732128c-d40e-46c8-9efa-0cc7d4171e3c" (UID: "f732128c-d40e-46c8-9efa-0cc7d4171e3c"). InnerVolumeSpecName "kube-api-access-gdm7m". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:15:03.903245 master-0 kubenswrapper[33142]: I1204 01:15:03.903153 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume\") pod \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\" (UID: \"f732128c-d40e-46c8-9efa-0cc7d4171e3c\") " Dec 04 01:15:03.904402 master-0 kubenswrapper[33142]: I1204 01:15:03.904347 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gdm7m\" (UniqueName: \"kubernetes.io/projected/f732128c-d40e-46c8-9efa-0cc7d4171e3c-kube-api-access-gdm7m\") on node \"master-0\" DevicePath \"\"" Dec 04 01:15:03.904402 master-0 kubenswrapper[33142]: I1204 01:15:03.904383 33142 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f732128c-d40e-46c8-9efa-0cc7d4171e3c-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:15:03.908743 master-0 kubenswrapper[33142]: I1204 01:15:03.908645 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "f732128c-d40e-46c8-9efa-0cc7d4171e3c" (UID: "f732128c-d40e-46c8-9efa-0cc7d4171e3c"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:15:04.008575 master-0 kubenswrapper[33142]: I1204 01:15:04.008423 33142 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f732128c-d40e-46c8-9efa-0cc7d4171e3c-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:15:04.243328 master-0 kubenswrapper[33142]: I1204 01:15:04.243215 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" event={"ID":"f732128c-d40e-46c8-9efa-0cc7d4171e3c","Type":"ContainerDied","Data":"87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4"} Dec 04 01:15:04.243328 master-0 kubenswrapper[33142]: I1204 01:15:04.243281 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413515-mcszs" Dec 04 01:15:04.243328 master-0 kubenswrapper[33142]: I1204 01:15:04.243302 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87d76ec8dc443cd88cdd9ba9b2d59c4c453774d7434a54d25b884e995d4730f4" Dec 04 01:15:04.817755 master-0 kubenswrapper[33142]: I1204 01:15:04.817649 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw"] Dec 04 01:15:04.829583 master-0 kubenswrapper[33142]: I1204 01:15:04.829507 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413470-qskzw"] Dec 04 01:15:05.921668 master-0 kubenswrapper[33142]: I1204 01:15:05.921543 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4efff267-ba65-4fcf-a442-64439eeb64ee" path="/var/lib/kubelet/pods/4efff267-ba65-4fcf-a442-64439eeb64ee/volumes" Dec 04 01:15:17.882246 master-0 kubenswrapper[33142]: I1204 01:15:17.882150 33142 scope.go:117] "RemoveContainer" containerID="cbf6f86392bf1c9fc1eb37e1740b70c6c92a9598e07970903b90c45732ee1d1f" Dec 04 01:15:17.905700 master-0 kubenswrapper[33142]: I1204 01:15:17.905625 33142 scope.go:117] "RemoveContainer" containerID="1401a4237e42cad32080dfa3086674c39612c875cee1e781add7ba4d18b62cea" Dec 04 01:15:17.964513 master-0 kubenswrapper[33142]: I1204 01:15:17.964425 33142 scope.go:117] "RemoveContainer" containerID="859be3ec608c0e1fecef6a7e45f036dad82e2e63d29426a8db5b4f694695a73c" Dec 04 01:15:18.045253 master-0 kubenswrapper[33142]: I1204 01:15:18.045182 33142 scope.go:117] "RemoveContainer" containerID="10bc4134fdf872f09ff5a652e61260d32c217c0ceacabdcfdd6627ce624ff547" Dec 04 01:15:18.078212 master-0 kubenswrapper[33142]: I1204 01:15:18.078160 33142 scope.go:117] "RemoveContainer" containerID="40a2eb7350b294b6fd3bc42ce9d84a36dd887ce3d46275db92d398c238e648c4" Dec 04 01:15:18.121469 master-0 kubenswrapper[33142]: I1204 01:15:18.121018 33142 scope.go:117] "RemoveContainer" containerID="fa783d35d4eac378504f1998f5b24825e94944f2ad0fc300c6862451a2e4a6c6" Dec 04 01:15:18.169682 master-0 kubenswrapper[33142]: I1204 01:15:18.169384 33142 scope.go:117] "RemoveContainer" containerID="9bc05cfb844d91b04f90eaab6eca9a32006366e6b73913197a2f4f5527de8488" Dec 04 01:15:18.194599 master-0 kubenswrapper[33142]: I1204 01:15:18.194546 33142 scope.go:117] "RemoveContainer" containerID="20477f76d926167038a4075c0d989581c7f1bd4fb52bbd37ad199405fd7c089f" Dec 04 01:15:28.073652 master-0 kubenswrapper[33142]: I1204 01:15:28.073557 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-cell-mapping-jhv4v"] Dec 04 01:15:28.091850 master-0 kubenswrapper[33142]: I1204 01:15:28.091699 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-cell-mapping-jhv4v"] Dec 04 01:15:29.919102 master-0 kubenswrapper[33142]: I1204 01:15:29.918907 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebe789b-7001-4f0a-b6fd-5a28815a7a10" path="/var/lib/kubelet/pods/1ebe789b-7001-4f0a-b6fd-5a28815a7a10/volumes" Dec 04 01:15:31.061251 master-0 kubenswrapper[33142]: I1204 01:15:31.061170 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-t89rl"] Dec 04 01:15:31.078826 master-0 kubenswrapper[33142]: I1204 01:15:31.078733 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-t89rl"] Dec 04 01:15:31.920315 master-0 kubenswrapper[33142]: I1204 01:15:31.920177 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c" path="/var/lib/kubelet/pods/4e6c0e12-e3e8-4c69-ab18-ad7dbbd6a58c/volumes" Dec 04 01:16:09.081147 master-0 kubenswrapper[33142]: I1204 01:16:09.081044 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-host-discover-v7zpg"] Dec 04 01:16:09.103724 master-0 kubenswrapper[33142]: I1204 01:16:09.103614 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-host-discover-v7zpg"] Dec 04 01:16:09.916128 master-0 kubenswrapper[33142]: I1204 01:16:09.916025 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b97a2d2-bdcb-4bc1-83e3-32a6271b948d" path="/var/lib/kubelet/pods/6b97a2d2-bdcb-4bc1-83e3-32a6271b948d/volumes" Dec 04 01:16:11.049306 master-0 kubenswrapper[33142]: I1204 01:16:11.049238 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-cell-mapping-g9gs4"] Dec 04 01:16:11.066990 master-0 kubenswrapper[33142]: I1204 01:16:11.066889 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-cell-mapping-g9gs4"] Dec 04 01:16:11.915833 master-0 kubenswrapper[33142]: I1204 01:16:11.915740 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351a4442-07ac-4457-93a0-be72109c30e8" path="/var/lib/kubelet/pods/351a4442-07ac-4457-93a0-be72109c30e8/volumes" Dec 04 01:16:18.415218 master-0 kubenswrapper[33142]: I1204 01:16:18.415130 33142 scope.go:117] "RemoveContainer" containerID="ed9aee9b0196dd092b072d1733d42b7d8cad78b9e4b66111b15dd9e0a18eb81c" Dec 04 01:16:18.467654 master-0 kubenswrapper[33142]: I1204 01:16:18.467152 33142 scope.go:117] "RemoveContainer" containerID="3c26ade0dff1243c05bdd28fd9038b9268c9e4ddc51e2567b076ffd64b8e24f8" Dec 04 01:16:18.539982 master-0 kubenswrapper[33142]: I1204 01:16:18.539895 33142 scope.go:117] "RemoveContainer" containerID="99e568d30abf731571f0e75d4ecff9d0473509b33ceb2b8ac456597685913255" Dec 04 01:16:18.582472 master-0 kubenswrapper[33142]: I1204 01:16:18.582190 33142 scope.go:117] "RemoveContainer" containerID="cc6451d8ffcc254751afacadd21039d7b38877b493b218fe6d4b2ec647bae4ae" Dec 04 01:17:02.585378 master-0 kubenswrapper[33142]: E1204 01:17:02.585287 33142 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 192.168.32.10:50236->192.168.32.10:43811: write tcp 192.168.32.10:50236->192.168.32.10:43811: write: broken pipe Dec 04 01:17:21.498484 master-0 kubenswrapper[33142]: I1204 01:17:21.498398 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:21.501869 master-0 kubenswrapper[33142]: E1204 01:17:21.499646 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f732128c-d40e-46c8-9efa-0cc7d4171e3c" containerName="collect-profiles" Dec 04 01:17:21.501869 master-0 kubenswrapper[33142]: I1204 01:17:21.499673 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="f732128c-d40e-46c8-9efa-0cc7d4171e3c" containerName="collect-profiles" Dec 04 01:17:21.501869 master-0 kubenswrapper[33142]: I1204 01:17:21.499917 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="f732128c-d40e-46c8-9efa-0cc7d4171e3c" containerName="collect-profiles" Dec 04 01:17:21.502234 master-0 kubenswrapper[33142]: I1204 01:17:21.501974 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.550048 master-0 kubenswrapper[33142]: I1204 01:17:21.548215 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:21.686919 master-0 kubenswrapper[33142]: I1204 01:17:21.686796 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.687200 master-0 kubenswrapper[33142]: I1204 01:17:21.687033 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.687247 master-0 kubenswrapper[33142]: I1204 01:17:21.687220 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.790261 master-0 kubenswrapper[33142]: I1204 01:17:21.790054 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.790569 master-0 kubenswrapper[33142]: I1204 01:17:21.790308 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.790569 master-0 kubenswrapper[33142]: I1204 01:17:21.790436 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.790978 master-0 kubenswrapper[33142]: I1204 01:17:21.790908 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.791120 master-0 kubenswrapper[33142]: I1204 01:17:21.791061 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.810218 master-0 kubenswrapper[33142]: I1204 01:17:21.810150 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn\") pod \"redhat-operators-wfbp7\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:21.842780 master-0 kubenswrapper[33142]: I1204 01:17:21.842677 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:22.379319 master-0 kubenswrapper[33142]: W1204 01:17:22.379221 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64111ecc_4dc4_42f0_88c2_024d72643b38.slice/crio-2a52281f94a6b04f8526bc8b41179ece600b463eea7263b6b9e4a81efd80f80a WatchSource:0}: Error finding container 2a52281f94a6b04f8526bc8b41179ece600b463eea7263b6b9e4a81efd80f80a: Status 404 returned error can't find the container with id 2a52281f94a6b04f8526bc8b41179ece600b463eea7263b6b9e4a81efd80f80a Dec 04 01:17:22.392237 master-0 kubenswrapper[33142]: I1204 01:17:22.391006 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:23.279986 master-0 kubenswrapper[33142]: I1204 01:17:23.279877 33142 generic.go:334] "Generic (PLEG): container finished" podID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerID="b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c" exitCode=0 Dec 04 01:17:23.280714 master-0 kubenswrapper[33142]: I1204 01:17:23.280033 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerDied","Data":"b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c"} Dec 04 01:17:23.280714 master-0 kubenswrapper[33142]: I1204 01:17:23.280133 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerStarted","Data":"2a52281f94a6b04f8526bc8b41179ece600b463eea7263b6b9e4a81efd80f80a"} Dec 04 01:17:23.282649 master-0 kubenswrapper[33142]: I1204 01:17:23.282599 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 01:17:25.313238 master-0 kubenswrapper[33142]: I1204 01:17:25.313043 33142 generic.go:334] "Generic (PLEG): container finished" podID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerID="fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb" exitCode=0 Dec 04 01:17:25.313238 master-0 kubenswrapper[33142]: I1204 01:17:25.313114 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerDied","Data":"fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb"} Dec 04 01:17:26.333826 master-0 kubenswrapper[33142]: I1204 01:17:26.333600 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerStarted","Data":"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c"} Dec 04 01:17:26.373537 master-0 kubenswrapper[33142]: I1204 01:17:26.373387 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-wfbp7" podStartSLOduration=2.918112023 podStartE2EDuration="5.373339903s" podCreationTimestamp="2025-12-04 01:17:21 +0000 UTC" firstStartedPulling="2025-12-04 01:17:23.28253225 +0000 UTC m=+1815.684534100" lastFinishedPulling="2025-12-04 01:17:25.73776013 +0000 UTC m=+1818.139761980" observedRunningTime="2025-12-04 01:17:26.3579978 +0000 UTC m=+1818.759999660" watchObservedRunningTime="2025-12-04 01:17:26.373339903 +0000 UTC m=+1818.775341753" Dec 04 01:17:31.844587 master-0 kubenswrapper[33142]: I1204 01:17:31.844301 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:31.845835 master-0 kubenswrapper[33142]: I1204 01:17:31.845819 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:31.928407 master-0 kubenswrapper[33142]: I1204 01:17:31.928307 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:32.492559 master-0 kubenswrapper[33142]: I1204 01:17:32.492472 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:32.568503 master-0 kubenswrapper[33142]: I1204 01:17:32.568382 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:34.438910 master-0 kubenswrapper[33142]: I1204 01:17:34.438802 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-wfbp7" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="registry-server" containerID="cri-o://6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c" gracePeriod=2 Dec 04 01:17:35.033830 master-0 kubenswrapper[33142]: I1204 01:17:35.033201 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:35.202660 master-0 kubenswrapper[33142]: I1204 01:17:35.202465 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn\") pod \"64111ecc-4dc4-42f0-88c2-024d72643b38\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " Dec 04 01:17:35.202660 master-0 kubenswrapper[33142]: I1204 01:17:35.202647 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities\") pod \"64111ecc-4dc4-42f0-88c2-024d72643b38\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " Dec 04 01:17:35.203052 master-0 kubenswrapper[33142]: I1204 01:17:35.202974 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content\") pod \"64111ecc-4dc4-42f0-88c2-024d72643b38\" (UID: \"64111ecc-4dc4-42f0-88c2-024d72643b38\") " Dec 04 01:17:35.210131 master-0 kubenswrapper[33142]: I1204 01:17:35.210080 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities" (OuterVolumeSpecName: "utilities") pod "64111ecc-4dc4-42f0-88c2-024d72643b38" (UID: "64111ecc-4dc4-42f0-88c2-024d72643b38"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:17:35.212253 master-0 kubenswrapper[33142]: I1204 01:17:35.212191 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn" (OuterVolumeSpecName: "kube-api-access-967kn") pod "64111ecc-4dc4-42f0-88c2-024d72643b38" (UID: "64111ecc-4dc4-42f0-88c2-024d72643b38"). InnerVolumeSpecName "kube-api-access-967kn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:17:35.306673 master-0 kubenswrapper[33142]: I1204 01:17:35.306585 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-967kn\" (UniqueName: \"kubernetes.io/projected/64111ecc-4dc4-42f0-88c2-024d72643b38-kube-api-access-967kn\") on node \"master-0\" DevicePath \"\"" Dec 04 01:17:35.306673 master-0 kubenswrapper[33142]: I1204 01:17:35.306641 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:17:35.340825 master-0 kubenswrapper[33142]: I1204 01:17:35.340677 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "64111ecc-4dc4-42f0-88c2-024d72643b38" (UID: "64111ecc-4dc4-42f0-88c2-024d72643b38"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:17:35.410213 master-0 kubenswrapper[33142]: I1204 01:17:35.410085 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/64111ecc-4dc4-42f0-88c2-024d72643b38-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:17:35.457474 master-0 kubenswrapper[33142]: I1204 01:17:35.457120 33142 generic.go:334] "Generic (PLEG): container finished" podID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerID="6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c" exitCode=0 Dec 04 01:17:35.457474 master-0 kubenswrapper[33142]: I1204 01:17:35.457335 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfbp7" Dec 04 01:17:35.457474 master-0 kubenswrapper[33142]: I1204 01:17:35.457351 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerDied","Data":"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c"} Dec 04 01:17:35.457474 master-0 kubenswrapper[33142]: I1204 01:17:35.457457 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfbp7" event={"ID":"64111ecc-4dc4-42f0-88c2-024d72643b38","Type":"ContainerDied","Data":"2a52281f94a6b04f8526bc8b41179ece600b463eea7263b6b9e4a81efd80f80a"} Dec 04 01:17:35.458255 master-0 kubenswrapper[33142]: I1204 01:17:35.457496 33142 scope.go:117] "RemoveContainer" containerID="6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c" Dec 04 01:17:35.490506 master-0 kubenswrapper[33142]: I1204 01:17:35.490443 33142 scope.go:117] "RemoveContainer" containerID="fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb" Dec 04 01:17:35.552602 master-0 kubenswrapper[33142]: I1204 01:17:35.552557 33142 scope.go:117] "RemoveContainer" containerID="b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c" Dec 04 01:17:35.553395 master-0 kubenswrapper[33142]: I1204 01:17:35.553298 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:35.578295 master-0 kubenswrapper[33142]: I1204 01:17:35.578218 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-wfbp7"] Dec 04 01:17:35.580109 master-0 kubenswrapper[33142]: I1204 01:17:35.580066 33142 scope.go:117] "RemoveContainer" containerID="6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c" Dec 04 01:17:35.581907 master-0 kubenswrapper[33142]: E1204 01:17:35.581868 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c\": container with ID starting with 6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c not found: ID does not exist" containerID="6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c" Dec 04 01:17:35.581999 master-0 kubenswrapper[33142]: I1204 01:17:35.581909 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c"} err="failed to get container status \"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c\": rpc error: code = NotFound desc = could not find container \"6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c\": container with ID starting with 6f079c78ac3d1be501c6974af38915416eac82a17ecebc43d548689e9da3e99c not found: ID does not exist" Dec 04 01:17:35.581999 master-0 kubenswrapper[33142]: I1204 01:17:35.581955 33142 scope.go:117] "RemoveContainer" containerID="fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb" Dec 04 01:17:35.582395 master-0 kubenswrapper[33142]: E1204 01:17:35.582353 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb\": container with ID starting with fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb not found: ID does not exist" containerID="fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb" Dec 04 01:17:35.582443 master-0 kubenswrapper[33142]: I1204 01:17:35.582391 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb"} err="failed to get container status \"fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb\": rpc error: code = NotFound desc = could not find container \"fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb\": container with ID starting with fb9c492cefebf88d0874e3f401e0bba5087bb6d39005833c7af20a2f702a3acb not found: ID does not exist" Dec 04 01:17:35.582443 master-0 kubenswrapper[33142]: I1204 01:17:35.582412 33142 scope.go:117] "RemoveContainer" containerID="b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c" Dec 04 01:17:35.582824 master-0 kubenswrapper[33142]: E1204 01:17:35.582770 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c\": container with ID starting with b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c not found: ID does not exist" containerID="b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c" Dec 04 01:17:35.582884 master-0 kubenswrapper[33142]: I1204 01:17:35.582831 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c"} err="failed to get container status \"b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c\": rpc error: code = NotFound desc = could not find container \"b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c\": container with ID starting with b34189c97a3717ad2c9f0e342b307ca4705380060d05ade54635bc87d8f1441c not found: ID does not exist" Dec 04 01:17:35.916531 master-0 kubenswrapper[33142]: I1204 01:17:35.916433 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" path="/var/lib/kubelet/pods/64111ecc-4dc4-42f0-88c2-024d72643b38/volumes" Dec 04 01:18:03.862393 master-0 kubenswrapper[33142]: I1204 01:18:03.862298 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:03.863851 master-0 kubenswrapper[33142]: E1204 01:18:03.863772 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="extract-content" Dec 04 01:18:03.863968 master-0 kubenswrapper[33142]: I1204 01:18:03.863919 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="extract-content" Dec 04 01:18:03.864081 master-0 kubenswrapper[33142]: E1204 01:18:03.864030 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="registry-server" Dec 04 01:18:03.864081 master-0 kubenswrapper[33142]: I1204 01:18:03.864047 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="registry-server" Dec 04 01:18:03.864081 master-0 kubenswrapper[33142]: E1204 01:18:03.864074 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="extract-utilities" Dec 04 01:18:03.864313 master-0 kubenswrapper[33142]: I1204 01:18:03.864089 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="extract-utilities" Dec 04 01:18:03.864598 master-0 kubenswrapper[33142]: I1204 01:18:03.864569 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="64111ecc-4dc4-42f0-88c2-024d72643b38" containerName="registry-server" Dec 04 01:18:03.868710 master-0 kubenswrapper[33142]: I1204 01:18:03.868636 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:03.908917 master-0 kubenswrapper[33142]: I1204 01:18:03.908739 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:03.940566 master-0 kubenswrapper[33142]: I1204 01:18:03.940495 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:03.940873 master-0 kubenswrapper[33142]: I1204 01:18:03.940582 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:03.940873 master-0 kubenswrapper[33142]: I1204 01:18:03.940676 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwzlg\" (UniqueName: \"kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.046015 master-0 kubenswrapper[33142]: I1204 01:18:04.044678 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.046015 master-0 kubenswrapper[33142]: I1204 01:18:04.044850 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.046015 master-0 kubenswrapper[33142]: I1204 01:18:04.045038 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cwzlg\" (UniqueName: \"kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.046015 master-0 kubenswrapper[33142]: I1204 01:18:04.045496 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.046015 master-0 kubenswrapper[33142]: I1204 01:18:04.045834 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.058067 master-0 kubenswrapper[33142]: I1204 01:18:04.054773 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:04.061865 master-0 kubenswrapper[33142]: I1204 01:18:04.061787 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.070701 master-0 kubenswrapper[33142]: I1204 01:18:04.070601 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwzlg\" (UniqueName: \"kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg\") pod \"community-operators-5gtsg\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.081710 master-0 kubenswrapper[33142]: I1204 01:18:04.081490 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:04.151298 master-0 kubenswrapper[33142]: I1204 01:18:04.151228 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.151555 master-0 kubenswrapper[33142]: I1204 01:18:04.151502 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz8rw\" (UniqueName: \"kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.151633 master-0 kubenswrapper[33142]: I1204 01:18:04.151606 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.217250 master-0 kubenswrapper[33142]: I1204 01:18:04.217164 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:04.254038 master-0 kubenswrapper[33142]: I1204 01:18:04.253947 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.254308 master-0 kubenswrapper[33142]: I1204 01:18:04.254143 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vz8rw\" (UniqueName: \"kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.254308 master-0 kubenswrapper[33142]: I1204 01:18:04.254187 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.256175 master-0 kubenswrapper[33142]: I1204 01:18:04.255134 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.256175 master-0 kubenswrapper[33142]: I1204 01:18:04.255465 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.290887 master-0 kubenswrapper[33142]: I1204 01:18:04.290824 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz8rw\" (UniqueName: \"kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw\") pod \"redhat-marketplace-44zbh\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.469127 master-0 kubenswrapper[33142]: I1204 01:18:04.467750 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:04.981991 master-0 kubenswrapper[33142]: I1204 01:18:04.976915 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:05.163244 master-0 kubenswrapper[33142]: I1204 01:18:05.163152 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:05.170823 master-0 kubenswrapper[33142]: W1204 01:18:05.170760 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30789c93_a118_46b3_8bbe_b4d78511daf6.slice/crio-2c1099a7287bc5ab3dbfc7d545fc1600683c7b7c9c74ee16db11bf19898700b0 WatchSource:0}: Error finding container 2c1099a7287bc5ab3dbfc7d545fc1600683c7b7c9c74ee16db11bf19898700b0: Status 404 returned error can't find the container with id 2c1099a7287bc5ab3dbfc7d545fc1600683c7b7c9c74ee16db11bf19898700b0 Dec 04 01:18:05.942381 master-0 kubenswrapper[33142]: I1204 01:18:05.942317 33142 generic.go:334] "Generic (PLEG): container finished" podID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerID="cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c" exitCode=0 Dec 04 01:18:05.945295 master-0 kubenswrapper[33142]: I1204 01:18:05.945234 33142 generic.go:334] "Generic (PLEG): container finished" podID="81956575-c5cc-4428-bb93-ea9262181dc3" containerID="9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f" exitCode=0 Dec 04 01:18:05.945494 master-0 kubenswrapper[33142]: I1204 01:18:05.945281 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerDied","Data":"cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c"} Dec 04 01:18:05.945648 master-0 kubenswrapper[33142]: I1204 01:18:05.945629 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerStarted","Data":"2c1099a7287bc5ab3dbfc7d545fc1600683c7b7c9c74ee16db11bf19898700b0"} Dec 04 01:18:05.945772 master-0 kubenswrapper[33142]: I1204 01:18:05.945756 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerDied","Data":"9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f"} Dec 04 01:18:05.945914 master-0 kubenswrapper[33142]: I1204 01:18:05.945862 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerStarted","Data":"a666f278da4b482f2601fed4413c4cf88ddddae89ef5ae1bac05d4ee9e98f794"} Dec 04 01:18:06.962470 master-0 kubenswrapper[33142]: I1204 01:18:06.962367 33142 generic.go:334] "Generic (PLEG): container finished" podID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerID="af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8" exitCode=0 Dec 04 01:18:06.962470 master-0 kubenswrapper[33142]: I1204 01:18:06.962435 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerDied","Data":"af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8"} Dec 04 01:18:06.966422 master-0 kubenswrapper[33142]: I1204 01:18:06.966327 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerStarted","Data":"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175"} Dec 04 01:18:07.456266 master-0 kubenswrapper[33142]: I1204 01:18:07.456186 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:07.461136 master-0 kubenswrapper[33142]: I1204 01:18:07.461077 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.473026 master-0 kubenswrapper[33142]: I1204 01:18:07.472747 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:07.571917 master-0 kubenswrapper[33142]: I1204 01:18:07.571838 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.572190 master-0 kubenswrapper[33142]: I1204 01:18:07.571977 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdw7g\" (UniqueName: \"kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.572190 master-0 kubenswrapper[33142]: I1204 01:18:07.572099 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.674451 master-0 kubenswrapper[33142]: I1204 01:18:07.674354 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jdw7g\" (UniqueName: \"kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.674888 master-0 kubenswrapper[33142]: I1204 01:18:07.674504 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.674888 master-0 kubenswrapper[33142]: I1204 01:18:07.674615 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.675236 master-0 kubenswrapper[33142]: I1204 01:18:07.675208 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.675838 master-0 kubenswrapper[33142]: I1204 01:18:07.675689 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.697019 master-0 kubenswrapper[33142]: I1204 01:18:07.696783 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdw7g\" (UniqueName: \"kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g\") pod \"certified-operators-z7q8v\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:07.863505 master-0 kubenswrapper[33142]: I1204 01:18:07.863418 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:08.005398 master-0 kubenswrapper[33142]: I1204 01:18:08.005199 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerStarted","Data":"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef"} Dec 04 01:18:08.035175 master-0 kubenswrapper[33142]: I1204 01:18:08.035092 33142 generic.go:334] "Generic (PLEG): container finished" podID="81956575-c5cc-4428-bb93-ea9262181dc3" containerID="efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175" exitCode=0 Dec 04 01:18:08.035175 master-0 kubenswrapper[33142]: I1204 01:18:08.035179 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerDied","Data":"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175"} Dec 04 01:18:08.059212 master-0 kubenswrapper[33142]: I1204 01:18:08.059079 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-44zbh" podStartSLOduration=2.643656039 podStartE2EDuration="4.059047317s" podCreationTimestamp="2025-12-04 01:18:04 +0000 UTC" firstStartedPulling="2025-12-04 01:18:05.945314493 +0000 UTC m=+1858.347316343" lastFinishedPulling="2025-12-04 01:18:07.360705771 +0000 UTC m=+1859.762707621" observedRunningTime="2025-12-04 01:18:08.04957831 +0000 UTC m=+1860.451580170" watchObservedRunningTime="2025-12-04 01:18:08.059047317 +0000 UTC m=+1860.461049167" Dec 04 01:18:08.441165 master-0 kubenswrapper[33142]: I1204 01:18:08.441081 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:09.055322 master-0 kubenswrapper[33142]: I1204 01:18:09.055237 33142 generic.go:334] "Generic (PLEG): container finished" podID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerID="6b24417ee74219dc4edbf5cd6f24b69a6c5885aa6259dcd3af6b4abd5a8e7a0f" exitCode=0 Dec 04 01:18:09.056673 master-0 kubenswrapper[33142]: I1204 01:18:09.056590 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerDied","Data":"6b24417ee74219dc4edbf5cd6f24b69a6c5885aa6259dcd3af6b4abd5a8e7a0f"} Dec 04 01:18:09.056754 master-0 kubenswrapper[33142]: I1204 01:18:09.056707 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerStarted","Data":"4d4ab98f0e4f1511b40bf56b8aaeb6da01645dc8fef9fb51639b182a04c36ad7"} Dec 04 01:18:10.073834 master-0 kubenswrapper[33142]: I1204 01:18:10.073774 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerStarted","Data":"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d"} Dec 04 01:18:10.080157 master-0 kubenswrapper[33142]: I1204 01:18:10.080042 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerStarted","Data":"7f25d4ac9ab61f96452c0a4661c32780f4e6e35381f370077c8a7eb59177883e"} Dec 04 01:18:10.112285 master-0 kubenswrapper[33142]: I1204 01:18:10.112204 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-5gtsg" podStartSLOduration=4.261580562 podStartE2EDuration="7.112184791s" podCreationTimestamp="2025-12-04 01:18:03 +0000 UTC" firstStartedPulling="2025-12-04 01:18:05.947073482 +0000 UTC m=+1858.349075332" lastFinishedPulling="2025-12-04 01:18:08.797677711 +0000 UTC m=+1861.199679561" observedRunningTime="2025-12-04 01:18:10.108434775 +0000 UTC m=+1862.510436695" watchObservedRunningTime="2025-12-04 01:18:10.112184791 +0000 UTC m=+1862.514186641" Dec 04 01:18:11.096641 master-0 kubenswrapper[33142]: I1204 01:18:11.096554 33142 generic.go:334] "Generic (PLEG): container finished" podID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerID="7f25d4ac9ab61f96452c0a4661c32780f4e6e35381f370077c8a7eb59177883e" exitCode=0 Dec 04 01:18:11.097290 master-0 kubenswrapper[33142]: I1204 01:18:11.096698 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerDied","Data":"7f25d4ac9ab61f96452c0a4661c32780f4e6e35381f370077c8a7eb59177883e"} Dec 04 01:18:12.112787 master-0 kubenswrapper[33142]: I1204 01:18:12.112664 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerStarted","Data":"53dbba00560bb91b82425d04031e89d10eab0c88d83841debec73687dc67f988"} Dec 04 01:18:12.141553 master-0 kubenswrapper[33142]: I1204 01:18:12.140905 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-z7q8v" podStartSLOduration=2.636918157 podStartE2EDuration="5.140876624s" podCreationTimestamp="2025-12-04 01:18:07 +0000 UTC" firstStartedPulling="2025-12-04 01:18:09.059201078 +0000 UTC m=+1861.461202928" lastFinishedPulling="2025-12-04 01:18:11.563159525 +0000 UTC m=+1863.965161395" observedRunningTime="2025-12-04 01:18:12.136796068 +0000 UTC m=+1864.538797918" watchObservedRunningTime="2025-12-04 01:18:12.140876624 +0000 UTC m=+1864.542878474" Dec 04 01:18:14.218048 master-0 kubenswrapper[33142]: I1204 01:18:14.217954 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:14.218048 master-0 kubenswrapper[33142]: I1204 01:18:14.218015 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:14.270062 master-0 kubenswrapper[33142]: I1204 01:18:14.269999 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:14.469864 master-0 kubenswrapper[33142]: I1204 01:18:14.469694 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:14.469864 master-0 kubenswrapper[33142]: I1204 01:18:14.469762 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:14.543264 master-0 kubenswrapper[33142]: I1204 01:18:14.543191 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:15.219202 master-0 kubenswrapper[33142]: I1204 01:18:15.219122 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:15.220978 master-0 kubenswrapper[33142]: I1204 01:18:15.220897 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:15.870146 master-0 kubenswrapper[33142]: I1204 01:18:15.865321 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:16.033844 master-0 kubenswrapper[33142]: I1204 01:18:16.033745 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:17.178734 master-0 kubenswrapper[33142]: I1204 01:18:17.174287 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-5gtsg" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="registry-server" containerID="cri-o://40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d" gracePeriod=2 Dec 04 01:18:17.178734 master-0 kubenswrapper[33142]: I1204 01:18:17.174491 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-44zbh" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="registry-server" containerID="cri-o://de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef" gracePeriod=2 Dec 04 01:18:17.249444 master-0 kubenswrapper[33142]: E1204 01:18:17.249356 33142 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30789c93_a118_46b3_8bbe_b4d78511daf6.slice/crio-de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef.scope\": RecentStats: unable to find data in memory cache]" Dec 04 01:18:17.864073 master-0 kubenswrapper[33142]: I1204 01:18:17.863987 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:17.864073 master-0 kubenswrapper[33142]: I1204 01:18:17.864070 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:17.909697 master-0 kubenswrapper[33142]: I1204 01:18:17.909615 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:17.917606 master-0 kubenswrapper[33142]: I1204 01:18:17.917542 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:17.919806 master-0 kubenswrapper[33142]: I1204 01:18:17.919760 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:17.942419 master-0 kubenswrapper[33142]: I1204 01:18:17.942312 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz8rw\" (UniqueName: \"kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw\") pod \"30789c93-a118-46b3-8bbe-b4d78511daf6\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " Dec 04 01:18:17.942837 master-0 kubenswrapper[33142]: I1204 01:18:17.942502 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content\") pod \"30789c93-a118-46b3-8bbe-b4d78511daf6\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " Dec 04 01:18:17.942837 master-0 kubenswrapper[33142]: I1204 01:18:17.942661 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities\") pod \"81956575-c5cc-4428-bb93-ea9262181dc3\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " Dec 04 01:18:17.942985 master-0 kubenswrapper[33142]: I1204 01:18:17.942848 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwzlg\" (UniqueName: \"kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg\") pod \"81956575-c5cc-4428-bb93-ea9262181dc3\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " Dec 04 01:18:17.942985 master-0 kubenswrapper[33142]: I1204 01:18:17.942875 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities\") pod \"30789c93-a118-46b3-8bbe-b4d78511daf6\" (UID: \"30789c93-a118-46b3-8bbe-b4d78511daf6\") " Dec 04 01:18:17.943113 master-0 kubenswrapper[33142]: I1204 01:18:17.943084 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content\") pod \"81956575-c5cc-4428-bb93-ea9262181dc3\" (UID: \"81956575-c5cc-4428-bb93-ea9262181dc3\") " Dec 04 01:18:17.943801 master-0 kubenswrapper[33142]: I1204 01:18:17.943694 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities" (OuterVolumeSpecName: "utilities") pod "81956575-c5cc-4428-bb93-ea9262181dc3" (UID: "81956575-c5cc-4428-bb93-ea9262181dc3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:17.943886 master-0 kubenswrapper[33142]: I1204 01:18:17.943787 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities" (OuterVolumeSpecName: "utilities") pod "30789c93-a118-46b3-8bbe-b4d78511daf6" (UID: "30789c93-a118-46b3-8bbe-b4d78511daf6"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:17.944534 master-0 kubenswrapper[33142]: I1204 01:18:17.944492 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:17.944534 master-0 kubenswrapper[33142]: I1204 01:18:17.944524 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:17.946770 master-0 kubenswrapper[33142]: I1204 01:18:17.946665 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw" (OuterVolumeSpecName: "kube-api-access-vz8rw") pod "30789c93-a118-46b3-8bbe-b4d78511daf6" (UID: "30789c93-a118-46b3-8bbe-b4d78511daf6"). InnerVolumeSpecName "kube-api-access-vz8rw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:18:17.948286 master-0 kubenswrapper[33142]: I1204 01:18:17.948214 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg" (OuterVolumeSpecName: "kube-api-access-cwzlg") pod "81956575-c5cc-4428-bb93-ea9262181dc3" (UID: "81956575-c5cc-4428-bb93-ea9262181dc3"). InnerVolumeSpecName "kube-api-access-cwzlg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:18:17.966626 master-0 kubenswrapper[33142]: I1204 01:18:17.966542 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "30789c93-a118-46b3-8bbe-b4d78511daf6" (UID: "30789c93-a118-46b3-8bbe-b4d78511daf6"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:17.998224 master-0 kubenswrapper[33142]: I1204 01:18:17.998121 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "81956575-c5cc-4428-bb93-ea9262181dc3" (UID: "81956575-c5cc-4428-bb93-ea9262181dc3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:18.048610 master-0 kubenswrapper[33142]: I1204 01:18:18.048001 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cwzlg\" (UniqueName: \"kubernetes.io/projected/81956575-c5cc-4428-bb93-ea9262181dc3-kube-api-access-cwzlg\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:18.048610 master-0 kubenswrapper[33142]: I1204 01:18:18.048063 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/81956575-c5cc-4428-bb93-ea9262181dc3-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:18.048610 master-0 kubenswrapper[33142]: I1204 01:18:18.048079 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vz8rw\" (UniqueName: \"kubernetes.io/projected/30789c93-a118-46b3-8bbe-b4d78511daf6-kube-api-access-vz8rw\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:18.048610 master-0 kubenswrapper[33142]: I1204 01:18:18.048089 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/30789c93-a118-46b3-8bbe-b4d78511daf6-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:18.219499 master-0 kubenswrapper[33142]: I1204 01:18:18.219326 33142 generic.go:334] "Generic (PLEG): container finished" podID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerID="de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef" exitCode=0 Dec 04 01:18:18.219499 master-0 kubenswrapper[33142]: I1204 01:18:18.219459 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerDied","Data":"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef"} Dec 04 01:18:18.220051 master-0 kubenswrapper[33142]: I1204 01:18:18.219543 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-44zbh" event={"ID":"30789c93-a118-46b3-8bbe-b4d78511daf6","Type":"ContainerDied","Data":"2c1099a7287bc5ab3dbfc7d545fc1600683c7b7c9c74ee16db11bf19898700b0"} Dec 04 01:18:18.220051 master-0 kubenswrapper[33142]: I1204 01:18:18.219570 33142 scope.go:117] "RemoveContainer" containerID="de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef" Dec 04 01:18:18.220051 master-0 kubenswrapper[33142]: I1204 01:18:18.219491 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-44zbh" Dec 04 01:18:18.225849 master-0 kubenswrapper[33142]: I1204 01:18:18.225792 33142 generic.go:334] "Generic (PLEG): container finished" podID="81956575-c5cc-4428-bb93-ea9262181dc3" containerID="40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d" exitCode=0 Dec 04 01:18:18.226120 master-0 kubenswrapper[33142]: I1204 01:18:18.225834 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerDied","Data":"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d"} Dec 04 01:18:18.226120 master-0 kubenswrapper[33142]: I1204 01:18:18.225887 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-5gtsg" event={"ID":"81956575-c5cc-4428-bb93-ea9262181dc3","Type":"ContainerDied","Data":"a666f278da4b482f2601fed4413c4cf88ddddae89ef5ae1bac05d4ee9e98f794"} Dec 04 01:18:18.226269 master-0 kubenswrapper[33142]: I1204 01:18:18.226238 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-5gtsg" Dec 04 01:18:18.249446 master-0 kubenswrapper[33142]: I1204 01:18:18.249411 33142 scope.go:117] "RemoveContainer" containerID="af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8" Dec 04 01:18:18.282813 master-0 kubenswrapper[33142]: I1204 01:18:18.282760 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:18.288268 master-0 kubenswrapper[33142]: I1204 01:18:18.286396 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:18.324052 master-0 kubenswrapper[33142]: I1204 01:18:18.323999 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-5gtsg"] Dec 04 01:18:18.337071 master-0 kubenswrapper[33142]: I1204 01:18:18.337012 33142 scope.go:117] "RemoveContainer" containerID="cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c" Dec 04 01:18:18.341200 master-0 kubenswrapper[33142]: I1204 01:18:18.341139 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:18.365600 master-0 kubenswrapper[33142]: I1204 01:18:18.365487 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-44zbh"] Dec 04 01:18:18.413528 master-0 kubenswrapper[33142]: I1204 01:18:18.413474 33142 scope.go:117] "RemoveContainer" containerID="de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: E1204 01:18:18.414024 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef\": container with ID starting with de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef not found: ID does not exist" containerID="de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414068 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef"} err="failed to get container status \"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef\": rpc error: code = NotFound desc = could not find container \"de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef\": container with ID starting with de3e66a7ff7243492ea83bee72cd1c671d6f8fe1ce493178263433ad512eb3ef not found: ID does not exist" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414095 33142 scope.go:117] "RemoveContainer" containerID="af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: E1204 01:18:18.414498 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8\": container with ID starting with af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8 not found: ID does not exist" containerID="af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414516 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8"} err="failed to get container status \"af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8\": rpc error: code = NotFound desc = could not find container \"af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8\": container with ID starting with af12d1726202b7a0b06560722f9d681c72d95efd98a19eab82ec79010d6400e8 not found: ID does not exist" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414528 33142 scope.go:117] "RemoveContainer" containerID="cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: E1204 01:18:18.414808 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c\": container with ID starting with cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c not found: ID does not exist" containerID="cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414827 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c"} err="failed to get container status \"cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c\": rpc error: code = NotFound desc = could not find container \"cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c\": container with ID starting with cc5b52a4a41a52e616800ba725eea2c5cdd6dc7a1f3b0cc641c4115ba8a9ba9c not found: ID does not exist" Dec 04 01:18:18.414781 master-0 kubenswrapper[33142]: I1204 01:18:18.414841 33142 scope.go:117] "RemoveContainer" containerID="40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d" Dec 04 01:18:18.468345 master-0 kubenswrapper[33142]: I1204 01:18:18.468299 33142 scope.go:117] "RemoveContainer" containerID="efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175" Dec 04 01:18:18.496026 master-0 kubenswrapper[33142]: I1204 01:18:18.495858 33142 scope.go:117] "RemoveContainer" containerID="9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f" Dec 04 01:18:18.561082 master-0 kubenswrapper[33142]: I1204 01:18:18.561036 33142 scope.go:117] "RemoveContainer" containerID="40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d" Dec 04 01:18:18.561568 master-0 kubenswrapper[33142]: E1204 01:18:18.561538 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d\": container with ID starting with 40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d not found: ID does not exist" containerID="40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d" Dec 04 01:18:18.561608 master-0 kubenswrapper[33142]: I1204 01:18:18.561574 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d"} err="failed to get container status \"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d\": rpc error: code = NotFound desc = could not find container \"40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d\": container with ID starting with 40da8a6ddacee435418f474735a3c0f050592306f528948fc3776f13ee3d0b7d not found: ID does not exist" Dec 04 01:18:18.561608 master-0 kubenswrapper[33142]: I1204 01:18:18.561595 33142 scope.go:117] "RemoveContainer" containerID="efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175" Dec 04 01:18:18.562076 master-0 kubenswrapper[33142]: E1204 01:18:18.562051 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175\": container with ID starting with efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175 not found: ID does not exist" containerID="efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175" Dec 04 01:18:18.562176 master-0 kubenswrapper[33142]: I1204 01:18:18.562073 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175"} err="failed to get container status \"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175\": rpc error: code = NotFound desc = could not find container \"efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175\": container with ID starting with efa67856fafce9959c676274dad70b93a5d3159452c38d30ed8a57fd8882d175 not found: ID does not exist" Dec 04 01:18:18.562176 master-0 kubenswrapper[33142]: I1204 01:18:18.562086 33142 scope.go:117] "RemoveContainer" containerID="9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f" Dec 04 01:18:18.562365 master-0 kubenswrapper[33142]: E1204 01:18:18.562327 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f\": container with ID starting with 9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f not found: ID does not exist" containerID="9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f" Dec 04 01:18:18.562365 master-0 kubenswrapper[33142]: I1204 01:18:18.562348 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f"} err="failed to get container status \"9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f\": rpc error: code = NotFound desc = could not find container \"9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f\": container with ID starting with 9b3b2639aa625a3d985142011b47aadda6d98a5024eb04202352d083a60ee48f not found: ID does not exist" Dec 04 01:18:19.916643 master-0 kubenswrapper[33142]: I1204 01:18:19.916556 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" path="/var/lib/kubelet/pods/30789c93-a118-46b3-8bbe-b4d78511daf6/volumes" Dec 04 01:18:19.917631 master-0 kubenswrapper[33142]: I1204 01:18:19.917569 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" path="/var/lib/kubelet/pods/81956575-c5cc-4428-bb93-ea9262181dc3/volumes" Dec 04 01:18:20.832507 master-0 kubenswrapper[33142]: I1204 01:18:20.832389 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:20.832878 master-0 kubenswrapper[33142]: I1204 01:18:20.832792 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-z7q8v" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="registry-server" containerID="cri-o://53dbba00560bb91b82425d04031e89d10eab0c88d83841debec73687dc67f988" gracePeriod=2 Dec 04 01:18:21.277173 master-0 kubenswrapper[33142]: I1204 01:18:21.275794 33142 generic.go:334] "Generic (PLEG): container finished" podID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerID="53dbba00560bb91b82425d04031e89d10eab0c88d83841debec73687dc67f988" exitCode=0 Dec 04 01:18:21.277173 master-0 kubenswrapper[33142]: I1204 01:18:21.275861 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerDied","Data":"53dbba00560bb91b82425d04031e89d10eab0c88d83841debec73687dc67f988"} Dec 04 01:18:21.677424 master-0 kubenswrapper[33142]: I1204 01:18:21.677365 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:21.754506 master-0 kubenswrapper[33142]: I1204 01:18:21.753955 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdw7g\" (UniqueName: \"kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g\") pod \"1f257a9a-ce87-4695-85e1-90b922f79a14\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " Dec 04 01:18:21.754506 master-0 kubenswrapper[33142]: I1204 01:18:21.754153 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities\") pod \"1f257a9a-ce87-4695-85e1-90b922f79a14\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " Dec 04 01:18:21.754506 master-0 kubenswrapper[33142]: I1204 01:18:21.754282 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content\") pod \"1f257a9a-ce87-4695-85e1-90b922f79a14\" (UID: \"1f257a9a-ce87-4695-85e1-90b922f79a14\") " Dec 04 01:18:21.755959 master-0 kubenswrapper[33142]: I1204 01:18:21.755647 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities" (OuterVolumeSpecName: "utilities") pod "1f257a9a-ce87-4695-85e1-90b922f79a14" (UID: "1f257a9a-ce87-4695-85e1-90b922f79a14"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:21.758588 master-0 kubenswrapper[33142]: I1204 01:18:21.758517 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g" (OuterVolumeSpecName: "kube-api-access-jdw7g") pod "1f257a9a-ce87-4695-85e1-90b922f79a14" (UID: "1f257a9a-ce87-4695-85e1-90b922f79a14"). InnerVolumeSpecName "kube-api-access-jdw7g". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:18:21.815986 master-0 kubenswrapper[33142]: I1204 01:18:21.815870 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1f257a9a-ce87-4695-85e1-90b922f79a14" (UID: "1f257a9a-ce87-4695-85e1-90b922f79a14"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:18:21.858078 master-0 kubenswrapper[33142]: I1204 01:18:21.858005 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jdw7g\" (UniqueName: \"kubernetes.io/projected/1f257a9a-ce87-4695-85e1-90b922f79a14-kube-api-access-jdw7g\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:21.858078 master-0 kubenswrapper[33142]: I1204 01:18:21.858062 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:21.858078 master-0 kubenswrapper[33142]: I1204 01:18:21.858079 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1f257a9a-ce87-4695-85e1-90b922f79a14-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:18:22.298689 master-0 kubenswrapper[33142]: I1204 01:18:22.298138 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-z7q8v" event={"ID":"1f257a9a-ce87-4695-85e1-90b922f79a14","Type":"ContainerDied","Data":"4d4ab98f0e4f1511b40bf56b8aaeb6da01645dc8fef9fb51639b182a04c36ad7"} Dec 04 01:18:22.298689 master-0 kubenswrapper[33142]: I1204 01:18:22.298231 33142 scope.go:117] "RemoveContainer" containerID="53dbba00560bb91b82425d04031e89d10eab0c88d83841debec73687dc67f988" Dec 04 01:18:22.298689 master-0 kubenswrapper[33142]: I1204 01:18:22.298225 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-z7q8v" Dec 04 01:18:22.348298 master-0 kubenswrapper[33142]: I1204 01:18:22.343819 33142 scope.go:117] "RemoveContainer" containerID="7f25d4ac9ab61f96452c0a4661c32780f4e6e35381f370077c8a7eb59177883e" Dec 04 01:18:22.351659 master-0 kubenswrapper[33142]: I1204 01:18:22.350988 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:22.365054 master-0 kubenswrapper[33142]: I1204 01:18:22.364917 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-z7q8v"] Dec 04 01:18:22.388679 master-0 kubenswrapper[33142]: I1204 01:18:22.387199 33142 scope.go:117] "RemoveContainer" containerID="6b24417ee74219dc4edbf5cd6f24b69a6c5885aa6259dcd3af6b4abd5a8e7a0f" Dec 04 01:18:23.917264 master-0 kubenswrapper[33142]: I1204 01:18:23.917175 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" path="/var/lib/kubelet/pods/1f257a9a-ce87-4695-85e1-90b922f79a14/volumes" Dec 04 01:28:09.067811 master-0 kubenswrapper[33142]: I1204 01:28:09.067597 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: E1204 01:28:09.068566 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="registry-server" Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: I1204 01:28:09.068596 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="registry-server" Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: E1204 01:28:09.068649 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="registry-server" Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: I1204 01:28:09.068665 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="registry-server" Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: E1204 01:28:09.068742 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="extract-content" Dec 04 01:28:09.068749 master-0 kubenswrapper[33142]: I1204 01:28:09.068758 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="extract-content" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.068777 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="extract-content" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.068791 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="extract-content" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.068808 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.068823 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.068851 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.068864 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.068914 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="extract-content" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.068952 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="extract-content" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.068975 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.068989 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="extract-utilities" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: E1204 01:28:09.069007 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="registry-server" Dec 04 01:28:09.069332 master-0 kubenswrapper[33142]: I1204 01:28:09.069021 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="registry-server" Dec 04 01:28:09.070511 master-0 kubenswrapper[33142]: I1204 01:28:09.069456 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="81956575-c5cc-4428-bb93-ea9262181dc3" containerName="registry-server" Dec 04 01:28:09.070511 master-0 kubenswrapper[33142]: I1204 01:28:09.069562 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="30789c93-a118-46b3-8bbe-b4d78511daf6" containerName="registry-server" Dec 04 01:28:09.070511 master-0 kubenswrapper[33142]: I1204 01:28:09.069602 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="1f257a9a-ce87-4695-85e1-90b922f79a14" containerName="registry-server" Dec 04 01:28:09.074978 master-0 kubenswrapper[33142]: I1204 01:28:09.074871 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.088486 master-0 kubenswrapper[33142]: I1204 01:28:09.083446 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:09.121284 master-0 kubenswrapper[33142]: I1204 01:28:09.120365 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7vk\" (UniqueName: \"kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.121284 master-0 kubenswrapper[33142]: I1204 01:28:09.120695 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.121284 master-0 kubenswrapper[33142]: I1204 01:28:09.120877 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.224056 master-0 kubenswrapper[33142]: I1204 01:28:09.223675 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.224056 master-0 kubenswrapper[33142]: I1204 01:28:09.223972 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7vk\" (UniqueName: \"kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.224446 master-0 kubenswrapper[33142]: I1204 01:28:09.224139 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.224553 master-0 kubenswrapper[33142]: I1204 01:28:09.224499 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.224908 master-0 kubenswrapper[33142]: I1204 01:28:09.224876 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.244367 master-0 kubenswrapper[33142]: I1204 01:28:09.244309 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7vk\" (UniqueName: \"kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk\") pod \"certified-operators-rtm42\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:09.434556 master-0 kubenswrapper[33142]: I1204 01:28:09.434081 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:10.040623 master-0 kubenswrapper[33142]: I1204 01:28:10.040547 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:10.040811 master-0 kubenswrapper[33142]: W1204 01:28:10.040643 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917116b3_6f9c_4e01_99e4_d790df24d12c.slice/crio-f21c357cfd933580c6140b7688c599388ffe6278ff9cc04d6e4b85b8c909c751 WatchSource:0}: Error finding container f21c357cfd933580c6140b7688c599388ffe6278ff9cc04d6e4b85b8c909c751: Status 404 returned error can't find the container with id f21c357cfd933580c6140b7688c599388ffe6278ff9cc04d6e4b85b8c909c751 Dec 04 01:28:10.640135 master-0 kubenswrapper[33142]: I1204 01:28:10.639991 33142 generic.go:334] "Generic (PLEG): container finished" podID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerID="f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba" exitCode=0 Dec 04 01:28:10.641086 master-0 kubenswrapper[33142]: I1204 01:28:10.640157 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerDied","Data":"f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba"} Dec 04 01:28:10.641086 master-0 kubenswrapper[33142]: I1204 01:28:10.640231 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerStarted","Data":"f21c357cfd933580c6140b7688c599388ffe6278ff9cc04d6e4b85b8c909c751"} Dec 04 01:28:10.646594 master-0 kubenswrapper[33142]: I1204 01:28:10.646518 33142 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 01:28:12.674708 master-0 kubenswrapper[33142]: I1204 01:28:12.673251 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerStarted","Data":"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b"} Dec 04 01:28:13.690749 master-0 kubenswrapper[33142]: I1204 01:28:13.690626 33142 generic.go:334] "Generic (PLEG): container finished" podID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerID="f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b" exitCode=0 Dec 04 01:28:13.690749 master-0 kubenswrapper[33142]: I1204 01:28:13.690702 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerDied","Data":"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b"} Dec 04 01:28:15.713672 master-0 kubenswrapper[33142]: I1204 01:28:15.713498 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerStarted","Data":"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387"} Dec 04 01:28:15.844041 master-0 kubenswrapper[33142]: I1204 01:28:15.843864 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-rtm42" podStartSLOduration=2.326102719 podStartE2EDuration="6.843825564s" podCreationTimestamp="2025-12-04 01:28:09 +0000 UTC" firstStartedPulling="2025-12-04 01:28:10.646312192 +0000 UTC m=+2463.048314042" lastFinishedPulling="2025-12-04 01:28:15.164035027 +0000 UTC m=+2467.566036887" observedRunningTime="2025-12-04 01:28:15.832505216 +0000 UTC m=+2468.234507086" watchObservedRunningTime="2025-12-04 01:28:15.843825564 +0000 UTC m=+2468.245827444" Dec 04 01:28:19.435269 master-0 kubenswrapper[33142]: I1204 01:28:19.434973 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:19.435269 master-0 kubenswrapper[33142]: I1204 01:28:19.435045 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:19.495273 master-0 kubenswrapper[33142]: I1204 01:28:19.495174 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:29.499038 master-0 kubenswrapper[33142]: I1204 01:28:29.498962 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:30.030345 master-0 kubenswrapper[33142]: I1204 01:28:30.030256 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:30.031130 master-0 kubenswrapper[33142]: I1204 01:28:30.031064 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-rtm42" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="registry-server" containerID="cri-o://7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387" gracePeriod=2 Dec 04 01:28:30.600729 master-0 kubenswrapper[33142]: I1204 01:28:30.600680 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:30.745692 master-0 kubenswrapper[33142]: I1204 01:28:30.745603 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content\") pod \"917116b3-6f9c-4e01-99e4-d790df24d12c\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " Dec 04 01:28:30.745692 master-0 kubenswrapper[33142]: I1204 01:28:30.745700 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities\") pod \"917116b3-6f9c-4e01-99e4-d790df24d12c\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " Dec 04 01:28:30.746196 master-0 kubenswrapper[33142]: I1204 01:28:30.745846 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d7vk\" (UniqueName: \"kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk\") pod \"917116b3-6f9c-4e01-99e4-d790df24d12c\" (UID: \"917116b3-6f9c-4e01-99e4-d790df24d12c\") " Dec 04 01:28:30.746835 master-0 kubenswrapper[33142]: I1204 01:28:30.746769 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities" (OuterVolumeSpecName: "utilities") pod "917116b3-6f9c-4e01-99e4-d790df24d12c" (UID: "917116b3-6f9c-4e01-99e4-d790df24d12c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:28:30.749194 master-0 kubenswrapper[33142]: I1204 01:28:30.749150 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk" (OuterVolumeSpecName: "kube-api-access-5d7vk") pod "917116b3-6f9c-4e01-99e4-d790df24d12c" (UID: "917116b3-6f9c-4e01-99e4-d790df24d12c"). InnerVolumeSpecName "kube-api-access-5d7vk". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:28:30.802233 master-0 kubenswrapper[33142]: I1204 01:28:30.802133 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "917116b3-6f9c-4e01-99e4-d790df24d12c" (UID: "917116b3-6f9c-4e01-99e4-d790df24d12c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:28:30.850325 master-0 kubenswrapper[33142]: I1204 01:28:30.850224 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:28:30.850325 master-0 kubenswrapper[33142]: I1204 01:28:30.850300 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/917116b3-6f9c-4e01-99e4-d790df24d12c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:28:30.850325 master-0 kubenswrapper[33142]: I1204 01:28:30.850321 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5d7vk\" (UniqueName: \"kubernetes.io/projected/917116b3-6f9c-4e01-99e4-d790df24d12c-kube-api-access-5d7vk\") on node \"master-0\" DevicePath \"\"" Dec 04 01:28:30.968335 master-0 kubenswrapper[33142]: I1204 01:28:30.968246 33142 generic.go:334] "Generic (PLEG): container finished" podID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerID="7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387" exitCode=0 Dec 04 01:28:30.968635 master-0 kubenswrapper[33142]: I1204 01:28:30.968343 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerDied","Data":"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387"} Dec 04 01:28:30.968635 master-0 kubenswrapper[33142]: I1204 01:28:30.968461 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rtm42" event={"ID":"917116b3-6f9c-4e01-99e4-d790df24d12c","Type":"ContainerDied","Data":"f21c357cfd933580c6140b7688c599388ffe6278ff9cc04d6e4b85b8c909c751"} Dec 04 01:28:30.968635 master-0 kubenswrapper[33142]: I1204 01:28:30.968389 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rtm42" Dec 04 01:28:30.968635 master-0 kubenswrapper[33142]: I1204 01:28:30.968501 33142 scope.go:117] "RemoveContainer" containerID="7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387" Dec 04 01:28:31.009754 master-0 kubenswrapper[33142]: I1204 01:28:31.009706 33142 scope.go:117] "RemoveContainer" containerID="f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b" Dec 04 01:28:31.051581 master-0 kubenswrapper[33142]: I1204 01:28:31.050100 33142 scope.go:117] "RemoveContainer" containerID="f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba" Dec 04 01:28:31.103519 master-0 kubenswrapper[33142]: I1204 01:28:31.103406 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:31.127366 master-0 kubenswrapper[33142]: I1204 01:28:31.127312 33142 scope.go:117] "RemoveContainer" containerID="7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387" Dec 04 01:28:31.127915 master-0 kubenswrapper[33142]: E1204 01:28:31.127850 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387\": container with ID starting with 7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387 not found: ID does not exist" containerID="7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387" Dec 04 01:28:31.128009 master-0 kubenswrapper[33142]: I1204 01:28:31.127939 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387"} err="failed to get container status \"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387\": rpc error: code = NotFound desc = could not find container \"7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387\": container with ID starting with 7603e796880720f981cde016adcb84db93c9f16142ae85821ac25480550c5387 not found: ID does not exist" Dec 04 01:28:31.128009 master-0 kubenswrapper[33142]: I1204 01:28:31.127976 33142 scope.go:117] "RemoveContainer" containerID="f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b" Dec 04 01:28:31.129099 master-0 kubenswrapper[33142]: E1204 01:28:31.128895 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b\": container with ID starting with f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b not found: ID does not exist" containerID="f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b" Dec 04 01:28:31.129260 master-0 kubenswrapper[33142]: I1204 01:28:31.129042 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b"} err="failed to get container status \"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b\": rpc error: code = NotFound desc = could not find container \"f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b\": container with ID starting with f56ca5f6c07d105c9733e3b95e8b585968504cf0b3d3b393f7a6f67aa9f7d49b not found: ID does not exist" Dec 04 01:28:31.129260 master-0 kubenswrapper[33142]: I1204 01:28:31.129136 33142 scope.go:117] "RemoveContainer" containerID="f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba" Dec 04 01:28:31.130088 master-0 kubenswrapper[33142]: E1204 01:28:31.130049 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba\": container with ID starting with f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba not found: ID does not exist" containerID="f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba" Dec 04 01:28:31.130088 master-0 kubenswrapper[33142]: I1204 01:28:31.130081 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba"} err="failed to get container status \"f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba\": rpc error: code = NotFound desc = could not find container \"f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba\": container with ID starting with f60a2e23ee6d86309c9ae6a42e3a59f7eeca833bf07a2a318d539b0455c896ba not found: ID does not exist" Dec 04 01:28:31.131120 master-0 kubenswrapper[33142]: I1204 01:28:31.131080 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-rtm42"] Dec 04 01:28:31.914339 master-0 kubenswrapper[33142]: I1204 01:28:31.914276 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" path="/var/lib/kubelet/pods/917116b3-6f9c-4e01-99e4-d790df24d12c/volumes" Dec 04 01:28:47.582957 master-0 kubenswrapper[33142]: I1204 01:28:47.582635 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: E1204 01:28:47.583224 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="extract-content" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: I1204 01:28:47.583245 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="extract-content" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: E1204 01:28:47.583271 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="registry-server" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: I1204 01:28:47.583277 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="registry-server" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: E1204 01:28:47.583330 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="extract-utilities" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: I1204 01:28:47.583337 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="extract-utilities" Dec 04 01:28:47.583614 master-0 kubenswrapper[33142]: I1204 01:28:47.583589 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="917116b3-6f9c-4e01-99e4-d790df24d12c" containerName="registry-server" Dec 04 01:28:47.586952 master-0 kubenswrapper[33142]: I1204 01:28:47.585802 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.710874 master-0 kubenswrapper[33142]: I1204 01:28:47.710787 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:28:47.754515 master-0 kubenswrapper[33142]: I1204 01:28:47.754434 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkrnt\" (UniqueName: \"kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.754795 master-0 kubenswrapper[33142]: I1204 01:28:47.754598 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.754795 master-0 kubenswrapper[33142]: I1204 01:28:47.754748 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.857054 master-0 kubenswrapper[33142]: I1204 01:28:47.856963 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qkrnt\" (UniqueName: \"kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.857305 master-0 kubenswrapper[33142]: I1204 01:28:47.857133 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.857305 master-0 kubenswrapper[33142]: I1204 01:28:47.857169 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.857815 master-0 kubenswrapper[33142]: I1204 01:28:47.857780 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.859255 master-0 kubenswrapper[33142]: I1204 01:28:47.858045 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.880826 master-0 kubenswrapper[33142]: I1204 01:28:47.879043 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkrnt\" (UniqueName: \"kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt\") pod \"redhat-operators-dt69h\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:47.911260 master-0 kubenswrapper[33142]: I1204 01:28:47.910615 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:48.454535 master-0 kubenswrapper[33142]: W1204 01:28:48.454471 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f089ea_b437_4b68_8940_80367596bd11.slice/crio-d9becb91c51c484de122cce470e2aba1247ed8b3e646f7420b04b945341968b5 WatchSource:0}: Error finding container d9becb91c51c484de122cce470e2aba1247ed8b3e646f7420b04b945341968b5: Status 404 returned error can't find the container with id d9becb91c51c484de122cce470e2aba1247ed8b3e646f7420b04b945341968b5 Dec 04 01:28:48.454841 master-0 kubenswrapper[33142]: I1204 01:28:48.454803 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:28:49.254539 master-0 kubenswrapper[33142]: I1204 01:28:49.254454 33142 generic.go:334] "Generic (PLEG): container finished" podID="45f089ea-b437-4b68-8940-80367596bd11" containerID="691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc" exitCode=0 Dec 04 01:28:49.254539 master-0 kubenswrapper[33142]: I1204 01:28:49.254515 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerDied","Data":"691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc"} Dec 04 01:28:49.254539 master-0 kubenswrapper[33142]: I1204 01:28:49.254545 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerStarted","Data":"d9becb91c51c484de122cce470e2aba1247ed8b3e646f7420b04b945341968b5"} Dec 04 01:28:51.286384 master-0 kubenswrapper[33142]: I1204 01:28:51.286291 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerStarted","Data":"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304"} Dec 04 01:28:52.300196 master-0 kubenswrapper[33142]: I1204 01:28:52.300102 33142 generic.go:334] "Generic (PLEG): container finished" podID="45f089ea-b437-4b68-8940-80367596bd11" containerID="34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304" exitCode=0 Dec 04 01:28:52.300196 master-0 kubenswrapper[33142]: I1204 01:28:52.300183 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerDied","Data":"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304"} Dec 04 01:28:53.323061 master-0 kubenswrapper[33142]: I1204 01:28:53.322904 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerStarted","Data":"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22"} Dec 04 01:28:53.362083 master-0 kubenswrapper[33142]: I1204 01:28:53.361983 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-dt69h" podStartSLOduration=2.914435273 podStartE2EDuration="6.361954775s" podCreationTimestamp="2025-12-04 01:28:47 +0000 UTC" firstStartedPulling="2025-12-04 01:28:49.256789087 +0000 UTC m=+2501.658790937" lastFinishedPulling="2025-12-04 01:28:52.704308589 +0000 UTC m=+2505.106310439" observedRunningTime="2025-12-04 01:28:53.347411817 +0000 UTC m=+2505.749413677" watchObservedRunningTime="2025-12-04 01:28:53.361954775 +0000 UTC m=+2505.763956625" Dec 04 01:28:57.937133 master-0 kubenswrapper[33142]: I1204 01:28:57.937037 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:57.937133 master-0 kubenswrapper[33142]: I1204 01:28:57.937104 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:28:58.983126 master-0 kubenswrapper[33142]: I1204 01:28:58.983027 33142 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-dt69h" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="registry-server" probeResult="failure" output=< Dec 04 01:28:58.983126 master-0 kubenswrapper[33142]: timeout: failed to connect service ":50051" within 1s Dec 04 01:28:58.983126 master-0 kubenswrapper[33142]: > Dec 04 01:29:07.963448 master-0 kubenswrapper[33142]: I1204 01:29:07.963368 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:29:08.030579 master-0 kubenswrapper[33142]: I1204 01:29:08.030522 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:29:08.211981 master-0 kubenswrapper[33142]: I1204 01:29:08.211896 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:29:09.514998 master-0 kubenswrapper[33142]: I1204 01:29:09.514835 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-dt69h" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="registry-server" containerID="cri-o://f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22" gracePeriod=2 Dec 04 01:29:10.160506 master-0 kubenswrapper[33142]: I1204 01:29:10.160431 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:29:10.230952 master-0 kubenswrapper[33142]: I1204 01:29:10.230865 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content\") pod \"45f089ea-b437-4b68-8940-80367596bd11\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " Dec 04 01:29:10.231198 master-0 kubenswrapper[33142]: I1204 01:29:10.231140 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkrnt\" (UniqueName: \"kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt\") pod \"45f089ea-b437-4b68-8940-80367596bd11\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " Dec 04 01:29:10.231275 master-0 kubenswrapper[33142]: I1204 01:29:10.231236 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities\") pod \"45f089ea-b437-4b68-8940-80367596bd11\" (UID: \"45f089ea-b437-4b68-8940-80367596bd11\") " Dec 04 01:29:10.232181 master-0 kubenswrapper[33142]: I1204 01:29:10.232130 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities" (OuterVolumeSpecName: "utilities") pod "45f089ea-b437-4b68-8940-80367596bd11" (UID: "45f089ea-b437-4b68-8940-80367596bd11"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:29:10.233111 master-0 kubenswrapper[33142]: I1204 01:29:10.233060 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:29:10.239876 master-0 kubenswrapper[33142]: I1204 01:29:10.239814 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt" (OuterVolumeSpecName: "kube-api-access-qkrnt") pod "45f089ea-b437-4b68-8940-80367596bd11" (UID: "45f089ea-b437-4b68-8940-80367596bd11"). InnerVolumeSpecName "kube-api-access-qkrnt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:29:10.337277 master-0 kubenswrapper[33142]: I1204 01:29:10.337040 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qkrnt\" (UniqueName: \"kubernetes.io/projected/45f089ea-b437-4b68-8940-80367596bd11-kube-api-access-qkrnt\") on node \"master-0\" DevicePath \"\"" Dec 04 01:29:10.370552 master-0 kubenswrapper[33142]: I1204 01:29:10.370472 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "45f089ea-b437-4b68-8940-80367596bd11" (UID: "45f089ea-b437-4b68-8940-80367596bd11"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:29:10.439486 master-0 kubenswrapper[33142]: I1204 01:29:10.439420 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/45f089ea-b437-4b68-8940-80367596bd11-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:29:10.530872 master-0 kubenswrapper[33142]: I1204 01:29:10.530807 33142 generic.go:334] "Generic (PLEG): container finished" podID="45f089ea-b437-4b68-8940-80367596bd11" containerID="f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22" exitCode=0 Dec 04 01:29:10.531468 master-0 kubenswrapper[33142]: I1204 01:29:10.530896 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerDied","Data":"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22"} Dec 04 01:29:10.531580 master-0 kubenswrapper[33142]: I1204 01:29:10.531564 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt69h" event={"ID":"45f089ea-b437-4b68-8940-80367596bd11","Type":"ContainerDied","Data":"d9becb91c51c484de122cce470e2aba1247ed8b3e646f7420b04b945341968b5"} Dec 04 01:29:10.531662 master-0 kubenswrapper[33142]: I1204 01:29:10.530923 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt69h" Dec 04 01:29:10.531862 master-0 kubenswrapper[33142]: I1204 01:29:10.531589 33142 scope.go:117] "RemoveContainer" containerID="f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22" Dec 04 01:29:10.571277 master-0 kubenswrapper[33142]: I1204 01:29:10.571199 33142 scope.go:117] "RemoveContainer" containerID="34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304" Dec 04 01:29:10.612548 master-0 kubenswrapper[33142]: I1204 01:29:10.612506 33142 scope.go:117] "RemoveContainer" containerID="691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc" Dec 04 01:29:10.640225 master-0 kubenswrapper[33142]: I1204 01:29:10.640166 33142 scope.go:117] "RemoveContainer" containerID="f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22" Dec 04 01:29:10.640911 master-0 kubenswrapper[33142]: E1204 01:29:10.640865 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22\": container with ID starting with f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22 not found: ID does not exist" containerID="f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22" Dec 04 01:29:10.640992 master-0 kubenswrapper[33142]: I1204 01:29:10.640951 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22"} err="failed to get container status \"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22\": rpc error: code = NotFound desc = could not find container \"f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22\": container with ID starting with f5e29cb2cf96f125ebbdb7c3fb72d09d63ef62a86e35a7a3fcde8a7d93038b22 not found: ID does not exist" Dec 04 01:29:10.641068 master-0 kubenswrapper[33142]: I1204 01:29:10.640996 33142 scope.go:117] "RemoveContainer" containerID="34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304" Dec 04 01:29:10.641627 master-0 kubenswrapper[33142]: E1204 01:29:10.641582 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304\": container with ID starting with 34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304 not found: ID does not exist" containerID="34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304" Dec 04 01:29:10.641700 master-0 kubenswrapper[33142]: I1204 01:29:10.641644 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304"} err="failed to get container status \"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304\": rpc error: code = NotFound desc = could not find container \"34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304\": container with ID starting with 34874afe02f99a84a592e1fb3475af7536c43e307ff3dee08c614902d7d1e304 not found: ID does not exist" Dec 04 01:29:10.641700 master-0 kubenswrapper[33142]: I1204 01:29:10.641680 33142 scope.go:117] "RemoveContainer" containerID="691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc" Dec 04 01:29:10.642307 master-0 kubenswrapper[33142]: E1204 01:29:10.642252 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc\": container with ID starting with 691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc not found: ID does not exist" containerID="691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc" Dec 04 01:29:10.642383 master-0 kubenswrapper[33142]: I1204 01:29:10.642326 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc"} err="failed to get container status \"691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc\": rpc error: code = NotFound desc = could not find container \"691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc\": container with ID starting with 691903aab656de1c9bbec7c7bdac0b9960fafa4fde48ae9b1b6f87e677d1c3dc not found: ID does not exist" Dec 04 01:29:10.801328 master-0 kubenswrapper[33142]: I1204 01:29:10.801229 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:29:10.816347 master-0 kubenswrapper[33142]: I1204 01:29:10.816270 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-dt69h"] Dec 04 01:29:11.914895 master-0 kubenswrapper[33142]: I1204 01:29:11.914791 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f089ea-b437-4b68-8940-80367596bd11" path="/var/lib/kubelet/pods/45f089ea-b437-4b68-8940-80367596bd11/volumes" Dec 04 01:30:00.164315 master-0 kubenswrapper[33142]: I1204 01:30:00.164225 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p"] Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: E1204 01:30:00.165078 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="extract-utilities" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: I1204 01:30:00.165102 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="extract-utilities" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: E1204 01:30:00.165156 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="extract-content" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: I1204 01:30:00.165167 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="extract-content" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: E1204 01:30:00.165182 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="registry-server" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: I1204 01:30:00.165191 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="registry-server" Dec 04 01:30:00.166210 master-0 kubenswrapper[33142]: I1204 01:30:00.165509 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="45f089ea-b437-4b68-8940-80367596bd11" containerName="registry-server" Dec 04 01:30:00.166652 master-0 kubenswrapper[33142]: I1204 01:30:00.166626 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.171735 master-0 kubenswrapper[33142]: I1204 01:30:00.171242 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 01:30:00.171735 master-0 kubenswrapper[33142]: I1204 01:30:00.171400 33142 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-zx2gd" Dec 04 01:30:00.182544 master-0 kubenswrapper[33142]: I1204 01:30:00.182456 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p"] Dec 04 01:30:00.269400 master-0 kubenswrapper[33142]: I1204 01:30:00.269327 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.269681 master-0 kubenswrapper[33142]: I1204 01:30:00.269500 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxml2\" (UniqueName: \"kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.269681 master-0 kubenswrapper[33142]: I1204 01:30:00.269585 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.372561 master-0 kubenswrapper[33142]: I1204 01:30:00.372489 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cxml2\" (UniqueName: \"kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.372832 master-0 kubenswrapper[33142]: I1204 01:30:00.372583 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.372832 master-0 kubenswrapper[33142]: I1204 01:30:00.372717 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.374295 master-0 kubenswrapper[33142]: I1204 01:30:00.374255 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.377964 master-0 kubenswrapper[33142]: I1204 01:30:00.377849 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.390835 master-0 kubenswrapper[33142]: I1204 01:30:00.390611 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxml2\" (UniqueName: \"kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2\") pod \"collect-profiles-29413530-7b44p\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.514541 master-0 kubenswrapper[33142]: I1204 01:30:00.514398 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:00.994601 master-0 kubenswrapper[33142]: I1204 01:30:00.994534 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p"] Dec 04 01:30:01.256739 master-0 kubenswrapper[33142]: I1204 01:30:01.256550 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" event={"ID":"782a6003-b23a-44d6-9155-d19588366ec9","Type":"ContainerStarted","Data":"2a124c98cb6cea02ef5913d6d693adfb1b234eb3cc4f3febd34063b0993a46e4"} Dec 04 01:30:01.256739 master-0 kubenswrapper[33142]: I1204 01:30:01.256607 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" event={"ID":"782a6003-b23a-44d6-9155-d19588366ec9","Type":"ContainerStarted","Data":"5616f3ad318c24be17fcc89a0e718b14060fa522a05d656a8d4a508400e84b27"} Dec 04 01:30:01.281012 master-0 kubenswrapper[33142]: I1204 01:30:01.280860 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" podStartSLOduration=1.28083631 podStartE2EDuration="1.28083631s" podCreationTimestamp="2025-12-04 01:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:30:01.276952002 +0000 UTC m=+2573.678953862" watchObservedRunningTime="2025-12-04 01:30:01.28083631 +0000 UTC m=+2573.682838160" Dec 04 01:30:02.271109 master-0 kubenswrapper[33142]: I1204 01:30:02.270973 33142 generic.go:334] "Generic (PLEG): container finished" podID="782a6003-b23a-44d6-9155-d19588366ec9" containerID="2a124c98cb6cea02ef5913d6d693adfb1b234eb3cc4f3febd34063b0993a46e4" exitCode=0 Dec 04 01:30:02.272064 master-0 kubenswrapper[33142]: I1204 01:30:02.271088 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" event={"ID":"782a6003-b23a-44d6-9155-d19588366ec9","Type":"ContainerDied","Data":"2a124c98cb6cea02ef5913d6d693adfb1b234eb3cc4f3febd34063b0993a46e4"} Dec 04 01:30:03.759332 master-0 kubenswrapper[33142]: I1204 01:30:03.759266 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:03.946995 master-0 kubenswrapper[33142]: I1204 01:30:03.945577 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume\") pod \"782a6003-b23a-44d6-9155-d19588366ec9\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " Dec 04 01:30:03.946995 master-0 kubenswrapper[33142]: I1204 01:30:03.945769 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxml2\" (UniqueName: \"kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2\") pod \"782a6003-b23a-44d6-9155-d19588366ec9\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " Dec 04 01:30:03.953470 master-0 kubenswrapper[33142]: I1204 01:30:03.945991 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume\") pod \"782a6003-b23a-44d6-9155-d19588366ec9\" (UID: \"782a6003-b23a-44d6-9155-d19588366ec9\") " Dec 04 01:30:03.953470 master-0 kubenswrapper[33142]: I1204 01:30:03.952260 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume" (OuterVolumeSpecName: "config-volume") pod "782a6003-b23a-44d6-9155-d19588366ec9" (UID: "782a6003-b23a-44d6-9155-d19588366ec9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 01:30:03.956661 master-0 kubenswrapper[33142]: I1204 01:30:03.956596 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2" (OuterVolumeSpecName: "kube-api-access-cxml2") pod "782a6003-b23a-44d6-9155-d19588366ec9" (UID: "782a6003-b23a-44d6-9155-d19588366ec9"). InnerVolumeSpecName "kube-api-access-cxml2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:30:03.971553 master-0 kubenswrapper[33142]: I1204 01:30:03.971405 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "782a6003-b23a-44d6-9155-d19588366ec9" (UID: "782a6003-b23a-44d6-9155-d19588366ec9"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 01:30:03.977085 master-0 kubenswrapper[33142]: I1204 01:30:03.977013 33142 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/782a6003-b23a-44d6-9155-d19588366ec9-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:03.977287 master-0 kubenswrapper[33142]: I1204 01:30:03.977130 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cxml2\" (UniqueName: \"kubernetes.io/projected/782a6003-b23a-44d6-9155-d19588366ec9-kube-api-access-cxml2\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:03.977405 master-0 kubenswrapper[33142]: I1204 01:30:03.977382 33142 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/782a6003-b23a-44d6-9155-d19588366ec9-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:04.298151 master-0 kubenswrapper[33142]: I1204 01:30:04.297727 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" event={"ID":"782a6003-b23a-44d6-9155-d19588366ec9","Type":"ContainerDied","Data":"5616f3ad318c24be17fcc89a0e718b14060fa522a05d656a8d4a508400e84b27"} Dec 04 01:30:04.298151 master-0 kubenswrapper[33142]: I1204 01:30:04.297815 33142 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5616f3ad318c24be17fcc89a0e718b14060fa522a05d656a8d4a508400e84b27" Dec 04 01:30:04.298151 master-0 kubenswrapper[33142]: I1204 01:30:04.297910 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29413530-7b44p" Dec 04 01:30:04.481314 master-0 kubenswrapper[33142]: I1204 01:30:04.392258 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht"] Dec 04 01:30:04.490674 master-0 kubenswrapper[33142]: I1204 01:30:04.486941 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29413485-5fwht"] Dec 04 01:30:05.915493 master-0 kubenswrapper[33142]: I1204 01:30:05.915386 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eb3966e-d567-4d7b-957e-ea3c3bf313cb" path="/var/lib/kubelet/pods/9eb3966e-d567-4d7b-957e-ea3c3bf313cb/volumes" Dec 04 01:30:17.690036 master-0 kubenswrapper[33142]: I1204 01:30:17.689974 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knls8/must-gather-t6f77"] Dec 04 01:30:17.690745 master-0 kubenswrapper[33142]: E1204 01:30:17.690710 33142 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="782a6003-b23a-44d6-9155-d19588366ec9" containerName="collect-profiles" Dec 04 01:30:17.690745 master-0 kubenswrapper[33142]: I1204 01:30:17.690732 33142 state_mem.go:107] "Deleted CPUSet assignment" podUID="782a6003-b23a-44d6-9155-d19588366ec9" containerName="collect-profiles" Dec 04 01:30:17.691233 master-0 kubenswrapper[33142]: I1204 01:30:17.691202 33142 memory_manager.go:354] "RemoveStaleState removing state" podUID="782a6003-b23a-44d6-9155-d19588366ec9" containerName="collect-profiles" Dec 04 01:30:17.692684 master-0 kubenswrapper[33142]: I1204 01:30:17.692658 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.695109 master-0 kubenswrapper[33142]: I1204 01:30:17.695076 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-knls8"/"openshift-service-ca.crt" Dec 04 01:30:17.696039 master-0 kubenswrapper[33142]: I1204 01:30:17.696004 33142 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-knls8"/"kube-root-ca.crt" Dec 04 01:30:17.704393 master-0 kubenswrapper[33142]: I1204 01:30:17.704327 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knls8/must-gather-wck6x"] Dec 04 01:30:17.708819 master-0 kubenswrapper[33142]: I1204 01:30:17.708772 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.719324 master-0 kubenswrapper[33142]: I1204 01:30:17.719253 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/must-gather-wck6x"] Dec 04 01:30:17.739793 master-0 kubenswrapper[33142]: I1204 01:30:17.739721 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/must-gather-t6f77"] Dec 04 01:30:17.869002 master-0 kubenswrapper[33142]: I1204 01:30:17.867277 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c147ccee-a934-4eac-877e-289a834f7dc2-must-gather-output\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.869002 master-0 kubenswrapper[33142]: I1204 01:30:17.867535 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a108271c-2b80-4e6d-afb2-64ecaac28057-must-gather-output\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.869002 master-0 kubenswrapper[33142]: I1204 01:30:17.868318 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfr6t\" (UniqueName: \"kubernetes.io/projected/c147ccee-a934-4eac-877e-289a834f7dc2-kube-api-access-rfr6t\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.869002 master-0 kubenswrapper[33142]: I1204 01:30:17.868525 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh75h\" (UniqueName: \"kubernetes.io/projected/a108271c-2b80-4e6d-afb2-64ecaac28057-kube-api-access-nh75h\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.972882 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a108271c-2b80-4e6d-afb2-64ecaac28057-must-gather-output\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.973471 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a108271c-2b80-4e6d-afb2-64ecaac28057-must-gather-output\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.973662 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rfr6t\" (UniqueName: \"kubernetes.io/projected/c147ccee-a934-4eac-877e-289a834f7dc2-kube-api-access-rfr6t\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.973771 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nh75h\" (UniqueName: \"kubernetes.io/projected/a108271c-2b80-4e6d-afb2-64ecaac28057-kube-api-access-nh75h\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.974201 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c147ccee-a934-4eac-877e-289a834f7dc2-must-gather-output\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.975686 master-0 kubenswrapper[33142]: I1204 01:30:17.974701 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c147ccee-a934-4eac-877e-289a834f7dc2-must-gather-output\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.992778 master-0 kubenswrapper[33142]: I1204 01:30:17.992458 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfr6t\" (UniqueName: \"kubernetes.io/projected/c147ccee-a934-4eac-877e-289a834f7dc2-kube-api-access-rfr6t\") pod \"must-gather-wck6x\" (UID: \"c147ccee-a934-4eac-877e-289a834f7dc2\") " pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:17.993899 master-0 kubenswrapper[33142]: I1204 01:30:17.993861 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh75h\" (UniqueName: \"kubernetes.io/projected/a108271c-2b80-4e6d-afb2-64ecaac28057-kube-api-access-nh75h\") pod \"must-gather-t6f77\" (UID: \"a108271c-2b80-4e6d-afb2-64ecaac28057\") " pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:18.013956 master-0 kubenswrapper[33142]: I1204 01:30:18.012857 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/must-gather-t6f77" Dec 04 01:30:18.029216 master-0 kubenswrapper[33142]: I1204 01:30:18.029126 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/must-gather-wck6x" Dec 04 01:30:18.511606 master-0 kubenswrapper[33142]: W1204 01:30:18.500849 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda108271c_2b80_4e6d_afb2_64ecaac28057.slice/crio-cedf438f904ff485f0890f3db51276a26ef5c746a9f89d5af433aca185a438ef WatchSource:0}: Error finding container cedf438f904ff485f0890f3db51276a26ef5c746a9f89d5af433aca185a438ef: Status 404 returned error can't find the container with id cedf438f904ff485f0890f3db51276a26ef5c746a9f89d5af433aca185a438ef Dec 04 01:30:18.511606 master-0 kubenswrapper[33142]: I1204 01:30:18.507987 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/must-gather-t6f77"] Dec 04 01:30:18.531548 master-0 kubenswrapper[33142]: I1204 01:30:18.531486 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-t6f77" event={"ID":"a108271c-2b80-4e6d-afb2-64ecaac28057","Type":"ContainerStarted","Data":"cedf438f904ff485f0890f3db51276a26ef5c746a9f89d5af433aca185a438ef"} Dec 04 01:30:18.608953 master-0 kubenswrapper[33142]: I1204 01:30:18.608850 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/must-gather-wck6x"] Dec 04 01:30:19.298815 master-0 kubenswrapper[33142]: I1204 01:30:19.298750 33142 scope.go:117] "RemoveContainer" containerID="274339ba78590b378384fabf9e945e17f757b313a617429d755e31ef00625b28" Dec 04 01:30:19.546314 master-0 kubenswrapper[33142]: I1204 01:30:19.546244 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-wck6x" event={"ID":"c147ccee-a934-4eac-877e-289a834f7dc2","Type":"ContainerStarted","Data":"6de2ddf33488ad8cb308e54885640b1badffe0dfca18b9be127ddae5efb4a8e7"} Dec 04 01:30:20.571858 master-0 kubenswrapper[33142]: I1204 01:30:20.571698 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-t6f77" event={"ID":"a108271c-2b80-4e6d-afb2-64ecaac28057","Type":"ContainerStarted","Data":"a9a36029f9add254054d43d03a65b40ac8dfd638dbb8a46b0b9151c9363a7b08"} Dec 04 01:30:20.571858 master-0 kubenswrapper[33142]: I1204 01:30:20.571790 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-t6f77" event={"ID":"a108271c-2b80-4e6d-afb2-64ecaac28057","Type":"ContainerStarted","Data":"3877467d17baf81e1d9352bc10320531a0e26af7eba5a1da6c4ffd5e5a9ea0b0"} Dec 04 01:30:20.608112 master-0 kubenswrapper[33142]: I1204 01:30:20.607960 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-knls8/must-gather-t6f77" podStartSLOduration=2.383615147 podStartE2EDuration="3.607892886s" podCreationTimestamp="2025-12-04 01:30:17 +0000 UTC" firstStartedPulling="2025-12-04 01:30:18.503259391 +0000 UTC m=+2590.905261251" lastFinishedPulling="2025-12-04 01:30:19.72753714 +0000 UTC m=+2592.129538990" observedRunningTime="2025-12-04 01:30:20.592893065 +0000 UTC m=+2592.994894935" watchObservedRunningTime="2025-12-04 01:30:20.607892886 +0000 UTC m=+2593.009894746" Dec 04 01:30:21.846687 master-0 kubenswrapper[33142]: I1204 01:30:21.846604 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-version_cluster-version-operator-7c49fbfc6f-mbdzr_004c989d-6ae8-4147-8355-af1118fe6a98/cluster-version-operator/1.log" Dec 04 01:30:22.382509 master-0 kubenswrapper[33142]: I1204 01:30:22.382437 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-version_cluster-version-operator-7c49fbfc6f-mbdzr_004c989d-6ae8-4147-8355-af1118fe6a98/cluster-version-operator/0.log" Dec 04 01:30:23.628743 master-0 kubenswrapper[33142]: I1204 01:30:23.628663 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-wck6x" event={"ID":"c147ccee-a934-4eac-877e-289a834f7dc2","Type":"ContainerStarted","Data":"89f1fcc05a99dec4c84ee14fc1fcc129232e1d31553433e9c032cb3e00e01a04"} Dec 04 01:30:24.045708 master-0 kubenswrapper[33142]: I1204 01:30:24.045580 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:24.048574 master-0 kubenswrapper[33142]: I1204 01:30:24.048545 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.083787 master-0 kubenswrapper[33142]: I1204 01:30:24.083730 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:24.201952 master-0 kubenswrapper[33142]: I1204 01:30:24.201467 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.201952 master-0 kubenswrapper[33142]: I1204 01:30:24.201619 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.201952 master-0 kubenswrapper[33142]: I1204 01:30:24.201656 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx9zj\" (UniqueName: \"kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.304908 master-0 kubenswrapper[33142]: I1204 01:30:24.304609 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.305484 master-0 kubenswrapper[33142]: I1204 01:30:24.305431 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.307891 master-0 kubenswrapper[33142]: I1204 01:30:24.307837 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.308125 master-0 kubenswrapper[33142]: I1204 01:30:24.308099 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fx9zj\" (UniqueName: \"kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.309717 master-0 kubenswrapper[33142]: I1204 01:30:24.309652 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.374445 master-0 kubenswrapper[33142]: I1204 01:30:24.374382 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx9zj\" (UniqueName: \"kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj\") pod \"community-operators-p6sh6\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.428197 master-0 kubenswrapper[33142]: I1204 01:30:24.428080 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:24.655271 master-0 kubenswrapper[33142]: I1204 01:30:24.653156 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/must-gather-wck6x" event={"ID":"c147ccee-a934-4eac-877e-289a834f7dc2","Type":"ContainerStarted","Data":"69345ba6e6503f4459c22dd6bf766472d402ea0d9ea967831ebab532ec5ac48a"} Dec 04 01:30:24.708962 master-0 kubenswrapper[33142]: I1204 01:30:24.705682 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-knls8/must-gather-wck6x" podStartSLOduration=3.212031646 podStartE2EDuration="7.705653835s" podCreationTimestamp="2025-12-04 01:30:17 +0000 UTC" firstStartedPulling="2025-12-04 01:30:18.613238018 +0000 UTC m=+2591.015239868" lastFinishedPulling="2025-12-04 01:30:23.106860207 +0000 UTC m=+2595.508862057" observedRunningTime="2025-12-04 01:30:24.684057199 +0000 UTC m=+2597.086059059" watchObservedRunningTime="2025-12-04 01:30:24.705653835 +0000 UTC m=+2597.107655695" Dec 04 01:30:26.476047 master-0 kubenswrapper[33142]: I1204 01:30:26.475994 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:26.489294 master-0 kubenswrapper[33142]: I1204 01:30:26.488968 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:26.489294 master-0 kubenswrapper[33142]: W1204 01:30:26.489214 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57640b3_5e74_40ac_8d37_6b0889ba383d.slice/crio-d1baf4b611c9199b7b0f600799d7e73f88799fba2d680668d14e2ec777b1c53f WatchSource:0}: Error finding container d1baf4b611c9199b7b0f600799d7e73f88799fba2d680668d14e2ec777b1c53f: Status 404 returned error can't find the container with id d1baf4b611c9199b7b0f600799d7e73f88799fba2d680668d14e2ec777b1c53f Dec 04 01:30:26.492685 master-0 kubenswrapper[33142]: I1204 01:30:26.492592 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.527300 master-0 kubenswrapper[33142]: I1204 01:30:26.526197 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:26.693867 master-0 kubenswrapper[33142]: I1204 01:30:26.665596 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.693867 master-0 kubenswrapper[33142]: I1204 01:30:26.665778 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.693867 master-0 kubenswrapper[33142]: I1204 01:30:26.665955 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w6td\" (UniqueName: \"kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.787953 master-0 kubenswrapper[33142]: I1204 01:30:26.784965 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerStarted","Data":"d1baf4b611c9199b7b0f600799d7e73f88799fba2d680668d14e2ec777b1c53f"} Dec 04 01:30:26.787953 master-0 kubenswrapper[33142]: I1204 01:30:26.786803 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.787953 master-0 kubenswrapper[33142]: I1204 01:30:26.786842 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.787953 master-0 kubenswrapper[33142]: I1204 01:30:26.786880 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9w6td\" (UniqueName: \"kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.787953 master-0 kubenswrapper[33142]: I1204 01:30:26.787539 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.791336 master-0 kubenswrapper[33142]: I1204 01:30:26.790427 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.822518 master-0 kubenswrapper[33142]: I1204 01:30:26.822458 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w6td\" (UniqueName: \"kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td\") pod \"redhat-marketplace-9jszv\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:26.860853 master-0 kubenswrapper[33142]: I1204 01:30:26.860777 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-console-plugin-7fbb5f6569-qncth_9c182ddf-b242-4630-98a3-7cd49905eaa8/nmstate-console-plugin/0.log" Dec 04 01:30:26.908491 master-0 kubenswrapper[33142]: I1204 01:30:26.901238 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-92pkn_13a0afa0-9bb4-4676-89c3-bdd08925b127/nmstate-handler/0.log" Dec 04 01:30:27.000721 master-0 kubenswrapper[33142]: I1204 01:30:26.999500 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f946cbc9-ljqrs_21ad452f-9242-4a85-9ffb-9569b25cb9f5/nmstate-metrics/0.log" Dec 04 01:30:27.026114 master-0 kubenswrapper[33142]: I1204 01:30:27.022404 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f946cbc9-ljqrs_21ad452f-9242-4a85-9ffb-9569b25cb9f5/kube-rbac-proxy/0.log" Dec 04 01:30:27.062959 master-0 kubenswrapper[33142]: I1204 01:30:27.057772 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:27.062959 master-0 kubenswrapper[33142]: I1204 01:30:27.059412 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-5b5b58f5c8-bfvsq_867be82d-8a79-43ca-a1e8-b5b2dfba2952/nmstate-operator/0.log" Dec 04 01:30:27.123155 master-0 kubenswrapper[33142]: I1204 01:30:27.120437 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-5f6d4c5ccb-6cndf_0a09a9a0-b512-4054-93c3-af7ccb4d4c87/nmstate-webhook/0.log" Dec 04 01:30:27.220049 master-0 kubenswrapper[33142]: I1204 01:30:27.219845 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-x4fnw_201d2247-e8f9-498e-b990-f9d610a70997/controller/0.log" Dec 04 01:30:27.254298 master-0 kubenswrapper[33142]: I1204 01:30:27.245996 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-x4fnw_201d2247-e8f9-498e-b990-f9d610a70997/kube-rbac-proxy/0.log" Dec 04 01:30:27.357957 master-0 kubenswrapper[33142]: I1204 01:30:27.357630 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/controller/0.log" Dec 04 01:30:27.881326 master-0 kubenswrapper[33142]: I1204 01:30:27.880834 33142 generic.go:334] "Generic (PLEG): container finished" podID="a57640b3-5e74-40ac-8d37-6b0889ba383d" containerID="8f1fe360cb38dc9869066a04b55327a6f97a21c5ce9e537ce8099a695b89e185" exitCode=0 Dec 04 01:30:27.881326 master-0 kubenswrapper[33142]: I1204 01:30:27.881012 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerDied","Data":"8f1fe360cb38dc9869066a04b55327a6f97a21c5ce9e537ce8099a695b89e185"} Dec 04 01:30:27.887142 master-0 kubenswrapper[33142]: I1204 01:30:27.886729 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:28.923947 master-0 kubenswrapper[33142]: I1204 01:30:28.920200 33142 generic.go:334] "Generic (PLEG): container finished" podID="f95061de-6d89-469c-87a3-3035a725e1b1" containerID="f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78" exitCode=0 Dec 04 01:30:28.923947 master-0 kubenswrapper[33142]: I1204 01:30:28.920267 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerDied","Data":"f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78"} Dec 04 01:30:28.923947 master-0 kubenswrapper[33142]: I1204 01:30:28.920297 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerStarted","Data":"17e21f0b5d87fe88a723551ed9df816c2556d6d77dcaf23e73ea8c3d9e36e06f"} Dec 04 01:30:29.307918 master-0 kubenswrapper[33142]: I1204 01:30:29.307830 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/frr/0.log" Dec 04 01:30:29.333266 master-0 kubenswrapper[33142]: I1204 01:30:29.333200 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/reloader/0.log" Dec 04 01:30:29.350966 master-0 kubenswrapper[33142]: I1204 01:30:29.350779 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/frr-metrics/0.log" Dec 04 01:30:29.381026 master-0 kubenswrapper[33142]: I1204 01:30:29.376246 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/kube-rbac-proxy/0.log" Dec 04 01:30:29.427634 master-0 kubenswrapper[33142]: I1204 01:30:29.424043 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/kube-rbac-proxy-frr/0.log" Dec 04 01:30:29.470817 master-0 kubenswrapper[33142]: I1204 01:30:29.470759 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-frr-files/0.log" Dec 04 01:30:29.492620 master-0 kubenswrapper[33142]: I1204 01:30:29.490572 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-reloader/0.log" Dec 04 01:30:29.517288 master-0 kubenswrapper[33142]: I1204 01:30:29.515330 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-metrics/0.log" Dec 04 01:30:29.543959 master-0 kubenswrapper[33142]: I1204 01:30:29.541234 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-7fcb986d4-t67dx_85bc7143-b1a6-4925-80b0-565ab710415e/frr-k8s-webhook-server/0.log" Dec 04 01:30:29.575757 master-0 kubenswrapper[33142]: I1204 01:30:29.575659 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-994774496-r7lg7_41f42803-7859-4025-b301-a5e216834d33/manager/0.log" Dec 04 01:30:29.605363 master-0 kubenswrapper[33142]: I1204 01:30:29.603583 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-589d959c4f-w2496_c32dfa8e-1fab-4316-ad2b-67234c573777/webhook-server/0.log" Dec 04 01:30:29.872365 master-0 kubenswrapper[33142]: I1204 01:30:29.872307 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcdctl/0.log" Dec 04 01:30:29.947964 master-0 kubenswrapper[33142]: I1204 01:30:29.946793 33142 generic.go:334] "Generic (PLEG): container finished" podID="a57640b3-5e74-40ac-8d37-6b0889ba383d" containerID="12c0ccfd2172fd897fa2413d9d4730f4caf36592bf273668f8b4babccabc6fc9" exitCode=0 Dec 04 01:30:29.950568 master-0 kubenswrapper[33142]: I1204 01:30:29.950497 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerDied","Data":"12c0ccfd2172fd897fa2413d9d4730f4caf36592bf273668f8b4babccabc6fc9"} Dec 04 01:30:30.074337 master-0 kubenswrapper[33142]: I1204 01:30:30.074248 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-clzsv_3fd94a76-7a42-45be-aa70-8b989177c4f6/speaker/0.log" Dec 04 01:30:30.091502 master-0 kubenswrapper[33142]: I1204 01:30:30.091331 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-clzsv_3fd94a76-7a42-45be-aa70-8b989177c4f6/kube-rbac-proxy/0.log" Dec 04 01:30:30.118599 master-0 kubenswrapper[33142]: I1204 01:30:30.118539 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knls8/master-0-debug-8clkw"] Dec 04 01:30:30.130439 master-0 kubenswrapper[33142]: I1204 01:30:30.130312 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.212293 master-0 kubenswrapper[33142]: I1204 01:30:30.211786 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/551aec3a-6fc7-440e-bc03-ee335be633fb-host\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.212293 master-0 kubenswrapper[33142]: I1204 01:30:30.211957 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zds7\" (UniqueName: \"kubernetes.io/projected/551aec3a-6fc7-440e-bc03-ee335be633fb-kube-api-access-9zds7\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.317040 master-0 kubenswrapper[33142]: I1204 01:30:30.316365 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/551aec3a-6fc7-440e-bc03-ee335be633fb-host\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.317040 master-0 kubenswrapper[33142]: I1204 01:30:30.316454 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9zds7\" (UniqueName: \"kubernetes.io/projected/551aec3a-6fc7-440e-bc03-ee335be633fb-kube-api-access-9zds7\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.317040 master-0 kubenswrapper[33142]: I1204 01:30:30.317031 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/551aec3a-6fc7-440e-bc03-ee335be633fb-host\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.338614 master-0 kubenswrapper[33142]: I1204 01:30:30.336609 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zds7\" (UniqueName: \"kubernetes.io/projected/551aec3a-6fc7-440e-bc03-ee335be633fb-kube-api-access-9zds7\") pod \"master-0-debug-8clkw\" (UID: \"551aec3a-6fc7-440e-bc03-ee335be633fb\") " pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.499969 master-0 kubenswrapper[33142]: I1204 01:30:30.499291 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/master-0-debug-8clkw" Dec 04 01:30:30.509775 master-0 kubenswrapper[33142]: I1204 01:30:30.506331 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd/0.log" Dec 04 01:30:30.534790 master-0 kubenswrapper[33142]: I1204 01:30:30.534738 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-metrics/0.log" Dec 04 01:30:30.555375 master-0 kubenswrapper[33142]: W1204 01:30:30.555307 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod551aec3a_6fc7_440e_bc03_ee335be633fb.slice/crio-6026236dcac38674775e610f3cd085e21f4d226aca384ec1d30162e1a5a4ffb5 WatchSource:0}: Error finding container 6026236dcac38674775e610f3cd085e21f4d226aca384ec1d30162e1a5a4ffb5: Status 404 returned error can't find the container with id 6026236dcac38674775e610f3cd085e21f4d226aca384ec1d30162e1a5a4ffb5 Dec 04 01:30:30.556937 master-0 kubenswrapper[33142]: I1204 01:30:30.556895 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-readyz/0.log" Dec 04 01:30:30.601897 master-0 kubenswrapper[33142]: I1204 01:30:30.601729 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-rev/0.log" Dec 04 01:30:30.634150 master-0 kubenswrapper[33142]: I1204 01:30:30.633711 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/setup/0.log" Dec 04 01:30:30.665568 master-0 kubenswrapper[33142]: I1204 01:30:30.665224 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-ensure-env-vars/0.log" Dec 04 01:30:30.949078 master-0 kubenswrapper[33142]: I1204 01:30:30.945530 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-resources-copy/0.log" Dec 04 01:30:31.039970 master-0 kubenswrapper[33142]: I1204 01:30:31.033435 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-1-master-0_af25c964-8d39-457a-9214-6cadfecf3943/installer/0.log" Dec 04 01:30:31.050545 master-0 kubenswrapper[33142]: I1204 01:30:31.050478 33142 generic.go:334] "Generic (PLEG): container finished" podID="f95061de-6d89-469c-87a3-3035a725e1b1" containerID="9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40" exitCode=0 Dec 04 01:30:31.050801 master-0 kubenswrapper[33142]: I1204 01:30:31.050599 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerDied","Data":"9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40"} Dec 04 01:30:31.063256 master-0 kubenswrapper[33142]: I1204 01:30:31.063195 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/master-0-debug-8clkw" event={"ID":"551aec3a-6fc7-440e-bc03-ee335be633fb","Type":"ContainerStarted","Data":"6026236dcac38674775e610f3cd085e21f4d226aca384ec1d30162e1a5a4ffb5"} Dec 04 01:30:31.110103 master-0 kubenswrapper[33142]: I1204 01:30:31.108839 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-2-master-0_19deb5f6-135d-4a17-8eb8-7b996f4f2e9f/installer/0.log" Dec 04 01:30:32.098956 master-0 kubenswrapper[33142]: I1204 01:30:32.098364 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerStarted","Data":"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c"} Dec 04 01:30:32.107950 master-0 kubenswrapper[33142]: I1204 01:30:32.106633 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerStarted","Data":"357d2df857b2ce3b7973417dc9ef1233e604bcf6b5b1816af3c4153e65743206"} Dec 04 01:30:32.142954 master-0 kubenswrapper[33142]: I1204 01:30:32.140959 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-9jszv" podStartSLOduration=4.439147016 podStartE2EDuration="7.140916929s" podCreationTimestamp="2025-12-04 01:30:25 +0000 UTC" firstStartedPulling="2025-12-04 01:30:28.923149815 +0000 UTC m=+2601.325151665" lastFinishedPulling="2025-12-04 01:30:31.624919728 +0000 UTC m=+2604.026921578" observedRunningTime="2025-12-04 01:30:32.130718473 +0000 UTC m=+2604.532720343" watchObservedRunningTime="2025-12-04 01:30:32.140916929 +0000 UTC m=+2604.542918789" Dec 04 01:30:32.198494 master-0 kubenswrapper[33142]: I1204 01:30:32.187918 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-p6sh6" podStartSLOduration=5.663552654 podStartE2EDuration="8.187895887s" podCreationTimestamp="2025-12-04 01:30:24 +0000 UTC" firstStartedPulling="2025-12-04 01:30:27.925044105 +0000 UTC m=+2600.327045955" lastFinishedPulling="2025-12-04 01:30:30.449387338 +0000 UTC m=+2602.851389188" observedRunningTime="2025-12-04 01:30:32.173287757 +0000 UTC m=+2604.575289617" watchObservedRunningTime="2025-12-04 01:30:32.187895887 +0000 UTC m=+2604.589897737" Dec 04 01:30:33.178302 master-0 kubenswrapper[33142]: I1204 01:30:33.178145 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication_oauth-openshift-6dd96bc56-2k2q7_3d1f393a-2463-4144-a276-3673bdeae8a2/oauth-openshift/0.log" Dec 04 01:30:33.210956 master-0 kubenswrapper[33142]: I1204 01:30:33.208753 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/assisted-installer_assisted-installer-controller-6cf87_c89c4eb9-3543-4fc1-bb2d-8395b5d573c4/assisted-installer-controller/0.log" Dec 04 01:30:34.431690 master-0 kubenswrapper[33142]: I1204 01:30:34.429630 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:34.431690 master-0 kubenswrapper[33142]: I1204 01:30:34.429698 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:34.489834 master-0 kubenswrapper[33142]: I1204 01:30:34.489594 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:35.638709 master-0 kubenswrapper[33142]: I1204 01:30:35.638205 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/2.log" Dec 04 01:30:35.677838 master-0 kubenswrapper[33142]: I1204 01:30:35.677788 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-7479ffdf48-7jnhr_d5f22827-c301-4584-b999-0a1cc1033bb5/authentication-operator/3.log" Dec 04 01:30:36.203915 master-0 kubenswrapper[33142]: I1204 01:30:36.203806 33142 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv"] Dec 04 01:30:36.215805 master-0 kubenswrapper[33142]: I1204 01:30:36.213674 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.220660 master-0 kubenswrapper[33142]: I1204 01:30:36.218881 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv"] Dec 04 01:30:36.245673 master-0 kubenswrapper[33142]: I1204 01:30:36.235792 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-sys\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.245673 master-0 kubenswrapper[33142]: I1204 01:30:36.235912 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-proc\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.245673 master-0 kubenswrapper[33142]: I1204 01:30:36.236087 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-podres\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.245673 master-0 kubenswrapper[33142]: I1204 01:30:36.236283 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285bf\" (UniqueName: \"kubernetes.io/projected/f48b40bb-0686-455a-823f-0ad9a931d632-kube-api-access-285bf\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.245673 master-0 kubenswrapper[33142]: I1204 01:30:36.236422 33142 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-lib-modules\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341087 master-0 kubenswrapper[33142]: I1204 01:30:36.340981 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-sys\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341318 master-0 kubenswrapper[33142]: I1204 01:30:36.341107 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-proc\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341318 master-0 kubenswrapper[33142]: I1204 01:30:36.341142 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-podres\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341318 master-0 kubenswrapper[33142]: I1204 01:30:36.341252 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-285bf\" (UniqueName: \"kubernetes.io/projected/f48b40bb-0686-455a-823f-0ad9a931d632-kube-api-access-285bf\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341318 master-0 kubenswrapper[33142]: I1204 01:30:36.341300 33142 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-lib-modules\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341484 master-0 kubenswrapper[33142]: I1204 01:30:36.341465 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-lib-modules\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341549 master-0 kubenswrapper[33142]: I1204 01:30:36.341529 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-sys\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341594 master-0 kubenswrapper[33142]: I1204 01:30:36.341582 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-proc\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.341659 master-0 kubenswrapper[33142]: I1204 01:30:36.341639 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f48b40bb-0686-455a-823f-0ad9a931d632-podres\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.468826 master-0 kubenswrapper[33142]: I1204 01:30:36.468694 33142 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-285bf\" (UniqueName: \"kubernetes.io/projected/f48b40bb-0686-455a-823f-0ad9a931d632-kube-api-access-285bf\") pod \"perf-node-gather-daemonset-qwdrv\" (UID: \"f48b40bb-0686-455a-823f-0ad9a931d632\") " pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.559737 master-0 kubenswrapper[33142]: I1204 01:30:36.559652 33142 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:36.942543 master-0 kubenswrapper[33142]: I1204 01:30:36.942370 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f97f57-x27s4_83e0d056-186c-4067-b586-14fe2970fcc0/router/4.log" Dec 04 01:30:36.948178 master-0 kubenswrapper[33142]: I1204 01:30:36.948116 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f97f57-x27s4_83e0d056-186c-4067-b586-14fe2970fcc0/router/3.log" Dec 04 01:30:37.058861 master-0 kubenswrapper[33142]: I1204 01:30:37.058725 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:37.059126 master-0 kubenswrapper[33142]: I1204 01:30:37.059111 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:37.119499 master-0 kubenswrapper[33142]: I1204 01:30:37.119442 33142 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:37.121551 master-0 kubenswrapper[33142]: W1204 01:30:37.121511 33142 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf48b40bb_0686_455a_823f_0ad9a931d632.slice/crio-589a6b08de32f5557d8c1d241d964bb3bac88824e690a58fdd016b8c7b5f51a6 WatchSource:0}: Error finding container 589a6b08de32f5557d8c1d241d964bb3bac88824e690a58fdd016b8c7b5f51a6: Status 404 returned error can't find the container with id 589a6b08de32f5557d8c1d241d964bb3bac88824e690a58fdd016b8c7b5f51a6 Dec 04 01:30:37.123690 master-0 kubenswrapper[33142]: I1204 01:30:37.123616 33142 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv"] Dec 04 01:30:37.221553 master-0 kubenswrapper[33142]: I1204 01:30:37.217023 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" event={"ID":"f48b40bb-0686-455a-823f-0ad9a931d632","Type":"ContainerStarted","Data":"589a6b08de32f5557d8c1d241d964bb3bac88824e690a58fdd016b8c7b5f51a6"} Dec 04 01:30:37.296023 master-0 kubenswrapper[33142]: I1204 01:30:37.294682 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:37.642068 master-0 kubenswrapper[33142]: I1204 01:30:37.641997 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:38.035820 master-0 kubenswrapper[33142]: I1204 01:30:38.035758 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-87cd489bc-llsfr_4b5c0b0e-6015-473f-b7b8-0e91900cd82d/oauth-apiserver/0.log" Dec 04 01:30:38.053349 master-0 kubenswrapper[33142]: I1204 01:30:38.053230 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-87cd489bc-llsfr_4b5c0b0e-6015-473f-b7b8-0e91900cd82d/fix-audit-permissions/0.log" Dec 04 01:30:38.234538 master-0 kubenswrapper[33142]: I1204 01:30:38.234479 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" event={"ID":"f48b40bb-0686-455a-823f-0ad9a931d632","Type":"ContainerStarted","Data":"85f132e85ea8f0a1053120bdace2d27f714ee5d23a7f2b8699430d51a72bc542"} Dec 04 01:30:38.234910 master-0 kubenswrapper[33142]: I1204 01:30:38.234894 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:38.273416 master-0 kubenswrapper[33142]: I1204 01:30:38.273318 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" podStartSLOduration=2.273291409 podStartE2EDuration="2.273291409s" podCreationTimestamp="2025-12-04 01:30:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 01:30:38.254906363 +0000 UTC m=+2610.656908223" watchObservedRunningTime="2025-12-04 01:30:38.273291409 +0000 UTC m=+2610.675293269" Dec 04 01:30:38.913844 master-0 kubenswrapper[33142]: I1204 01:30:38.913774 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/kube-rbac-proxy/0.log" Dec 04 01:30:38.953174 master-0 kubenswrapper[33142]: I1204 01:30:38.953104 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/cluster-autoscaler-operator/0.log" Dec 04 01:30:38.968286 master-0 kubenswrapper[33142]: I1204 01:30:38.968217 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-7f88444875-zwhqs_ba4531f5-90d7-41b9-9bbc-0f0d5c640d96/cluster-autoscaler-operator/1.log" Dec 04 01:30:38.997095 master-0 kubenswrapper[33142]: I1204 01:30:38.997021 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/1.log" Dec 04 01:30:38.997692 master-0 kubenswrapper[33142]: I1204 01:30:38.997656 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/cluster-baremetal-operator/2.log" Dec 04 01:30:39.014833 master-0 kubenswrapper[33142]: I1204 01:30:39.014755 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-5fdc576499-xlwrx_17f5a6f7-07dc-45cc-9db4-810f84b678d1/baremetal-kube-rbac-proxy/0.log" Dec 04 01:30:39.034609 master-0 kubenswrapper[33142]: I1204 01:30:39.034481 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72_a6a2308d-6d6f-4e8d-a6db-d931a172ed55/control-plane-machine-set-operator/1.log" Dec 04 01:30:39.035208 master-0 kubenswrapper[33142]: I1204 01:30:39.035179 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-66f4cc99d4-6sv72_a6a2308d-6d6f-4e8d-a6db-d931a172ed55/control-plane-machine-set-operator/0.log" Dec 04 01:30:39.065874 master-0 kubenswrapper[33142]: I1204 01:30:39.065723 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/kube-rbac-proxy/0.log" Dec 04 01:30:39.083556 master-0 kubenswrapper[33142]: I1204 01:30:39.083480 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/machine-api-operator/0.log" Dec 04 01:30:39.086480 master-0 kubenswrapper[33142]: I1204 01:30:39.086362 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-7486ff55f-tnhrb_e852069a-82f1-4121-9d86-277b8ca07370/machine-api-operator/1.log" Dec 04 01:30:39.248892 master-0 kubenswrapper[33142]: I1204 01:30:39.248725 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-9jszv" podUID="f95061de-6d89-469c-87a3-3035a725e1b1" containerName="registry-server" containerID="cri-o://d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c" gracePeriod=2 Dec 04 01:30:39.873042 master-0 kubenswrapper[33142]: I1204 01:30:39.867148 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:39.999828 master-0 kubenswrapper[33142]: I1204 01:30:39.998689 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w6td\" (UniqueName: \"kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td\") pod \"f95061de-6d89-469c-87a3-3035a725e1b1\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " Dec 04 01:30:39.999828 master-0 kubenswrapper[33142]: I1204 01:30:39.998824 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content\") pod \"f95061de-6d89-469c-87a3-3035a725e1b1\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " Dec 04 01:30:39.999828 master-0 kubenswrapper[33142]: I1204 01:30:39.998908 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities\") pod \"f95061de-6d89-469c-87a3-3035a725e1b1\" (UID: \"f95061de-6d89-469c-87a3-3035a725e1b1\") " Dec 04 01:30:40.000206 master-0 kubenswrapper[33142]: I1204 01:30:39.999969 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities" (OuterVolumeSpecName: "utilities") pod "f95061de-6d89-469c-87a3-3035a725e1b1" (UID: "f95061de-6d89-469c-87a3-3035a725e1b1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:30:40.001177 master-0 kubenswrapper[33142]: I1204 01:30:40.001112 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:40.027057 master-0 kubenswrapper[33142]: I1204 01:30:40.026598 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td" (OuterVolumeSpecName: "kube-api-access-9w6td") pod "f95061de-6d89-469c-87a3-3035a725e1b1" (UID: "f95061de-6d89-469c-87a3-3035a725e1b1"). InnerVolumeSpecName "kube-api-access-9w6td". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:30:40.030965 master-0 kubenswrapper[33142]: I1204 01:30:40.030038 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f95061de-6d89-469c-87a3-3035a725e1b1" (UID: "f95061de-6d89-469c-87a3-3035a725e1b1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:30:40.107190 master-0 kubenswrapper[33142]: I1204 01:30:40.107059 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f95061de-6d89-469c-87a3-3035a725e1b1-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:40.107190 master-0 kubenswrapper[33142]: I1204 01:30:40.107180 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9w6td\" (UniqueName: \"kubernetes.io/projected/f95061de-6d89-469c-87a3-3035a725e1b1-kube-api-access-9w6td\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:40.266497 master-0 kubenswrapper[33142]: I1204 01:30:40.266346 33142 generic.go:334] "Generic (PLEG): container finished" podID="f95061de-6d89-469c-87a3-3035a725e1b1" containerID="d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c" exitCode=0 Dec 04 01:30:40.266497 master-0 kubenswrapper[33142]: I1204 01:30:40.266442 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerDied","Data":"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c"} Dec 04 01:30:40.266742 master-0 kubenswrapper[33142]: I1204 01:30:40.266510 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9jszv" event={"ID":"f95061de-6d89-469c-87a3-3035a725e1b1","Type":"ContainerDied","Data":"17e21f0b5d87fe88a723551ed9df816c2556d6d77dcaf23e73ea8c3d9e36e06f"} Dec 04 01:30:40.266742 master-0 kubenswrapper[33142]: I1204 01:30:40.266541 33142 scope.go:117] "RemoveContainer" containerID="d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c" Dec 04 01:30:40.266742 master-0 kubenswrapper[33142]: I1204 01:30:40.266446 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9jszv" Dec 04 01:30:40.328026 master-0 kubenswrapper[33142]: I1204 01:30:40.327974 33142 scope.go:117] "RemoveContainer" containerID="9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40" Dec 04 01:30:40.349987 master-0 kubenswrapper[33142]: I1204 01:30:40.347400 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:40.359785 master-0 kubenswrapper[33142]: I1204 01:30:40.358121 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-9jszv"] Dec 04 01:30:40.379546 master-0 kubenswrapper[33142]: I1204 01:30:40.371291 33142 scope.go:117] "RemoveContainer" containerID="f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78" Dec 04 01:30:40.456121 master-0 kubenswrapper[33142]: I1204 01:30:40.454954 33142 scope.go:117] "RemoveContainer" containerID="d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c" Dec 04 01:30:40.460303 master-0 kubenswrapper[33142]: E1204 01:30:40.459234 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c\": container with ID starting with d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c not found: ID does not exist" containerID="d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c" Dec 04 01:30:40.460303 master-0 kubenswrapper[33142]: I1204 01:30:40.459312 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c"} err="failed to get container status \"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c\": rpc error: code = NotFound desc = could not find container \"d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c\": container with ID starting with d30f240dbfaf2b3f2f35a57cd580eefd7578c7746271522fd8b106a5a885a76c not found: ID does not exist" Dec 04 01:30:40.460303 master-0 kubenswrapper[33142]: I1204 01:30:40.459353 33142 scope.go:117] "RemoveContainer" containerID="9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40" Dec 04 01:30:40.461048 master-0 kubenswrapper[33142]: E1204 01:30:40.460735 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40\": container with ID starting with 9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40 not found: ID does not exist" containerID="9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40" Dec 04 01:30:40.461048 master-0 kubenswrapper[33142]: I1204 01:30:40.460813 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40"} err="failed to get container status \"9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40\": rpc error: code = NotFound desc = could not find container \"9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40\": container with ID starting with 9c81dc4720bdb5ec98755d7308cdd4da00bc58e2ba82998d0dce07764b818d40 not found: ID does not exist" Dec 04 01:30:40.461048 master-0 kubenswrapper[33142]: I1204 01:30:40.460867 33142 scope.go:117] "RemoveContainer" containerID="f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78" Dec 04 01:30:40.465821 master-0 kubenswrapper[33142]: E1204 01:30:40.465689 33142 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78\": container with ID starting with f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78 not found: ID does not exist" containerID="f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78" Dec 04 01:30:40.465821 master-0 kubenswrapper[33142]: I1204 01:30:40.465773 33142 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78"} err="failed to get container status \"f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78\": rpc error: code = NotFound desc = could not find container \"f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78\": container with ID starting with f16e4aaead6151559a2a6ea56a9bf26fa41fc353e4c83a7b96a193860dd77c78 not found: ID does not exist" Dec 04 01:30:40.649448 master-0 kubenswrapper[33142]: I1204 01:30:40.649351 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/cluster-cloud-controller-manager/0.log" Dec 04 01:30:40.651653 master-0 kubenswrapper[33142]: I1204 01:30:40.651612 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/cluster-cloud-controller-manager/1.log" Dec 04 01:30:40.670377 master-0 kubenswrapper[33142]: I1204 01:30:40.670299 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/0.log" Dec 04 01:30:40.671674 master-0 kubenswrapper[33142]: I1204 01:30:40.671254 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/config-sync-controllers/1.log" Dec 04 01:30:40.686713 master-0 kubenswrapper[33142]: I1204 01:30:40.686580 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-6c74dddbfb-r74rw_b900991f-c6ec-45d1-a76b-44aec0f56cde/kube-rbac-proxy/0.log" Dec 04 01:30:41.914870 master-0 kubenswrapper[33142]: I1204 01:30:41.914788 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f95061de-6d89-469c-87a3-3035a725e1b1" path="/var/lib/kubelet/pods/f95061de-6d89-469c-87a3-3035a725e1b1/volumes" Dec 04 01:30:42.829697 master-0 kubenswrapper[33142]: I1204 01:30:42.829631 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-credential-operator_cloud-credential-operator-7c4dc67499-shsm8_890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/kube-rbac-proxy/0.log" Dec 04 01:30:42.864442 master-0 kubenswrapper[33142]: I1204 01:30:42.864271 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-credential-operator_cloud-credential-operator-7c4dc67499-shsm8_890fd2c0-ac22-4d85-aa02-8f6c4518b7a1/cloud-credential-operator/0.log" Dec 04 01:30:44.481276 master-0 kubenswrapper[33142]: I1204 01:30:44.481206 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:44.576427 master-0 kubenswrapper[33142]: I1204 01:30:44.576315 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:44.933161 master-0 kubenswrapper[33142]: I1204 01:30:44.933100 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68c95b6cf5-qgr6l_49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/openshift-config-operator/2.log" Dec 04 01:30:44.935571 master-0 kubenswrapper[33142]: I1204 01:30:44.934074 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68c95b6cf5-qgr6l_49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/openshift-config-operator/1.log" Dec 04 01:30:44.945666 master-0 kubenswrapper[33142]: I1204 01:30:44.945632 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68c95b6cf5-qgr6l_49bd2d0a-d2b5-423d-adb2-61fdf9a51e39/openshift-api/0.log" Dec 04 01:30:45.346306 master-0 kubenswrapper[33142]: I1204 01:30:45.346229 33142 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-p6sh6" podUID="a57640b3-5e74-40ac-8d37-6b0889ba383d" containerName="registry-server" containerID="cri-o://357d2df857b2ce3b7973417dc9ef1233e604bcf6b5b1816af3c4153e65743206" gracePeriod=2 Dec 04 01:30:45.828158 master-0 kubenswrapper[33142]: I1204 01:30:45.828036 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-77df56447c-khvgx_dc637782-0c5c-43ae-bc94-03aad6a509c3/console-operator/0.log" Dec 04 01:30:46.369790 master-0 kubenswrapper[33142]: I1204 01:30:46.369643 33142 generic.go:334] "Generic (PLEG): container finished" podID="a57640b3-5e74-40ac-8d37-6b0889ba383d" containerID="357d2df857b2ce3b7973417dc9ef1233e604bcf6b5b1816af3c4153e65743206" exitCode=0 Dec 04 01:30:46.369790 master-0 kubenswrapper[33142]: I1204 01:30:46.369731 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerDied","Data":"357d2df857b2ce3b7973417dc9ef1233e604bcf6b5b1816af3c4153e65743206"} Dec 04 01:30:46.494957 master-0 kubenswrapper[33142]: I1204 01:30:46.492412 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-588c8f5cd5-nqpcn_6f5ab3bb-7099-4809-b946-a7bb6313c2ee/console/0.log" Dec 04 01:30:46.531006 master-0 kubenswrapper[33142]: I1204 01:30:46.530278 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6f5db8559b-fgz5r_07652d83-b353-4e4f-b234-c60d7f704e62/download-server/0.log" Dec 04 01:30:46.601294 master-0 kubenswrapper[33142]: I1204 01:30:46.601110 33142 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-knls8/perf-node-gather-daemonset-qwdrv" Dec 04 01:30:47.542416 master-0 kubenswrapper[33142]: I1204 01:30:47.541874 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-f84784664-zvrvl_95141f9b-b6b0-40dc-a6e2-b5c84d24caac/cluster-storage-operator/0.log" Dec 04 01:30:47.545296 master-0 kubenswrapper[33142]: I1204 01:30:47.545251 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-f84784664-zvrvl_95141f9b-b6b0-40dc-a6e2-b5c84d24caac/cluster-storage-operator/1.log" Dec 04 01:30:47.564951 master-0 kubenswrapper[33142]: I1204 01:30:47.564878 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/4.log" Dec 04 01:30:47.565612 master-0 kubenswrapper[33142]: I1204 01:30:47.565584 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-86897dd478-8zdrm_dc7bfc47-972c-4493-8372-f211c6645ff5/snapshot-controller/5.log" Dec 04 01:30:47.591781 master-0 kubenswrapper[33142]: I1204 01:30:47.591714 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-operator-7b795784b8-6cgj2_285a1e74-1d8e-452e-a5a4-484afc10e10f/csi-snapshot-controller-operator/0.log" Dec 04 01:30:47.593611 master-0 kubenswrapper[33142]: I1204 01:30:47.593580 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-operator-7b795784b8-6cgj2_285a1e74-1d8e-452e-a5a4-484afc10e10f/csi-snapshot-controller-operator/1.log" Dec 04 01:30:48.454744 master-0 kubenswrapper[33142]: I1204 01:30:48.454501 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-6b7bcd6566-v5f4p_e8375dfa-3a83-415b-bce5-0819a73255c1/dns-operator/0.log" Dec 04 01:30:48.475577 master-0 kubenswrapper[33142]: I1204 01:30:48.473774 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-6b7bcd6566-v5f4p_e8375dfa-3a83-415b-bce5-0819a73255c1/kube-rbac-proxy/0.log" Dec 04 01:30:48.674796 master-0 kubenswrapper[33142]: I1204 01:30:48.674746 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:48.748579 master-0 kubenswrapper[33142]: I1204 01:30:48.748500 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities\") pod \"a57640b3-5e74-40ac-8d37-6b0889ba383d\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " Dec 04 01:30:48.748849 master-0 kubenswrapper[33142]: I1204 01:30:48.748658 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx9zj\" (UniqueName: \"kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj\") pod \"a57640b3-5e74-40ac-8d37-6b0889ba383d\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " Dec 04 01:30:48.748902 master-0 kubenswrapper[33142]: I1204 01:30:48.748866 33142 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content\") pod \"a57640b3-5e74-40ac-8d37-6b0889ba383d\" (UID: \"a57640b3-5e74-40ac-8d37-6b0889ba383d\") " Dec 04 01:30:48.752289 master-0 kubenswrapper[33142]: I1204 01:30:48.752253 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities" (OuterVolumeSpecName: "utilities") pod "a57640b3-5e74-40ac-8d37-6b0889ba383d" (UID: "a57640b3-5e74-40ac-8d37-6b0889ba383d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:30:48.754246 master-0 kubenswrapper[33142]: I1204 01:30:48.754198 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj" (OuterVolumeSpecName: "kube-api-access-fx9zj") pod "a57640b3-5e74-40ac-8d37-6b0889ba383d" (UID: "a57640b3-5e74-40ac-8d37-6b0889ba383d"). InnerVolumeSpecName "kube-api-access-fx9zj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 01:30:48.816806 master-0 kubenswrapper[33142]: I1204 01:30:48.816687 33142 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a57640b3-5e74-40ac-8d37-6b0889ba383d" (UID: "a57640b3-5e74-40ac-8d37-6b0889ba383d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 01:30:48.853414 master-0 kubenswrapper[33142]: I1204 01:30:48.853329 33142 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:48.853414 master-0 kubenswrapper[33142]: I1204 01:30:48.853391 33142 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fx9zj\" (UniqueName: \"kubernetes.io/projected/a57640b3-5e74-40ac-8d37-6b0889ba383d-kube-api-access-fx9zj\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:48.853414 master-0 kubenswrapper[33142]: I1204 01:30:48.853408 33142 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a57640b3-5e74-40ac-8d37-6b0889ba383d-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 01:30:49.207867 master-0 kubenswrapper[33142]: I1204 01:30:49.207800 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cr7sj_f190ddab-e7d0-4dd6-8bb7-359a02393259/dns/0.log" Dec 04 01:30:49.226345 master-0 kubenswrapper[33142]: I1204 01:30:49.226273 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cr7sj_f190ddab-e7d0-4dd6-8bb7-359a02393259/kube-rbac-proxy/0.log" Dec 04 01:30:49.270667 master-0 kubenswrapper[33142]: I1204 01:30:49.270604 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5bwrm_e85684df-0014-4d28-9b00-9c6a6942cc94/dns-node-resolver/0.log" Dec 04 01:30:49.423011 master-0 kubenswrapper[33142]: I1204 01:30:49.421684 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knls8/master-0-debug-8clkw" event={"ID":"551aec3a-6fc7-440e-bc03-ee335be633fb","Type":"ContainerStarted","Data":"6e4e0d63d8549c8e910265fec9f7f31ed8d52e2733fd3c071e91a17f6d82041a"} Dec 04 01:30:49.426064 master-0 kubenswrapper[33142]: I1204 01:30:49.425974 33142 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p6sh6" event={"ID":"a57640b3-5e74-40ac-8d37-6b0889ba383d","Type":"ContainerDied","Data":"d1baf4b611c9199b7b0f600799d7e73f88799fba2d680668d14e2ec777b1c53f"} Dec 04 01:30:49.426064 master-0 kubenswrapper[33142]: I1204 01:30:49.426049 33142 scope.go:117] "RemoveContainer" containerID="357d2df857b2ce3b7973417dc9ef1233e604bcf6b5b1816af3c4153e65743206" Dec 04 01:30:49.426279 master-0 kubenswrapper[33142]: I1204 01:30:49.426253 33142 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p6sh6" Dec 04 01:30:49.456207 master-0 kubenswrapper[33142]: I1204 01:30:49.456122 33142 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-knls8/master-0-debug-8clkw" podStartSLOduration=1.7733487449999998 podStartE2EDuration="19.456099053s" podCreationTimestamp="2025-12-04 01:30:30 +0000 UTC" firstStartedPulling="2025-12-04 01:30:30.563202243 +0000 UTC m=+2602.965204093" lastFinishedPulling="2025-12-04 01:30:48.245952551 +0000 UTC m=+2620.647954401" observedRunningTime="2025-12-04 01:30:49.445747473 +0000 UTC m=+2621.847749323" watchObservedRunningTime="2025-12-04 01:30:49.456099053 +0000 UTC m=+2621.858100913" Dec 04 01:30:49.502032 master-0 kubenswrapper[33142]: I1204 01:30:49.501813 33142 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:49.519037 master-0 kubenswrapper[33142]: I1204 01:30:49.518961 33142 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-p6sh6"] Dec 04 01:30:49.531208 master-0 kubenswrapper[33142]: I1204 01:30:49.530486 33142 scope.go:117] "RemoveContainer" containerID="12c0ccfd2172fd897fa2413d9d4730f4caf36592bf273668f8b4babccabc6fc9" Dec 04 01:30:49.560753 master-0 kubenswrapper[33142]: I1204 01:30:49.560682 33142 scope.go:117] "RemoveContainer" containerID="8f1fe360cb38dc9869066a04b55327a6f97a21c5ce9e537ce8099a695b89e185" Dec 04 01:30:49.916577 master-0 kubenswrapper[33142]: I1204 01:30:49.916488 33142 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57640b3-5e74-40ac-8d37-6b0889ba383d" path="/var/lib/kubelet/pods/a57640b3-5e74-40ac-8d37-6b0889ba383d/volumes" Dec 04 01:30:50.049195 master-0 kubenswrapper[33142]: I1204 01:30:50.049084 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/3.log" Dec 04 01:30:50.052420 master-0 kubenswrapper[33142]: I1204 01:30:50.052352 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-7978bf889c-zkr9h_3e901355-2d0f-46f9-9d64-c4bc900b1839/etcd-operator/2.log" Dec 04 01:30:50.776893 master-0 kubenswrapper[33142]: I1204 01:30:50.776823 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcdctl/0.log" Dec 04 01:30:51.219695 master-0 kubenswrapper[33142]: I1204 01:30:51.219600 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd/0.log" Dec 04 01:30:51.242959 master-0 kubenswrapper[33142]: I1204 01:30:51.242858 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-metrics/0.log" Dec 04 01:30:51.284829 master-0 kubenswrapper[33142]: I1204 01:30:51.283642 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-readyz/0.log" Dec 04 01:30:51.321359 master-0 kubenswrapper[33142]: I1204 01:30:51.321150 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-rev/0.log" Dec 04 01:30:51.336817 master-0 kubenswrapper[33142]: I1204 01:30:51.336758 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/setup/0.log" Dec 04 01:30:51.357576 master-0 kubenswrapper[33142]: I1204 01:30:51.356909 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-ensure-env-vars/0.log" Dec 04 01:30:51.377651 master-0 kubenswrapper[33142]: I1204 01:30:51.377569 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_4dd8b778e190b1975a0a8fad534da6dd/etcd-resources-copy/0.log" Dec 04 01:30:51.430820 master-0 kubenswrapper[33142]: I1204 01:30:51.430748 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-1-master-0_af25c964-8d39-457a-9214-6cadfecf3943/installer/0.log" Dec 04 01:30:51.489583 master-0 kubenswrapper[33142]: I1204 01:30:51.489489 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-2-master-0_19deb5f6-135d-4a17-8eb8-7b996f4f2e9f/installer/0.log" Dec 04 01:30:52.362065 master-0 kubenswrapper[33142]: I1204 01:30:52.362000 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-65dc4bcb88-2m45m_46a9c1fd-6e78-4d87-85ef-f8fc195bb980/cluster-image-registry-operator/1.log" Dec 04 01:30:52.363181 master-0 kubenswrapper[33142]: I1204 01:30:52.363151 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-65dc4bcb88-2m45m_46a9c1fd-6e78-4d87-85ef-f8fc195bb980/cluster-image-registry-operator/0.log" Dec 04 01:30:52.384614 master-0 kubenswrapper[33142]: I1204 01:30:52.384541 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b6t29_9ed02507-e1a5-4179-8011-c0bdfbb60d82/node-ca/0.log" Dec 04 01:30:53.171044 master-0 kubenswrapper[33142]: I1204 01:30:53.170980 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/4.log" Dec 04 01:30:53.179892 master-0 kubenswrapper[33142]: I1204 01:30:53.179758 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/ingress-operator/5.log" Dec 04 01:30:53.201191 master-0 kubenswrapper[33142]: I1204 01:30:53.200580 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-85dbd94574-7clvx_c0f3ded2-925e-4d86-9c91-55b5df9f28ab/kube-rbac-proxy/0.log" Dec 04 01:30:54.052800 master-0 kubenswrapper[33142]: I1204 01:30:54.052742 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn56p_df783888-6b82-48e8-aad0-ee77f7167115/serve-healthcheck-canary/0.log" Dec 04 01:30:54.818099 master-0 kubenswrapper[33142]: I1204 01:30:54.818026 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-59d99f9b7b-jl84b_e5d561ad-8e4f-4ac7-8ee8-b43ad5ca603c/insights-operator/0.log" Dec 04 01:30:57.297352 master-0 kubenswrapper[33142]: I1204 01:30:57.297285 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/alertmanager/0.log" Dec 04 01:30:57.324004 master-0 kubenswrapper[33142]: I1204 01:30:57.323912 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/config-reloader/0.log" Dec 04 01:30:57.348848 master-0 kubenswrapper[33142]: I1204 01:30:57.348799 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/kube-rbac-proxy-web/0.log" Dec 04 01:30:57.382172 master-0 kubenswrapper[33142]: I1204 01:30:57.382087 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/kube-rbac-proxy/0.log" Dec 04 01:30:58.012047 master-0 kubenswrapper[33142]: I1204 01:30:58.011944 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/kube-rbac-proxy-metric/0.log" Dec 04 01:30:58.208650 master-0 kubenswrapper[33142]: I1204 01:30:58.208575 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/prom-label-proxy/0.log" Dec 04 01:30:58.238039 master-0 kubenswrapper[33142]: I1204 01:30:58.237959 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a86808d-5aed-496e-b46d-c62e0e2afc8c/init-config-reloader/0.log" Dec 04 01:30:58.316437 master-0 kubenswrapper[33142]: I1204 01:30:58.316250 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69cc794c58-5cpjn_f2f01d68-92ae-45b8-8501-645e439b5295/cluster-monitoring-operator/0.log" Dec 04 01:30:58.356517 master-0 kubenswrapper[33142]: I1204 01:30:58.352782 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7dcc7f9bd6-cwhhx_5aabcb3b-483d-419b-98ce-0ffd0ce265e8/kube-state-metrics/0.log" Dec 04 01:30:58.380724 master-0 kubenswrapper[33142]: I1204 01:30:58.378571 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7dcc7f9bd6-cwhhx_5aabcb3b-483d-419b-98ce-0ffd0ce265e8/kube-rbac-proxy-main/0.log" Dec 04 01:30:58.412461 master-0 kubenswrapper[33142]: I1204 01:30:58.412249 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7dcc7f9bd6-cwhhx_5aabcb3b-483d-419b-98ce-0ffd0ce265e8/kube-rbac-proxy-self/0.log" Dec 04 01:30:58.438359 master-0 kubenswrapper[33142]: I1204 01:30:58.436745 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dfc8cdd-mb55t_f67fa153-3692-4544-9bbb-f26ad8094470/metrics-server/0.log" Dec 04 01:30:58.463435 master-0 kubenswrapper[33142]: I1204 01:30:58.463373 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-66f56d49bd-gfnhw_a32a0665-3db5-4531-8d77-96742354cf06/monitoring-plugin/0.log" Dec 04 01:30:58.493001 master-0 kubenswrapper[33142]: I1204 01:30:58.492068 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpjf_4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/node-exporter/0.log" Dec 04 01:30:58.509028 master-0 kubenswrapper[33142]: I1204 01:30:58.508957 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpjf_4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/kube-rbac-proxy/0.log" Dec 04 01:30:58.532124 master-0 kubenswrapper[33142]: I1204 01:30:58.532037 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpjf_4adeb2c2-10ba-420a-be0b-fb2329ac3fe2/init-textfile/0.log" Dec 04 01:30:58.564304 master-0 kubenswrapper[33142]: I1204 01:30:58.564221 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57cbc648f8-tmqmn_1288d627-f7c2-47d5-aa02-2c86d5f82369/kube-rbac-proxy-main/0.log" Dec 04 01:30:58.582147 master-0 kubenswrapper[33142]: I1204 01:30:58.580807 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57cbc648f8-tmqmn_1288d627-f7c2-47d5-aa02-2c86d5f82369/kube-rbac-proxy-self/0.log" Dec 04 01:30:58.615790 master-0 kubenswrapper[33142]: I1204 01:30:58.615723 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57cbc648f8-tmqmn_1288d627-f7c2-47d5-aa02-2c86d5f82369/openshift-state-metrics/0.log" Dec 04 01:30:58.660418 master-0 kubenswrapper[33142]: I1204 01:30:58.660322 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/prometheus/0.log" Dec 04 01:30:58.681918 master-0 kubenswrapper[33142]: I1204 01:30:58.681811 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/config-reloader/0.log" Dec 04 01:30:58.710721 master-0 kubenswrapper[33142]: I1204 01:30:58.710648 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/thanos-sidecar/0.log" Dec 04 01:30:58.728168 master-0 kubenswrapper[33142]: I1204 01:30:58.728092 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/kube-rbac-proxy-web/0.log" Dec 04 01:30:58.762340 master-0 kubenswrapper[33142]: I1204 01:30:58.762237 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/kube-rbac-proxy/0.log" Dec 04 01:30:58.778317 master-0 kubenswrapper[33142]: I1204 01:30:58.777517 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/kube-rbac-proxy-thanos/0.log" Dec 04 01:30:58.802945 master-0 kubenswrapper[33142]: I1204 01:30:58.802830 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835063d-37c3-4fc1-8fbe-a79ceb8b59eb/init-config-reloader/0.log" Dec 04 01:30:58.836349 master-0 kubenswrapper[33142]: I1204 01:30:58.836171 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-565bdcb8-8dcsg_8d4d3057-9f71-4b07-b463-51cc49d28bf3/prometheus-operator/0.log" Dec 04 01:30:58.856884 master-0 kubenswrapper[33142]: I1204 01:30:58.856809 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-565bdcb8-8dcsg_8d4d3057-9f71-4b07-b463-51cc49d28bf3/kube-rbac-proxy/0.log" Dec 04 01:30:58.890063 master-0 kubenswrapper[33142]: I1204 01:30:58.889990 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6d4cbfb4b-tsnwc_cd208ca4-eb77-49a9-87a9-e0a617526e5d/prometheus-operator-admission-webhook/0.log" Dec 04 01:30:58.953592 master-0 kubenswrapper[33142]: I1204 01:30:58.953531 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69695c56bc-5tscf_b4dc6d45-957e-479c-ade4-1a03ebeef927/telemeter-client/0.log" Dec 04 01:30:58.989300 master-0 kubenswrapper[33142]: I1204 01:30:58.989229 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69695c56bc-5tscf_b4dc6d45-957e-479c-ade4-1a03ebeef927/reload/0.log" Dec 04 01:30:59.020566 master-0 kubenswrapper[33142]: I1204 01:30:59.019530 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69695c56bc-5tscf_b4dc6d45-957e-479c-ade4-1a03ebeef927/kube-rbac-proxy/0.log" Dec 04 01:30:59.055624 master-0 kubenswrapper[33142]: I1204 01:30:59.055522 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/thanos-query/0.log" Dec 04 01:30:59.071847 master-0 kubenswrapper[33142]: I1204 01:30:59.071772 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/kube-rbac-proxy-web/0.log" Dec 04 01:30:59.098506 master-0 kubenswrapper[33142]: I1204 01:30:59.098368 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/kube-rbac-proxy/0.log" Dec 04 01:30:59.116713 master-0 kubenswrapper[33142]: I1204 01:30:59.116633 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/prom-label-proxy/0.log" Dec 04 01:30:59.141514 master-0 kubenswrapper[33142]: I1204 01:30:59.141418 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/kube-rbac-proxy-rules/0.log" Dec 04 01:30:59.162165 master-0 kubenswrapper[33142]: I1204 01:30:59.162102 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6db5f86c74-5rwks_697e7e4b-be49-48e2-9675-63b179187c48/kube-rbac-proxy-metrics/0.log" Dec 04 01:31:01.117420 master-0 kubenswrapper[33142]: I1204 01:31:01.117267 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-x4fnw_201d2247-e8f9-498e-b990-f9d610a70997/controller/0.log" Dec 04 01:31:01.228519 master-0 kubenswrapper[33142]: I1204 01:31:01.228461 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-x4fnw_201d2247-e8f9-498e-b990-f9d610a70997/kube-rbac-proxy/0.log" Dec 04 01:31:01.497879 master-0 kubenswrapper[33142]: I1204 01:31:01.497694 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/controller/0.log" Dec 04 01:31:02.852678 master-0 kubenswrapper[33142]: I1204 01:31:02.849181 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/frr/0.log" Dec 04 01:31:03.072813 master-0 kubenswrapper[33142]: I1204 01:31:03.072750 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/reloader/0.log" Dec 04 01:31:03.100266 master-0 kubenswrapper[33142]: I1204 01:31:03.100192 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/frr-metrics/0.log" Dec 04 01:31:03.119684 master-0 kubenswrapper[33142]: I1204 01:31:03.119544 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/kube-rbac-proxy/0.log" Dec 04 01:31:03.137356 master-0 kubenswrapper[33142]: I1204 01:31:03.136670 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/kube-rbac-proxy-frr/0.log" Dec 04 01:31:03.160113 master-0 kubenswrapper[33142]: I1204 01:31:03.160053 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-frr-files/0.log" Dec 04 01:31:03.186970 master-0 kubenswrapper[33142]: I1204 01:31:03.183033 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-reloader/0.log" Dec 04 01:31:03.210036 master-0 kubenswrapper[33142]: I1204 01:31:03.208814 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-9pqnp_cecefec9-7a77-44be-aa90-b8aeacf31584/cp-metrics/0.log" Dec 04 01:31:03.237232 master-0 kubenswrapper[33142]: I1204 01:31:03.237168 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-7fcb986d4-t67dx_85bc7143-b1a6-4925-80b0-565ab710415e/frr-k8s-webhook-server/0.log" Dec 04 01:31:03.290003 master-0 kubenswrapper[33142]: I1204 01:31:03.289847 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-994774496-r7lg7_41f42803-7859-4025-b301-a5e216834d33/manager/0.log" Dec 04 01:31:03.309115 master-0 kubenswrapper[33142]: I1204 01:31:03.309055 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-589d959c4f-w2496_c32dfa8e-1fab-4316-ad2b-67234c573777/webhook-server/0.log" Dec 04 01:31:03.683308 master-0 kubenswrapper[33142]: I1204 01:31:03.681981 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-clzsv_3fd94a76-7a42-45be-aa70-8b989177c4f6/speaker/0.log" Dec 04 01:31:03.699275 master-0 kubenswrapper[33142]: I1204 01:31:03.699210 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-clzsv_3fd94a76-7a42-45be-aa70-8b989177c4f6/kube-rbac-proxy/0.log" Dec 04 01:31:05.862944 master-0 kubenswrapper[33142]: I1204 01:31:05.862796 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-bbd9b9dff-lqlgs_cb121145-3e1a-49da-aac5-822cf65eefcf/cluster-node-tuning-operator/1.log" Dec 04 01:31:05.864196 master-0 kubenswrapper[33142]: I1204 01:31:05.864162 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-bbd9b9dff-lqlgs_cb121145-3e1a-49da-aac5-822cf65eefcf/cluster-node-tuning-operator/0.log" Dec 04 01:31:05.887705 master-0 kubenswrapper[33142]: I1204 01:31:05.887626 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-df7ld_21e8bd47-93e6-4068-a6fb-ba34255103d2/tuned/0.log" Dec 04 01:31:07.643326 master-0 kubenswrapper[33142]: I1204 01:31:07.643248 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-5b557b5f57-z9mw6_f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/kube-apiserver-operator/0.log" Dec 04 01:31:07.655370 master-0 kubenswrapper[33142]: I1204 01:31:07.655301 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-5b557b5f57-z9mw6_f4d39cde-d7b9-4156-afd1-cc4f23b9b16a/kube-apiserver-operator/1.log" Dec 04 01:31:09.960761 master-0 kubenswrapper[33142]: I1204 01:31:09.960694 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_f099c1a6-5f9e-4d81-8656-dd8f003f0143/installer/0.log" Dec 04 01:31:09.989221 master-0 kubenswrapper[33142]: I1204 01:31:09.989126 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-3-master-0_a37027d2-eeb1-416b-b67e-7ee233c42d04/installer/0.log" Dec 04 01:31:10.019626 master-0 kubenswrapper[33142]: I1204 01:31:10.019540 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-4-master-0_6f06fa67-196e-4ec9-b0f8-6d6956f8158c/installer/0.log" Dec 04 01:31:10.048448 master-0 kubenswrapper[33142]: I1204 01:31:10.048374 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-5-master-0_bcf7f3cb-7c5e-4c02-82dd-3b33ebde45c1/installer/0.log" Dec 04 01:31:10.520747 master-0 kubenswrapper[33142]: I1204 01:31:10.520653 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver/0.log" Dec 04 01:31:10.536966 master-0 kubenswrapper[33142]: I1204 01:31:10.536237 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-cert-syncer/0.log" Dec 04 01:31:10.556842 master-0 kubenswrapper[33142]: I1204 01:31:10.556789 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-cert-regeneration-controller/0.log" Dec 04 01:31:10.569897 master-0 kubenswrapper[33142]: I1204 01:31:10.569843 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-insecure-readyz/0.log" Dec 04 01:31:10.587366 master-0 kubenswrapper[33142]: I1204 01:31:10.587278 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-check-endpoints/1.log" Dec 04 01:31:10.588725 master-0 kubenswrapper[33142]: I1204 01:31:10.588690 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/kube-apiserver-check-endpoints/0.log" Dec 04 01:31:10.600235 master-0 kubenswrapper[33142]: I1204 01:31:10.600181 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_8a00233b22d19df39b2e1c8ba133b3c2/setup/0.log" Dec 04 01:31:11.964253 master-0 kubenswrapper[33142]: I1204 01:31:11.964171 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/kube-rbac-proxy/0.log" Dec 04 01:31:11.984004 master-0 kubenswrapper[33142]: I1204 01:31:11.983866 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/1.log" Dec 04 01:31:11.987460 master-0 kubenswrapper[33142]: I1204 01:31:11.987274 33142 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-754cfd84-zjpxn_bd6b9ed0-eaf7-4977-bd6e-4a1afaba9ced/manager/2.log"